Google half-way cancelled their SOAP API a while ago, but they now* offer a parametrized URL that returns a JSON data set. Google says this REST approach is useful for "Flash developers, and those developers that have a need to access the AJAX Search API from other Non-Javascript environments." This may be even simpler to use than the SOAP API, though I wonder how long (and how well) it's going to be working. Here's an example query:

ajax.googleapis.com/ajax/ services/search/web?v=1.0&q=hello%20world

This URL format can also be adjusted to grab results from video search, book search and so on.

While the URL has the word AJAX in the string and this is officially part of the Google AJAX Search API, this has nothing to do with AJAX per se, as the URL can be called from other environments, including the server side. All you need is a JSON library to parse the results (JSON means JavaScript Object Notation, though it also doesn't require JavaScript). The Yahoo Search API already utilizes a similar approach, though it returns XML.

Eugenius, who noted this in the forum, says "I'm wondering if Google opened up this channel so that App Engine developers would have Python access to it's search, translation, and feed-cache products?"

On the other hand, it's also fairly easy to just screenscrape Google results, though it may be against your netiquette as it may require ignoring the robots.txt file by Google (Google's robots guidelines disallow direct bot-spidering of their search results). The bonus is that it can work on any kind of Google result as well as any website, whether the site provides an API or not. Here's a PHP5 sample that grabs the Google top 10 results, for instance – to PHP it doesn't matter whether the Google result page is valid HTML (let alone valid XHTML), it just parses pretty much anything into a neat object model that is searchable via XPath:

$url = 'http://www.google.com/search?hl=en&q=';
$nodes = getHtmlNodes($url . 'hello+world',
        '//h2/a[@class="l"]');
foreach ($nodes as $node) {
    $url = $node->getAttribute('href');
    echo htmlEntities($url) . '<br />';
}

function getHtmlNodes($url, $xpath) {
    $dom = new domdocument;
    @$dom->loadHtmlFile($url);
    $oXpath = new domXpath($dom);
    return $oXpath->query($xpath);
}

[Thanks Eugenius!]

*I'm not sure how recent this is.

[By Philipp Lenssen | Origin: Google REST Search API | Comments]

[Advertisement] Hakia -- Get into the semantic search now

Over the past few days at the Next Web conference in Amsterdam, I had the opportunity to hang out with about 700 Internet entrepreneurs from all over Europe. The startup scene in Europe reminds me of Silicon Valley four or five years ago—hungry startups building Web companies on the cheap and products that scratch a personal itch.

Swedish startup Twingly, for instance, wants to come up with spam-free blog search by starting with the best 450,000 blogs and letting users share blog posts with each other. Paris-based Zilok is creating an eBay for renting things such as drills and digital projectors. London’s Fav.or.it makes a feed reader with extra powers—you can leave comments on blogs within the reader, it ranks posts based on how much they are actually read, and it lets you filter posts by tag, rank, or category. In Munich, andUnite has created a service that allows you to collect your search terms and share them with others.

And a handful of companies are even gaining substantial traction. I was surprised to learn that the social network Netlog claims 30 million unique visitors and four billion page views per month (comScore counts 11 million visitors, but five billion page views). Netlog operates in 15 different languages, and 20 countries. Then there is eBuddy, the Meebo of Europe, which boasts 12 million Web users and 1.6 million mobile users of its Web-based instant-messaging service.

Most of the startups I encountered, however, are still operating under the radar—in Romania, Sweden, Holland, Ireland, France. But a cross-border Web 2.0 culture is definitely gaining steam across Europe. Technology itself is helping to break down borders. A VC showed me the landing page on his mobile phone. It wasn’t his e-mail. It was Twitter. Another startup founder told me that Twitter helps him keep a dialogue going with other entrepreneurs and VCs across Europe, and even with contacts in the U.S.

Europe is still a mosaic of employment law, tax regulations, and cultural habits that can influence where it makes the most sense to locate different parts of a business. One Dutch CEO, for instance, told me that it costs you need a minimum of 18,000 Euros in starting capital just to incorporate in the Netherlands. And that is just the government’s fee.

When I asked which region was most likely to emerge as Europe’s Silicon Valley, the answers were all over the map: London, Munich, Berlin, Zurich, Geneva, even Barcelona. The money is in London, cheap office space is in Berlin, the mobile expertise is in Helsinki, the weather’s nice in Barcelona, and the inexpensive engineers are in Estonia (which may not even consider itself part of Europe, but is close enough to manage from Berlin or Amsterdam).

As Europe searches for its Silicon Valley, it may turn up as a state of mind rather than a specific place. The truth is that Europe may not need a single Silicon Valley because business is becoming so distributed. While some Silicon-Valley chauvinists may disagree, the idea of concentrating all the talent and capital in one region seems so last century to many Euro 2.0 entrepreneurs.

(Photo © Pieter Baert).

Crunch Network: CrunchGear drool over the sexiest new gadgets and hardware.

Over the past few days at the Next Web conference in Amsterdam, I had the opportunity to hang out with about 700 Internet entrepreneurs from all over Europe. The startup scene in Europe reminds me of Silicon Valley four or five years ago—hungry startups building Web companies on the cheap and products that scratch a personal itch.

Swedish startup Twingly, for instance, wants to come up with spam-free blog search by starting with the best 450,000 blogs and letting users share blog posts with each other. ParisBrussels-based Zilok is creating an eBay for renting things such as drills and digital projectors. London’s Fav.or.it makes a feed reader with extra powers—you can leave comments on blogs within the reader, it ranks posts based on how much they are actually read, and it lets you filter posts by tag, rank, or category. In Munich, andUnite has created a service that allows you to collect your search terms and share them with others.

And a handful of companies are even gaining substantial traction. I was surprised to learn that the social network Netlog claims 30 million unique visitors and four billion page views per month (comScore counts 11 million visitors, but five billion page views). Netlog operates in 15 different languages, and 20 countries. Then there is eBuddy, the Meebo of Europe, which boasts 12 million Web users and 1.6 million mobile users of its Web-based instant-messaging service.

Most of the startups I encountered, however, are still operating under the radar—in Romania, Sweden, Holland, Ireland, France. But a cross-border Web 2.0 culture is definitely gaining steam across Europe. Technology itself is helping to break down borders. A VC showed me the landing page on his mobile phone. It wasn’t his e-mail. It was Twitter. Another startup founder told me that Twitter helps him keep a dialogue going with other entrepreneurs and VCs across Europe, and even with contacts in the U.S.

Europe is still a mosaic of employment law, tax regulations, and cultural habits that can influence where it makes the most sense to locate different parts of a business. One Dutch CEO, for instance, told me that it costs you need a minimum of 18,000 Euros in starting capital just to incorporate in the Netherlands. And that is just the government’s fee.

When I asked which region was most likely to emerge as Europe’s Silicon Valley, the answers were all over the map: London, Munich, Berlin, Zurich, Geneva, even Barcelona. The money is in London, cheap office space is in Berlin, the mobile expertise is in Helsinki, the weather’s nice in Barcelona, and the inexpensive engineers are in Estonia (which may not even consider itself part of Europe, but is close enough to manage from Berlin or Amsterdam).

As Europe searches for its Silicon Valley, it may turn up as a state of mind rather than a specific place. The truth is that Europe may not need a single Silicon Valley because business is becoming so distributed. While some Silicon-Valley chauvinists may disagree, the idea of concentrating all the talent and capital in one region seems so last century to many Euro 2.0 entrepreneurs.

(Photo © Pieter Baert).

Crunch Network: CrunchGear drool over the sexiest new gadgets and hardware.

Over the past few days at the Next Web conference in Amsterdam, I had the opportunity to hang out with about 700 Internet entrepreneurs from all over Europe. The startup scene in Europe reminds me of Silicon Valley four or five years ago—hungry startups building Web companies on the cheap and products that scratch a personal itch.

Swedish startup Twingly, for instance, wants to come up with spam-free blog search by starting with the best 450,000 blogs and letting users share blog posts with each other. ParisBrussels-based Zilok is creating an eBay for renting things such as drills and digital projectors. London’s Fav.or.it makes a feed reader with extra powers—you can leave comments on blogs within the reader, it ranks posts based on how much they are actually read, and it lets you filter posts by tag, rank, or category. In Munich, andUnite has created a service that allows you to collect your search terms and share them with others.

And a handful of companies are even gaining substantial traction. I was surprised to learn that the social network Netlog claims 30 million unique visitors and four billion page views per month (comScore counts 11 million visitors, but five billion page views). Netlog operates in 15 different languages, and 20 countries. Then there is eBuddy, the Meebo of Europe, which boasts 12 million Web users and 1.6 million mobile users of its Web-based instant-messaging service.

Most of the startups I encountered, however, are still operating under the radar—in Romania, Sweden, Holland, Ireland, France. But a cross-border Web 2.0 culture is definitely gaining steam across Europe. Technology itself is helping to break down borders. A VC showed me the landing page on his mobile phone. It wasn’t his e-mail. It was Twitter. Another startup founder told me that Twitter helps him keep a dialogue going with other entrepreneurs and VCs across Europe, and even with contacts in the U.S.

Europe is still a mosaic of employment law, tax regulations, and cultural habits that can influence where it makes the most sense to locate different parts of a business. One Dutch CEO, for instance, told me that it costs you need a minimum of 18,000 Euros in starting capital just to incorporate in the Netherlands. And that is just the government’s fee.

When I asked which region was most likely to emerge as Europe’s Silicon Valley, the answers were all over the map: London, Munich, Berlin, Zurich, Geneva, even Barcelona. The money is in London, cheap office space is in Berlin, the mobile expertise is in Helsinki, the weather’s nice in Barcelona, and the inexpensive engineers are in Estonia (which may not even consider itself part of Europe, but is close enough to manage from Berlin or Amsterdam).

As Europe searches for its Silicon Valley, it may turn up as a state of mind rather than a specific place. The truth is that Europe may not need a single Silicon Valley because business is becoming so distributed. While some Silicon-Valley chauvinists may disagree, the idea of concentrating all the talent and capital in one region seems so last century to many Euro 2.0 entrepreneurs.

(Photo © Pieter Baert).

Crunch Network: CrunchGear drool over the sexiest new gadgets and hardware.