Saturday, August 29, 2009

Google Caffeine: A Detailed Test of the New Google

Did you hear? Google’s launching a new, upgraded version of its search engine soon. And just as important, the search giant released the developer’s preview of it today. Google (Google) promises that the new search tool (codename “Caffeine”) will improve the speed, accuracy, size, and comprehensiveness of Google search.

While the developer version is a pre-beta release, it’s completely usable. Thus, we’ve decided to put the new Google search through the wringer. We took the developer version for a spin and compared it to not only the current version of Google Search (Google search), but to Bing (Bing) as well.

The categories we tested the new search engine on are as follows: speed, accuracy, temporal relevancy, and index size. Here’s how we define those:

Speed: How fast can the new search engine load results?

Accuracy: Which set of results is more accurate to the search term?

Temporal Relevancy: Is one version of search better at capturing breaking news?

Index Size: Is it really more comprehensive than the last version of Google?
1.SPEED------
The first category is incredibly important. How fast do these Google search results come at you anyway? Even a tenth of a second can mean millions for the search company as the longer it takes the load, the more likely someone will go look for results somewhere else.

So how fast is the new search? Lightning fast. As you probably know, Google tells you how long it takes to load results. We tried a few search terms, starting with “Dog.” Here’s the speed result:


Compare that to the original Google search:


0.12 vs. 0.25 seconds? They doubled the speed! That’s tremendous.

Friday, August 28, 2009

Google to Launch a New Version of Google Search

GoogleGoogle has a giant target on its back.
Microsoft has been on a spending and deal-making spree to grow BingBing, recently signing a huge search deal with Yahoo. And with Bing starting to steal some market share from Google, it’s proving to be a formidable opponent. Oh, and now you can’t count out Facebookfacebook either, which just launched a new realtime search engine.

Google’s not taking any of this lying down. Secretly, they’ve been working on a new project: the next generation of Google SearchGoogle search. This isn’t just some minor upgrade, but an entire new infrastructure for the world’s largest search engine. In other words: it’s a new version of Google.

The project’s still under construction, but Google’s now confident enough in the new version of its search engine that it has released the development version for public consumption. While you won’t see too many differences immediately, let us assure you: it’s a completely upgraded Google search.

Google specifically states that its goal for the new version of Google Search is to improve its indexing speed, accuracy, size, and comprehensiveness. Here’s what they wrote:

“For the last several months, a large team of Googlers has been working on a secret project: a next-generation architecture for Google’s web search. It’s the first step in a process that will let us push the envelope on size, indexing speed, accuracy, comprehensiveness and other dimensions. The new infrastructure sits “under the hood” of Google’s search engine, which means that most users won’t notice a difference in search results.

Sunday, August 2, 2009

GOOGLE>>>>YAHOO>>>ASK>>MSN

Google

* has been in the search game a long time, and saw the web graph when it is much cleaner than the current web graph
* is much better than the other engines at determining if a link is a true editorial citation or an artificial link
* looks for natural link growth over time
* heavily biases search results toward informational resources
* trusts old sites way too much
* a page on a site or subdomain of a site with significant age or link related trust can rank much better than it should, even with no external citations
* they have aggressive duplicate content filters that filter out many pages with similar content
* if a page is obviously focused on a term they may filter the document out for that term. on page variation and link anchor text variation are important. a page with a single reference or a few references of a modifier will frequently outrank pages that are heavily focused on a search phrase containing that modifier
* crawl depth determined not only by link quantity, but also link quality. Excessive low quality links may make your site less likely to be crawled deep or even included in the index.
* things like cheesy off topic reciprocal links are generally ineffective in Google when you consider the associated opportunity cost


Ask

* looks at topical communities
* due to their heavy emphasis on topical communities they are slow to rank sites until they are heavily cited from within their topical community
* due to their limited market share they probably are not worth paying much attention to unless you are in a vertical where they have a strong brand that drives significant search traffic


Yahoo!

* been in the search game for many years.
* is better than MSN but nowhere near as good as Google at determining if a link is a natural citation or not.
* has a ton of internal content and a paid inclusion program. both of which give them incentive to bias search results toward commercial results
* things like cheesy off topic reciprocal links still work great in Yahoo!

MSN Search

* new to the search game
* is bad at determining if a link is natural or artificial in nature
* due to sucking at link analysis they place too much weight on the page content
* their poor relevancy algorithms cause a heavy bias toward commercial results
* likes bursty recent links
* new sites that are generally untrusted in other systems can rank quickly in MSN Search
* things like cheesy off topic reciprocal links still work great in MSN Search

The technology behind Google's great results

As a Google user, you're familiar with the speed and accuracy of a Google search. How exactly does Google manage to find the right results for every query as quickly as it does? The heart of Google's search technology is PigeonRank™, a system for ranking web pages developed by Google founders Larry Page and Sergey Brin at Stanford University.

PigeonRank System

Building upon the breakthrough work of B. F. Skinner, Page and Brin reasoned that low cost pigeon clusters (PCs) could be used to compute the relative value of web pages faster than human editors or machine-based algorithms. And while Google has dozens of engineers working to improve every aspect of our service on a daily basis, PigeonRank continues to provide the basis for all of our web search tools.

Why Google's patented PigeonRank™ works so well

PigeonRank's success relies primarily on the superior trainability of the domestic pigeon (Columba livia) and its unique capacity to recognize objects regardless of spatial orientation. The common gray pigeon can easily distinguish among items displaying only the minutest differences, an ability that enables it to select relevant web sites from among thousands of similar pages.

By collecting flocks of pigeons in dense clusters, Google is able to process search queries at speeds superior to traditional search engines, which typically rely on birds of prey, brooding hens or slow-moving waterfowl to do their relevance rankings.

diagramWhen a search query is submitted to Google, it is routed to a data coop where monitors flash result pages at blazing speeds. When a relevant result is observed by one of the pigeons in the cluster, it strikes a rubber-coated steel bar with its beak, which assigns the page a PigeonRank value of one. For each peck, the PigeonRank increases. Those pages receiving the most pecks, are returned at the top of the user's results page with the other results displayed in pecking order.

Integrity

Google's pigeon-driven methods make tampering with our results extremely difficult. While some unscrupulous websites have tried to boost their ranking by including images on their pages of bread crumbs, bird seed and parrots posing seductively in resplendent plumage, Google's PigeonRank technology cannot be deceived by these techniques. A Google search is an easy, honest and objective way to find high-quality websites with information relevant to your search.

Data


PigeonRank Frequently Asked Questions

How was PigeonRank developed?

The ease of training pigeons was documented early in the annals of science and fully explored by noted psychologist B.F. Skinner, who demonstrated that with only minor incentives, pigeons could be trained to execute complex tasks such as playing ping pong, piloting bombs or revising the Abatements, Credits and Refunds section of the national tax code.

Brin and Page were the first to recognize that this adaptability could be harnessed through massively parallel pecking to solve complex problems, such as ordering large datasets or ordering pizza for large groups of engineers. Page and Brin experimented with numerous avian motivators before settling on a combination of linseed and flax (lin/ax) that not only offered superior performance, but could be gathered at no cost from nearby open space preserves. This open space lin/ax powers Google's operations to this day, and a visit to the data coop reveals pigeons happily pecking away at lin/ax kernels and seeds.

What are the challenges of operating so many pigeon clusters (PCs)?

Pigeons naturally operate in dense populations, as anyone holding a pack of peanuts in an urban plaza is aware. This compactability enables Google to pack enormous numbers of processors into small spaces, with rack after rack stacked up in our data coops. While this is optimal from the standpoint of space conservation and pigeon contentment, it does create issues during molting season, when large fans must be brought in to blow feathers out of the data coop. Removal of other pigeon byproducts was a greater challenge, until Page and Brin developed groundbreaking technology for converting poop to pixels, the tiny dots that make up a monitor's display. The clean white background of Google's home page is powered by this renewable process.

Aren't pigeons really stupid? How do they do this?

While no pigeon has actually been confirmed for a seat on the Supreme Court, pigeons are surprisingly adept at making instant judgments when confronted with difficult choices. This makes them suitable for any job requiring accurate and authoritative decision-making under pressure. Among the positions in which pigeons have served capably are replacement air traffic controllers, butterfly ballot counters and pro football referees during the "no-instant replay" years.

Where does Google get its pigeons? Some special breeding lab?

Google uses only low-cost, off-the-street pigeons for its clusters. Gathered from city parks and plazas by Google's pack of more than 50 Phds (Pigeon-harvesting dogs), the pigeons are given a quick orientation on web site relevance and assigned to an appropriate data coop.

Isn't it cruel to keep pigeons penned up in tiny data coops?

Google exceeds all international standards for the ethical treatment of its pigeon personnel. Not only are they given free range of the coop and its window ledges, special break rooms have been set up for their convenience. These rooms are stocked with an assortment of delectable seeds and grains and feature the finest in European statuary for roosting.

What's the future of pigeon computing?

Google continues to explore new applications for PigeonRank and affiliated technologies. One of the most promising projects in development involves harnessing millions of pigeons worldwide to work on complex scientific challenges. For the latest developments on Google's distributed cooing initiative, please consider signing up for our Google Friends newsletter.
 
Blog Advertising - Get Paid to Blog