Google completes New Search Index: Caffeine

By on June 10, 2010
submit to reddit

Caffeine provides 50% ‘fresher’ results.

Tags:

Google has announced the completion of its new web indexing system called Caffeine. Google boasts that Caffeine “provides 50 per cent fresher results for web searches than our last index”. The new web indexing system will help you find results “when or where it was published”.

Let us allow Google to explain it better:

Our old index had several layers, some of which were refreshed at a faster rate than others; the main layer would update every couple of weeks. To refresh a layer of the old index, we would analyze the entire web, which meant there was a significant delay between when we found a page and made it available to you.

With Caffeine, we analyze the web in small portions and update our search index on a continuous basis, globally. As we find new pages, or new information on existing pages, we can add these straight to the index. That means you can find fresher information than ever before—no matter when or where it was published.

In line of publishing ridiculous stat numbers following an important global announcement, Google indulged us with some crazy numbers:

Caffeine lets us index web pages on an enormous scale. In fact, every second Caffeine processes hundreds of thousands of pages in parallel. If this were a pile of paper it would grow three miles taller every second. Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day. You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles.

Source: Google Blog.


About

Mufaddal Fakhruddin is the Editor for IGN ME and thinks writing in third person about himself in an about me section is weird.

Comments
Most Read
Most Commented
Competitions
Win two Toshiba AT200 tablets

This festive season Toshiba has 2 tablets to giveaway.

Win an MSI FM2-A85XA-G65 Motherboard

Thanks to MSI we have an great AMD FM2 motherboard to giveaway.

Win a Nokia Asha 311

Thanks to Nokia we have a great entry-level smartphone to giveaway.