Thaindian News

MOUNTAIN VIEW, CALIFORNIA (BNO NEWS) – Google unveiled a new web indexing system called Caffeine on Wednesday which provides 50 percent fresher results for web searches, the company said.

The new system will help Google to update their search index on a regular basis and in small portions resulting in the largest collection of web content offered so far by the internet giant. With Caffeine, Google said, users will find links to relevant content sooner after it was published.

Overall, this means that users will be able to found new content quicker, whether it is a news story, forum, blog or twitter update. The previous system had several layers. In order to refresh one, the entire web needed to be analyzed. The main layer was updated every couple of weeks.

The new system, Caffeine, analyzes the web in small portions and therefore allows the index to be refreshed continuously. As new pages or websites are found, Caffeine allows them to be added straight to the index. The result is fresher and newer information available for users no matter when or where it was published.

“Caffeine lets us index web pages on an enormous scale. In fact, every second Caffeine processes hundreds of thousands of pages in parallel. If this were a pile of paper it would grow three miles taller every second. Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day,” said Carrie Grimes, a software engineer at Google, Inc. “You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles.”

With Caffeine, Google says it will be able to build an even faster and comprehensive search engine that scales with the growth of information online and delivers more relevant results for the users.