Goto

Collaborating Authors

 metacrawler


Moving Up the Information Food Chain

AI Magazine

I view the World Wide Web as an information food chain. The maze of pages and hyperlinks that comprise the Web are at the very bottom of the chain. The maze of pages and hyperlinks that comprise the Web are at the very bottom of the chain. Today's Web is populated by a panoply of primitive but popular information services. Is the Web challenge a distraction from our long-term goal of understanding intelligence and building intelligent agents?


Moving Up the Information Food Chain: Deploying Softbots on the World Wide Web

Etzioni, Oren

AI Magazine

I view the World Wide Web as an information food chain. The maze of pages and hyperlinks that comprise the Web are at the very bottom of the chain. The WEBCRAWLERs and ALTAVISTAs of the world are information herbivores; they graze on Web pages and regurgitate them as searchable indices. Today, most Web users feed near the bottom of the information food chain, but the time is ripe to move up. Since 1991, we have been building information carnivores, which intelligently hunt and feast on herbivores in UNIX, on the Internet, and on the Web. Information carnivores will become increasingly critical as the Web continues to grow and as more naive users are exposed to its chaotic jumble.