Jump to content

MetaCrawler

From Wikipedia, the free encyclopedia
MetaCrawler
Type of site
Metasearch engine
Available inEnglish
OwnerSystem1
URLmetacrawler.com
RegistrationNo
LaunchedJuly 7, 1995; 29 years ago (1995-07-07)

MetaCrawler is a search engine. It is a registered trademark of InfoSpace and was created by Erik Selberg.

It was originally a metasearch engine, as its name suggests. Throughout its lifetime it combined web search results from sources including Google, Yahoo!, Bing (formerly Live Search), Ask.com, About.com, MIVA, LookSmart and other search engine programs. MetaCrawler also provided users the option to search for images, video, news, business and personal telephone directories, and for a while even audio.

History

[edit]

MetaCrawler was originally developed in 1994 at the University of Washington by graduate student Erik Selberg and Professor Oren Etzioni as Erik Selberg's Ph.D. qualifying project.[1] Originally, it was created in order to provide a reliable abstraction layer to web search engine programs in order to study semantic structure on the World Wide Web. However, it was a useful service in its own right, and had a number of research challenges. MetaCrawler was not, however, the first metasearch engine on the World Wide Web. That feat belongs to SavvySearch, developed at the Colorado State University, albeit launched just four months prior to MetaCrawler.[2]

MetaCrawler was originally operating on four Digital Equipment Corporation AlphaStations[3] and processing several hundred thousand queries per day. This was starting to create significant bandwidth load at UW. It became clear that MetaCrawler needed to have some method of paying for the queries it was forwarding to the primary search engines. Some time after the search engine launched, NetBot, Inc., which was cofounded by Etzioni,[4] was initiated to commercialize MetaCrawler[5] and three other UW programs: Ahoy! The HomePage Finder, Occam, and ShopBot. Ahoy! and Occam were never actually commercialized. NetBot then combined the core of MetaCrawler with ShopBot to create a meta-shopping website, Jango.[6]

MetaCrawler launched on July 7, 1995.[7]

MetaCrawler site in 1996

As of late 1995, MetaCrawler logged over 7,000 search queries per week, and accessed six services: Galaxy, InfoSeek, Lycos, Open Text, WebCrawler and Yahoo.[8] By late 1996, there were over 150,000 queries per day.[9]

MetaCrawler's owners were unable to determine a reasonable business model, so in January 1997 they sold it to another Internet startup company, Go2Net,[10] in which Microsoft co-founder Paul Allen later invested a 54 percent stake.[11] Go2Net went public in April that year, registering on Nasdaq.[12] MetaCrawler had about 30,000 daily visitors at the start of 1997, but by mid 1998 jumped to 275,000.[13]

Old MetaCrawler logo, used c. 1997 to 2003

NetBot would eventually be purchased by Excite in October 1997 for $35 million, where Jango became part of the Excite Network Shopping Channel.[14] Both Selberg and Etzioni resumed working for UW until 1999, when they joined Go2Net for a year, quitting just prior to Go2Net's acquisition by InfoSpace, Inc. in July 2000 for $4.2 billion.[15] By that time, Go2Net had purchased another metasearch engine, Dogpile.[16]

In 2014, MetaCrawler was merged into another one of InfoSpace's search engines, Zoo.com,[17] which was originally launched in 2006.[18] The MetaCrawler domain at first redirected to Zoo.com,[19][20] but was afterwards changed to redirect to msxml.excite.com, the search page for Excite, also operated by InfoSpace.[21][22]

In July 2016, InfoSpace was sold by parent company Blucora to OpenMail for $45 million, putting MetaCrawler under the ownership of OpenMail.[23] OpenMail was later renamed System1.[24]

In 2017, MetaCrawler relaunched as its own search engine.[25]

See also

[edit]

References

[edit]
  1. ^ "Erik Selberg IoT Conference Bio". Retrieved 2019-09-25.
  2. ^ jeff.dalton. "Meta-Search Part I: The Beginning". Archived from the original on 2019-01-26. Retrieved 2019-01-29.
  3. ^ "Federated Search". federatedsearchblog.com. Retrieved 2019-01-29.
  4. ^ "Robots Mailing List Archive: The Metacrawler, Reborn". webdoc.gwdg.de. Retrieved 2019-01-29.
  5. ^ "ASEE PRISM - Apr 1999 - Cover Story - Building Strategic Partnerships". www.prism-magazine.org. Archived from the original on 2015-09-09. Retrieved 2019-01-29.
  6. ^ "Shopping Engine History - SingleFeed, Shopping Engines made easy". www.singlefeed.com. Retrieved 2019-01-29.
  7. ^ "Multi-Service Search and Comparison Using the MetaCrawler". www.w3.org. Retrieved 2019-02-12.
  8. ^ "Multi-Service Search and Comparison Using the MetaCrawler". homes.cs.washington.edu. Retrieved 2019-01-29.
  9. ^ "The MetaCrawler Architecture for Resource Aggregation on the Web". homes.cs.washington.edu. Retrieved 2019-01-29.
  10. ^ "Robots Mailing List Archive: The Metacrawler, Reborn". webdoc.gwdg.de. Retrieved 2019-01-29.
  11. ^ "Paul Allen sets 54-percent stake in Go2Net - Mar. 15, 1999". money.cnn.com. Retrieved 2019-01-29.
  12. ^ Court, Randolph (1998-04-23). "Go2net's Low-Overhead Plan". Wired. ISSN 1059-1028. Retrieved 2019-01-29.
  13. ^ King, Suzanne. "O.P. Web site developer is Seattle-bound". American City Business Journals. Retrieved 2019-01-29.
  14. ^ "Excite to buy NetBot". CNET. Retrieved 2019-01-29.
  15. ^ Francisco, August Cole, Bambi. "InfoSpace to acquire Go2Net". MarketWatch. Retrieved 2019-01-29.{{cite web}}: CS1 maint: multiple names: authors list (link)
  16. ^ "Google Added To Go2Net's MetaCrawler and Dogpile Metasearch Services – News announcements – News from Google – Google". googlepress.blogspot.com. Retrieved 2019-01-29.
  17. ^ "MetaCrawler". 2014-01-01. Archived from the original on 2014-01-01. Retrieved 2019-01-29.
  18. ^ "New Kid-Friendly Search Engine Zoo.com Offers Wealth of Information Without the Worry". www.businesswire.com. 2006-11-14. Retrieved 2019-01-29.
  19. ^ "What is Zoo?". www.computerhope.com. Retrieved 2019-01-29.
  20. ^ "Module 1". mason.gmu.edu. Archived from the original on 2019-01-26. Retrieved 2019-01-29.
  21. ^ "Søgemaskiner - Search-on.dk JR Corp". www.search-on.dk. Retrieved 2019-01-29.
  22. ^ "MetaCrawler". Archived from the original on 2016-01-01. Retrieved 2019-01-29.
  23. ^ "Blucora to sell InfoSpace business for $45 million". Seattle Times. July 5, 2016.
  24. ^ "System1 raises $270 million for 'consumer intent' advertising". L.A. Biz. Retrieved 2017-12-01.
  25. ^ "MetaCrawler". 2017-04-03. Archived from the original on 2017-04-03. Retrieved 2019-01-29.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=MetaCrawler&oldid=1187545792"