Web Spider

+A web spider, or [Web Crawler](/wiki/web_crawler), is an automated program designed to systematically browse the [World Wide Web](/wiki/world_wide_web). It follows links to discover and gather information, primarily to facilitate the indexing of web content for search engines.

+## See also

+- [Search Engine](/wiki/search_engine)

+- [Web Indexing](/wiki/web_indexing)

+- [Internet Bot](/wiki/internet_bot)