Home > Glossary > Search Engine Spiders

Search Engine Spiders

Search Engine Spiders


Search engine spiders are programs (also called crawlers or bots) that visit websites to create and index entries for search engines such as Google. They are usually programmed to crawl sites where the webmaster has requested that a page or sitemap be submitted for indexing by the search engine.


Conversion marketing – Glossary of Conversion Marketing.

Over 300 tools reviewed – Digital Marketing Toolbox.

Keyword research –How to do keyword research.

Link building – 20 powerful link building tools to drive traffic to your site.

A/B testing software – Which A/B testing tools should you choose?

Types of A/B tests – How to optimise your website’s performance using A/B testing.


Spider icons created by Creartive – Flaticon