Internet Marketing Dictionary Find Definitions Center Rule Internet Marketing Terms Start with G
A Internet Marketing Terms B Internet Marketing Terms C Internet Marketing Terms D Internet Marketing Terms E Internet Marketing Terms F Internet Marketing Terms G Internet Marketing Terms H Internet Marketing Terms I Internet Marketing Terms J Internet Marketing Terms K Internet Marketing Terms L Internet Marketing Terms M Internet Marketing Terms M Internet Marketing Terms O Internet Marketing Terms P Internet Marketing Terms Q Internet Marketing Terms R Internet Marketing Terms S Internet Marketing Terms T Internet Marketing Terms U Internet Marketing Terms V Internet Marketing Terms W Internet Marketing Terms X Internet Marketing Terms Y Internet Marketing Terms Z Internet Marketing Terms Number Internet Marketing Terms

Define robots.txt

robots.txt. A text file on a website used to control the behaviors of search engine spiders (or "robots") that visit the site.

For example, the robots.txt file can be used to prevent spiders from indexing certain sections of the site.

 


Visit our other site: