A Robot communicate with Search Engine
Search engine spider crawl your periodically. How to limit the access of the spider? So the search engine only crawled the page pages you want
robot
Evinco Software: Streamline your business