Search Engine Likes 1. Sitemap Site Map is important. You should have a link to the sitemap page in your home page. The sitemap should list your website page one by one with a descriptive title. It not only helps your visitor to find your page, but also help search engine spider to crawl your […]
Search engine spider crawl your periodically. How to limit the access of the spider? So the search engine only crawled the page pages you want to show and leave others ignored. What we need is a file called “robots.txt”. The robot text file is used to disallow the search engine spider’s access to folders or […]