What is Robots.txt ? And its importance.

added by JavaScript Kicks
10/29/2018 5:29:09 AM

809 Views

Crawling and indexing are two different concepts which we really need to understand. We know how to see robots.txt but there is misconception about robots.txt. Most of the peoples consider robots.txt is for "noidex" or "doindex". But please understand robots.txt is not for used for indexing purpose.


0 comments