Robots.txt syntax

Posted by Sinan on Stack Overflow See other posts from Stack Overflow or by Sinan
Published on 2010-04-10T23:10:55Z Indexed on 2010/04/10 23:13 UTC
Read the original article Hit count: 436

Filed under:
|
|
|

I not expert on robots.txt and i have the following in one of my clients robots.txt

User-agent: *
Disallow:
Disallow: /backup/
Disallow: /stylesheets/
Disallow: /admin/

I am not sure about the second line. Is this line disallows all spiders?

© Stack Overflow or respective owner

Related posts about seo

Related posts about robots.txt