mean of robots.txt at yahoo.com

Posted by hussain on Stack Overflow See other posts from Stack Overflow or by hussain
Published on 2010-05-06T06:28:16Z Indexed on 2010/05/06 6:48 UTC
Read the original article Hit count: 213

Filed under:

robots.txt

i want to know the mean of yahoo robots.txt

that website( http://www.yahoo.com/robots.txt ) have the following lines

User-agent: *
Disallow: /p/
Disallow: /r/
Disallow: /*?

i dont know the mean of last line(Disallow: /*?)

please let me know...

thanks and advance

Related posts about robots.txt

Robots.txt practices with .htaccess redirections (inherits)

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I have a question regarding how to write robots.txt files for many domains and subdomains with redirects in place. We have a hosting account that enacts primary and add-on domains. All of our domains and subdomains, including the primary domain, is redirected via htaccess 301s to their own subdirectories… >>> More
mod evasive not working properly on ubuntu 10.04

as seen on Server Fault - Search for 'Server Fault'
I have an ubuntu 10.04 server where I installed mod_evasive using apt-get install libapache2-mod-evasive I already tried several configurations, the result stays the same. The blocking does work, but randomly. I tried with low limis and long blocking periods as well as short limits. The behaviour… >>> More
Cross-domain jQuery using YQL gives robots.txt error

as seen on Stack Overflow - Search for 'Stack Overflow'
On the page http://qxlapps.dk/test.htm I am trying to perform an Ajax load from another domain, qxlapp.dk. I am using James Padolsey's xdomainajax.js plugin from: http://james.padolsey.com/javascript/cross-domain-requests-with-jquery/ When I open my test page, I get no output, but FireBug shows… >>> More
Asterisk in robots.txt

as seen on Stack Overflow - Search for 'Stack Overflow'
Wondering if following will work for google in robots.txt Disallow: /*.action I need to exclude all urls ending with .action. Is this correct? >>> More
SEO chaos from changing robots.txt file in Wordpress site

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi there, I recently edited the robots.txt file in my site using a wordpress plugin. However, since i did this, google seems to have removed my site from their search page. I'd appreciate if I could get an expert opinion on why this is so, and a possible solution. I'd initially done it to increase… >>> More

Developer IT

mean of robots.txt at yahoo.com - Developer IT

mean of robots.txt at yahoo.com

robots.txt

Related posts about robots.txt

Robots.txt practices with .htaccess redirections (inherits)

mod evasive not working properly on ubuntu 10.04

Cross-domain jQuery using YQL gives robots.txt error

Asterisk in robots.txt

SEO chaos from changing robots.txt file in Wordpress site

Categories cloud