google search engine
        Posted  
        
            by kourosh
        on Server Fault
        
        See other posts from Server Fault
        
            or by kourosh
        
        
        
        Published on 2010-06-08T23:10:16Z
        Indexed on 
            2010/06/08
            23:12 UTC
        
        
        Read the original article
        Hit count: 362
        
I am working on a google box, something like this, http://mytwentyfive.com/blog/wp-content/uploads/byme/Google%20Search%20Appliances.jpg
I am pointing the crawler to a folder where there are html files. before the crawler was crawling the files and indexing them but right now it finds the pattern or the folder but not following any html files within the folder. I have tried everything I could and know but, can't think of anything else. Can someone help?
thanks
© Server Fault or respective owner