What does Googlebot see when it accesses my page?"

**Dbrazzell** · 10-16-09, 12:51 PM

This is a question Im sure a lot of people are curious about.

The coolest bit is that instead of waiting for google to crawl your site and then you checking to see if the results were positive. You can skip that part and do it in real time now.

http://www.googlelabs.com/show_detai...E1vZGVsGJukUgw

**Croc Hunter** · 10-16-09, 11:36 PM

I don't think it's entirely accurate. For example it doesn't show a hit on the robots.txt file which as far as I know is one of the first files a Google bot looks for.

rainbore · 10-17-09, 11:54 AM

The tool is accurate. It's just very simple. It fetches the URL you enter from your site and displays the server's response - including the response header information and the complete document data. The advantage of this tool is that it fetches with Googlebot's IP address and User-Agent information so that you get a true reading of how your site responds to Googlebot. It doesn't need to consult your robots.txt file since you're the verified site owner and have requested the page be fetched.

10-16-09, 12:51 PM	#1
Dbrazzell PowWeb Staff Join Date: Nov 2008 Location: Burlington Posts: 386 Reputation: 122	What does Googlebot see when it accesses my page?" This is a question Im sure a lot of people are curious about. The coolest bit is that instead of waiting for google to crawl your site and then you checking to see if the results were positive. You can skip that part and do it in real time now. http://www.googlelabs.com/show_detai...E1vZGVsGJukUgw __________________ For Robots only Linky

10-16-09, 11:36 PM	#2
Croc Hunter Mod.. with bite.. Join Date: Sep 2002 Location: Australia Posts: 6,630 Reputation: 383	I don't think it's entirely accurate. For example it doesn't show a hit on the robots.txt file which as far as I know is one of the first files a Google bot looks for. __________________ Croc Hunter MSC :

10-17-09, 11:54 AM	#3
rainbore Rick Join Date: May 2002 Location: Minneapolis, MN Posts: 1,503 Reputation: 162	The tool is accurate. It's just very simple. It fetches the URL you enter from your site and displays the server's response - including the response header information and the complete document data. The advantage of this tool is that it fetches with Googlebot's IP address and User-Agent information so that you get a true reading of how your site responds to Googlebot. It doesn't need to consult your robots.txt file since you're the verified site owner and have requested the page be fetched. __________________ Richard L. Trethewey Search Engine Optimization Tips Disney Art and Collectibles Book Reviews Management Consultant Minneapolis

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search