LearnFetch as Googlebot


writes on January 13, 2010

Editors note: Learn more about measuring the success of your site at Future of Web Apps Miami – February 22nd – 24th 2010. Buy your ticket now.

Ryan pointed out a nice little feature of Google Webmaster Tools recently and I thought it worth sharing.

Hidden away under the labs tab is a feature called “Fetch as Googlebot”. With “Fetch as Googlebot” you are able to see exactly how a page appears to Google when it’s crawled. Here’s the results for carsonified.com/blog. Click the image below to see it full size.

Why is this useful?

  • It allows you to troubleshoot a page’s poor performance in search results. For example it will identify content that can’t be crawled by Google.
  • It can help identify if your site has been hacked with malicious and undesired content
  • It identifies he HTTP response returned by your server
  • It highlights the HTML code as seen by Google. Useful if you use a lot of generated content in the page.

Other useful tools

As well as “Fetch as Googlebot” Webmaster Tools has a number of useful options including:

  • Sitemap submission
  • Facility to edit your sitelinks (links that appear beneath the pages search result in Google)
  • Help with reindexing your site if you move it to a new domain
  • Top search queries, keywords and subscriber stats
  • Help with robots.txt files
  • Crawler stats

You can find more out about Webmaster Tools on the Google web site.


Learning with Treehouse for only 30 minutes a day can teach you the skills needed to land the job that you've been dreaming about.

Get Started

11 Responses to “Fetch as Googlebot”

  1. Great advice on SEO, always looking for ways to improve my SEO skills. Than you

  2. thanks for the helpful info. I’m fairly new to the SEO subject, but I would think knowing what content Google wouldn’t crawl would be very beneficial to me. Thanks again


  3. I just can’t figure out how this tool is useful? Isn’t it just the same as viewing the source code of your page with the addition of a few headers? People seem to be really excited about this tool. What am I missing?

  4. Any tool that will help a marketers seo on his web-site is OK by me. Thanks for posting this… I will try it out for myself

  5. Ok, before I start introducing myself, I want to take this opportunity to thank all of you by having me as a member in______________. I am hoping that this community will be able to help us in our day to day transactions.

    I am a first time mom who used to have a booming career in the health insurance industry. That was when I still have time on my hands to meet clients and generate sales lead. Don’t get me wrong, I love being a mom and everyday is a new adventure for me. In fact, it is because of motherhood that my career slowed down because as we know being a mom means less time to do other things. So when I found out about this community, I was excited to join as I know it will surely benefit me in many ways. One thing that I am looking forward to in joining this community is to gain access to some information about the latest trends in marketing health insurance and gaining more knowledge on gaining exclusive insurance leads even if I’m home taking care o f my kid. I had been through a lot of websites and online communities but was a little disappointed because I didn’t get the chance to learn anything new.

    I had been staying at home to take care of my kid for two years now and I know for a fact that the landscape for health insurance marketing had changed a lot over that short period of time. I want to get back to my career but am having a hard time deciding on how to start all over again. Plus the fact that I will be spending some time away from my kid makes me sad. I had heard of working from home as a health insurance marketing consultant and sales trainer, and all you need is the internet and some tools to help make the job easier. For me, as a stay at home mom and a career oriented wannabe again, this is like a blessing that I should not miss out on. Where else can I have that benefit of working while I take care of my kid? So I figured that for me to get back on the saddle again, I need to be p repared and get all the help I can get.
    insurance sales training

    • Bob Sinclair on February 18, 2010 at 12:34 pm said:

      Hi Gorubaba,

      It is a pleasure to have you join [INSERT COMMUNITY NAME INTO TEMPLATE HERE]. We hope that we can provide you with assistance on your spamming needs during your time here.

      We find your comments on [Insert Topic Name Here] very informative and we will blindly click on your link.

      Once again, welcome to the __________________ community 🙂

  6. I wanna try this tips. For getting an information about SEO.

  7. Good! I’ll spread the word at Pixmac… thank you!

  8. I’m always looking to improve my SEO knowledge as there’s so much competition, I need to keep ahead where ever I can. So thanks for the information. I’ll see if I can put this to good use.

  9. I will try that google option, thanx for pointing it out!

  10. Nice & creative mind can developed such blog are really appreciate with u.
    Thanks for this blog.

Leave a Reply

You must be logged in to post a comment.

man working on his laptop

Are you ready to start learning?

Learning with Treehouse for only 30 minutes a day can teach you the skills needed to land the job that you've been dreaming about.

Start a Free Trial
woman working on her laptop