Skip to main content

How Fast is Google Crawling Your Blog?


by Paula Neal Mooney

The other day I was so excited to write about Google's new AdSense Referrals Betaprogram because I caught it right when it was announced to the public.

I published the post, pinged it on Google's blog search ping search, then searched for it thru Google Blog Search.

Nothing at first.

Pretty soon after, I received an email for my Google Alert set up on http://paulamooney.blogspot.com -- letting me know that Google had indexed my blog page.


I re-checked a Google blog search on "Adsense Referrals Beta" and there was my blog post. It made it in at the number two position for relevance, right under Darren Rowse, Mr. ProBlogger.net himself.

How did I get Google to pick up my info so fast? Besides the aforementioned publishing and pinging, I relate this to two other factors:

1 - Having a sitemap listed in Google Webmaster Tools for my blog

Visit Google Webmaster Tools if you haven't already, click on the Google Webmaster Tools (including sitemaps) link and then "Add Site".

Follow the instructions to verify your blog site and add a sitemap. Now, I must admit, it took me FOREVER to figure out how to get my blog verified properly.

Only when I read Hakuna Matata's instructions -- gee think that's his real name? -- did I finally get http://paulamooney.blogspot.com to show up with a litte '1' under the sitemap page.

My other blog address listing, http://www.paulamooney.blogspot.com is also verified and with the '1' under sitemap, but it contains errors. Only when I followed Hakuna Matata's instructions on adding my atom.xml feed as my sitemap, did I have success.

2 - Achieving a normal (instead of slower) crawl rate for Googlebot

After you've set up your blog on Google Websmaster Tools, check and see what your crawl rate is by locating the "Diagnostic" tab then clicking the Crawl Rate link on the left-hand side.

Initially, my blog was set to the dreaded Slower rate: "A slower crawl will reduce Googlebot's traffic on your server, but we may not be able to crawl your site as often."

Some time after figuring out how to get my blog properly verified and a good sitemap attached, I went back and found out I was given the option to have it crawl at the Normal, recommended crawl rate.

From what I've read, updating your blog often will help flip your crawl rate into normal mode if it's slower, along with the sitemap and verification steps described above.


This is one reason I'm posting this puppy on my dad's nice and fast and lovely computer while I'm off on a vacation-of-sorts. I love having my normal crawl rate!

Hope yours is at least normal now too...

Now, does anyone out there know what you have to do to get a fast crawl rate option? Sign up to my blog so you won't miss the answer when I'm fast-crawling!



Wanna make $7.50 to blog about this post? Click the following image to sign up with PayPerPost and check out their Review My Post program:



Bookmark http://www.paulamooney.blogspot.com/ or
Add me to Technorati FavoritesTechnorati fav me, please!


Digg!


Tags: , , , , , ,

Paula Mooney's Musings

Comments

Anonymous said…
Ok you said leave you a note so I will...lol
I take it you are the daughter of Paul Mooney? If so I will say that your dad is the shit!! Ok I won't go further until I know this is for real......
Martin Lindsey said…
Paula, you keep bringing the great tips. I need a smaller one today though. How do you customize the "comments" link to add extra text?
Paris David said…
Hey Yazmar -

That's a sweet moving avatar there. Love Mary J...

And yeah, I'm not Paul Mooney's daughter. We're not even related, that I know of...but check it: Paul Mooney on Michael Richards: He cured me of using the n-word.

But thank you so much for calling me his daughter and not his mother, or even worse, his grandma!

Be blessed,
Paula
Paris David said…
Hello there, Martin

If you want to customize your comments link like I did (only 'cause people tell me they have a hard time find my comments section) then first make sure to save a copy of your template by:

1 - Go to Template
2 - EDIT HTML
3 - Download Full Template

Then...

4 - Click the "Expand Widget Templates" check box

5 - Find the spot after data:post.numComments and change the text IN THE TEXT PORTION THAT SAYS "comments" -- NOT IN THE DATA:POST.NUMCOMMNENTS PART, ONLY IN THE TEXT PORTION -- to say anything you want, like I've added:

...THUS FAR... AND COMMENTS MAKE ME SO HAPPY. COMMENTS ARE GOOD. EVEN BAD COMMENTS ARE GOOD. SO CLICK ANYWHERE WITHIN THIS RANTING AND TELL ME HOW YOU FEEL ABOUT WHAT YOU JUST READ. OR TELL ME HOW YOUR DAY IS GOING THUS FAR. TELL ME ANYTHING! SAY ANYTHING! JUST PLEASE LEAVE ME

This text should show up before the "data:top.commentLabelPlural" but don't change any of the < > and be very careful!

Make sure to preview your changes before saving them and you'll have that saved good copy of your template in case you need it.

Be warned however, I noticed my text only shows up after I have comments, so I think I also need to add this text to another comment section of code to get it to show up for when there are 0 comments.

Take care and I hope that helps,
Paula
Anonymous said…
Paula,

Thanks for this article. It's always really helpful to know the inner workings of Google.
Anonymous said…
lol oh ok I was wondering about the Paul Mooney thing...because you look rather young.


Ahhhhhhhhh u like my avatar? so u a fan of Mary J. Blige??!!!

Glad u are no longer using the N-word
Paris David said…
Hey Martin, here's a good way to change it too. I love this blog and their description of stuff:

Dummies Guide to Google Blogger Beta: Create Add Your Comment Link.
Anonymous said…
Hey Paula,

It's good to hear that you've made it just after Darren...That simply shows that you are having great techniques and your blog is gaining popularity and interest and readership from fellow netizens....

I'm so happy for you. I need to learn more from you. Do you mind I ask you few questions in your mail box? Need some tuition...he he...
MK said…
If you've not done it yet, go to Yahoo and submit your URL and atom feed like you did at Google.

Hey Paula, your blog is really moving. But sometimes, slow down a bit, take a second honest look at your blog and wonder to yourself: Am I cluttering up things?

I admire your boundless energy.

Cheers to you from a guy with an alternate view.
Paris David said…
Hey Markk - You are correct, sir!

I'm so grateful for people who speak truth to me and aren't afraid to give honest feedback.

Thanks for still reading...

Yes, for this reason I do step back sometimes and realize the clutter can turn off readers.

Look for some changes as I continue to pretty up my blog and make it even more readable.

I like the blogs that are easy to read, like yours.

Take care and I'll be over there soon.

Much thanks,
Paula
Paris David said…
Zaki!

Sure, you and any of my readers can hit me up any time at cpmooney@aol.com

I love email,
Paula
natnit said…
Great post, and thanks for teaching me about Google Alerts...I'm surprised I never knew of that trick before.
Paris David said…
Thanks, natnit - Sometimes I wonder if this kind of stuff is helping anybody, and then along you come to confirm that what I went thru helps people!
Anonymous said…
Hi There! Good post! Thanks for sharing and good luck.
Anonymous said…
last time, i took 1 days for my blog to appear in google .
Paris David said…
Yeah, I guess that's good timing, Nicholas, but hopefully it showed up in Google Blog Search soon after you pinged it.

Popular posts from this blog

Paula's List of Blogger Salaries...Are you on the list?

Update: For those who continue to enjoy this post, check out my website about 50 real online people making more than $50k per year , and my page where I update my online salary . UPDATE: Before you read any further or especially link to this old list, please check out "Paula's New List of Blogger Salaries (and Webmasters, Affiliate Marketers, Content Scrapers, Domainers and any other title you can think of) June 2007" by clicking here! ~ Thanks, PAULA NEAL MOONEY by Paula Neal Mooney One of my favorite features in Parade magazine is the issue where they grab a random sampling of people and report their incomes -- from the millionaires to the working poor. Since I'm fascinated with how much money bloggers and webmasters are making nowadays, I've created a similar list -- a random sampling of people making money on the net. Who's on Paula's List of Blogger and Webmaster Salaries? I spent hours and hours scouring the internet for the last-reporte...

Paula's New List of Blogger Salaries (and Webmasters, Affiliate Marketers, Content Scrapers, Domainers and any other title you can think of) June 2007

FIND OUT HOW MUCH BLOGGERS REALLY MAKE ONLINE -- CHECK OUT THIS NEW WEBSITE ABOUT MONEY-MAKING ONLINE CALLED 50 OVER $50K... by Paula Neal Mooney The time has come. The time is now. Paula N. Mooney will you please publish that list now?! (Yes, I fancy Dr. Seuss' iambic pentameter.) My WebMaster blest me with a viral post called "Paula's List of Blogger Salaries," and the response was so wonderful, here lies an update. It's bigger and better than ever before with more pics, and double the amount of bloggers, webmasters, domainers, affiliate marketers (or a smidgen of some or all of those titles) and their reported incomes. How Much Do You Make? Money is funny. The abundance of it, the lack of it, the subject of cash in general gets attention. While some invoke their choice not to post their online income nor discuss it at all, I've always been of the Suze Orman mindset ever since I read her first book. Suze encourages people to talk ab...

† Tissa Godavitarne - Scam? Hoax? Or Internet Marketing Genius? Read these reviews...

UPDATE - I can't do it. Just as soon as I signed up with Tissa's people search engine, I cancelled. I just don't feel right about helping people find other people's addresses and phone numbers. AND THIS PRIVACY ISSUE IS GAINING STEAM. CHECK OUT THE CONTROVERSY BREWING OVER THE MYLIFE.COM PRIVACY SELLING ISSUES THAT TISSA USES TO PROVIDE THE PEOPLE SEARCH ENGINE INFO. I know I could probably make money with it, but it's just not sitting right with my soul. Back to the drawing board. I know better things await... I kept trying to rationalize that many people could use the people search engines for good purposes, like reconnecting with old classmates and finding deadbeat dads and such -- but the reality is that if just one person uses them for nefarious purposes, I just don't want to be a part of that. I wonder if Tissa would care if people found out the address of his fabulous home, and came a' knocking on his door? How I Bought a Brand New $1.2 Million Dolla...