Google was not crawling my posts , My pages were getting de-indexed day by day
Around about 8th of May I noticed that the post I was making on my blog was not getting indexed in Google.Before this my indexing in Google was normal.As I post Google used to index it within an hour.
I noticed the problem around about 11th of May.I posted the issue in Google webmaster help forum.It was shocking,I got answers which were totally off topic.
Then I decided to get into the problem my self.I saw that in webmaster tools under cached robots.txt file it was showing nothing.My robots.txt file was downloaded successfully but the Google was showing
status:Please check later.
Downloaded ago: Some hours ago
This “Please check back later” never change itself.So I got there is something unusual now.
I decided to check for other site’s robots.txt file.They were finely cached. Problem was only with my blog.At end of long research I got that the problem is coming from my hosting not from Google.
I contacted my host.Told them about the thing.They told they are going to flush ip tables.They did it.Result was amazing.My main domain (as I write blog on subdomain) also started getting the same problem.Google take all subdomains an individual site.So I went to host for solution for subdomain and they created problem for main domain too.
Now,on another side Google was trying to crawl my old indexed pages but unfortunately due to same problem Google was not able to reach them and it was de-indexing my posts gradually.
My host Mellowhost(Currently I host here) tried to solve it they couldn’t the issue stayed with me.I was loosing traffic and also listing.After more than one week mellow host solved the issue on 22th of may.So around about a month there was no indexing and crawling.Even I lost some indexed posts.
After successfully solving it I again resubmitted my sitemap,I checked robots.txt status It was 200 (success) again.
Fortunately and due to team Google my posts are again in index . Google is crawling the site again,
Moral : If you get the same problem to your site,Don’t rush here there.Just contact host directly,there was no one to guide me.But now you keep in mind.We don’t know when we get into trouble.God Bless.
Share with Friends ( Sharing is Caring! )
Subscribe For E-mail Notification Of Article Updates
DO NOT FORGET TO CLICK ON THE VERIFICATION LINK AFTER SUBSCRIBING,THE VERIFICATION MAIL WILL BE SENT TO YOU FROM "FeedBurner Email Subscriptions".
( What is this? Why I need to do this?)
Related Posts
6 responses. Wanna say something?
Search
Free Daily E-mail News Letter
DO NOT FORGET TO CLICK ON THE VERIFICATION LINK AFTER SUBSCRIBING,THE VERIFICATION MAIL WILL BE SENT TO YOU FROM "FeedBurner Email Subscriptions".
( What is this? Why I need to do this?)
Tip Of The Day
Meet the Author
Mail me:
Stay Connected With Me
Jun 14, 2009 at 10:15:36
Hope now your site pages being crawled…
[Reply]
Jun 15, 2009 at 20:00:13
Yes,hopefully,Thanks to Google Team algorithms
[Reply]
Jun 16, 2009 at 09:03:21
hello kp i am also facing problem of google not indexing my bogs new post……..older are doing their best but i am not getting traffic from new ones plz help me…….
[Reply]
Jun 16, 2009 at 20:56:27
plz help me kp……….
[Reply]
Jun 16, 2009 at 21:17:41
Sorry to hear.I will post some guides soon,may be today.How to give habit to Google of crawling your site every hour
[Reply]
Jul 6, 2009 at 03:58:30
It is really weird. I am running Joomla on one website, and WordPress on the other, and have set up SEO plugins in both to help. Both sites get indexed into google, but random 1 or 2 pages are missing, although they show up on the sitemap!
I tried submitting them manually to Google Webmasters Tools, and they are crawled, but for example one sitemap contains like 36 pages but only 18 are indexed! Wondering what is happening there hmm…
The two pages that are not being indexed are:
[two links,suppressed content]
[Reply]