hello,
can anyone help me. my blog home page is not getting crawled by the google adsense crawlers. it is showing crawl errors for my home page. can anyone help me in this issue. my blog is www.codershunt.com
srinath reddy 0 Newbie Poster
Recommended Answers
Jump to Postit is showing crawl errors for my home page
Which errors ?
Jump to PostHave you tried without your robots.txt ?
All 6 Replies
pritaeas 2,211 ¯\_(ツ)_/¯ Moderator Featured Poster
it is showing crawl errors for my home page
Which errors ?
srinath reddy 0 Newbie Poster
it is showing a 404 error that my blog home page www.codershunt.com/ is not getting crawled. but it is opening properly if i open it manually.
pritaeas 2,211 ¯\_(ツ)_/¯ Moderator Featured Poster
Have you tried without your robots.txt ?
srinath reddy 0 Newbie Poster
no what is it ? how to use ?
pritaeas 2,211 ¯\_(ツ)_/¯ Moderator Featured Poster
You have it in your web-root. Try removing it, if there is no difference, just put it back again (so make a copy first). For more info google "robots.txt".
JorgeM 958 Problem Solver Team Colleague Featured Poster
You may want to establish a webmaster's account with Google, and submit your site. You can then get more detailed information about Google's crawlers and other stats.
www.google.com/webmasters/
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.