3 days after I resubmit my sitemap.xml on GWT, I saw bunch of crawl errors on my GWT
My Problem is GWT crawl a page on my site that doesn't exist, i mean the URL does not exist, The page is a 404 not found and it appears on crawl errors.
How do you deal with it?
I just deleted all the errors, but I still am curious about it.
Thanks a lot in advance
This might have happened because you might have deleted a page and it might have been indexed by google before.
Instead of deleting, you can also redirect the webpage to the specific web page in the same domain (website).
Hi,
In my own experiences, Google crawl would make such mistakes when you submit a new sitemap. If you could confirm all the 404 pages are accurately on your site, you don't need to do anything, just wait for Google to correct its mistake would be OK. :)
have a nice day,
Your sitemap is just a hint for google and not an instruction on what pages google should index.
Google will still crawl all links into and within your website to find pages. If any of them lead to a missing page then WMT will tell you with the 404 error.
As Allison2009 states, the best way to handle a page that is indexed but no longer exists is to set-up a redirect from it to a relevant page that does exist (use a 301 Permanent Redirect).
These lost pages are indexed because they did exists and you or another website are still linking to them. Always try and find out where the bad link is and fix it.
is it okay if i just deleted it all? the redirection is no use because the page crawl by google is not really related to the site :D i don't know where the page came from. I just resubmit the sitemap.xml then a day or 2 I checked the crawl errors then there it was 230 crawl errors. check all the page then the page is completely a 404 not found
Those pages may have a ranking with Google even if you don't know what they are about. Deleting them is just throwing that ranking away, while 301 redirecting is asking Google to pass it on to a new page.
If they have no relevance then you could still redirect them to your home page.
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.