Member Avatar for fumnimda

hi,
i have a robots.txt file with this content:
User-agent:*
Allow: /
Allow: /sitemap
Disallow: /gerente

is it written in right order?

  • 3 Contributors
  • 2 Replies
  • 65 Views
  • 2 Days Discussion Span
  • Latest Post Latest Post by Dani
Member Avatar for AirForceOne

Hi,

I think these 2 lines would be not useful Allow: / Allow: /sitemap for any purpose since they are allowed by default. Also, might I suggest the contents on robotstxt.org/orig.html#examples for you to read.

all the best,

Member Avatar for Dani

My robots.txt file looks like this:

Sitemap: http://www.daniweb.com/sitemap.xml

User-agent: Googlebot
Disallow: ...........

It sits in the root directory. I think that Allow is explicit.

Edited by Dani because: n/a
Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.