How Robots.txt is to be placed in the web site?
tomibaw 0 Newbie Poster
JorgeM 958 Problem Solver Team Colleague Featured Poster
Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
DarkMonarch 1 Newbie Poster
mine is here: ../var/html/www/robots.txt
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.