What would be the difference if you use a robots.txt file or the Robot MataTag <META name="robots" Content="Index,Follow">

Can you use both?

You can buit it is pointless. Robots will index and follow the links on every page by default. This makes that tag redundant and useless. Only use it to block robots.

What would be the difference if you use a robots.txt file or the Robot MataTag <META name="robots" Content="Index,Follow">

Can you use both?

Hi,

One simple answer,

Meta tag is to direct/block each and ever page
Robots text file is to block the entire folder

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.