Member Avatar for vectro

I can't find a section related to .htaccess, so I'm posting this here.

Bing is going crazy trying to index proxied pages from PHPRoxy. With Glype, it's easy to exclude browse.php in robots.txt. However, PHPRoxy doesn't use browse.php. It uses index.php. For example: /index.php?q=aHR0cDovL21pbmRjdHJs

I know it's possible to include user agents in .htaccess code. How can I use .htaccess to prevent Bing from crawling index.php?= (but without blocking index.php entirely) no matter what string comes after the = symbol?

  • 2 Contributors
  • 3 Replies
  • 80 Views
  • 2 Weeks Discussion Span
  • Latest Post Latest Post by pritaeas
Member Avatar for vectro 
user-agent: bingbot
disallow: index.php

I see what you're getting at. robots.txt can probably accomplish the task. If this forum had a 'Thanks' button I'd use it.

Edited by vectro because: n/a
Member Avatar for pritaeas

You can upvote posts, should you want to, using the arrows next to the post.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.