Miscellaneous ⇒ Search Engines :: Archives ⇒ Use robots.txt to Block Forums :: Archived ⇒ Community Forums ⇒ CPG Dragonfly™ CMS
Forum IndexSearch Engines

Archived ⇒ Use robots.txt to Block Forums


I am trying to use the robots.txt to block the robots access to the Forums which I have now completely scrapped. I hadn't switched LEO on then so using the following is of no use;

Disallow: /Forums/
Disallow: /Forums.html

I think I know what I could use but would like to see others comment on this as to if I am thinking in the right direction.

Disallow: /index.php?name=Forums&file=viewtopic&t=([0-9]*)
Disallow: /index.php?name=Forums&file=viewtopic&t=([0-9]*)
Disallow: /index.php?name=Forums&file=viewtopic&t=([0-9]*)

Anybody?

Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Linux/2.0.54 (Unix)/5.0.51/5.2.6/DragonflyCMS 9.2.1


What I meant was this

Disallow: /index.php?name=Forums&file=viewtopic&t=([0-9]*)
Disallow: /index.php?name=Forums&file=viewtopic&p=([0-9]*)
Disallow: /index.php?name=Forums&file=viewtopic&f=([0-9]*)

Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Linux/2.0.54 (Unix)/5.0.51/5.2.6/DragonflyCMS 9.2.1


Anybody?

Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Linux/2.0.54 (Unix)/5.0.51/5.2.6/DragonflyCMS 9.2.1

All times are UTC