Related RSS Plugin
Keyword Winner

Posts Tagged robots

Code For Robots.txt

Feel free to copy this for your own use.  The first is used when WordPress is installed on the root of the domain ie The second is used when WordPress is installed in a directory of the domain ie Please note that unless you are using the install directory named articles, you will [...]


Robots.txt Plugins And Why You Should Have One

I’ve been using kbrobots for the past year and there are probably fancier plugins out there but this one works fine for me. For those of you who don’t know, the robots.txt file sits on your server root and tells the different spiders, robots, and other agents what they should and shouldn’t crawl when they [...]