Looking for a good robots.txt file for WordPress? Well here’s a good example, culled from a few different guides around the web and rolled into one file:
The crawl delay prevents bots using too much of your site bandwidth by over crawling.
You can auto generate your basic Sitemap here. Auto generate a 500 page Sitemap here.
0 responses so far ↓
There are no comments yet...Kick things off by filling out the form below.
Leave a Comment