Free Robots.txt Generator for WordPress Sites
Create an optimized robots.txt for WordPress. Block wp-admin, manage plugin directories, and improve SEO crawling. Free tool.
WordPress generates a default robots.txt that's minimal and often insufficient. A custom robots.txt tailored for WordPress blocks unnecessary admin pages, plugin assets, and duplicate content from WordPress-specific URL patterns that can hurt your site's SEO performance.
Tips for Wordpress
Block /wp-admin/ but allow /wp-admin/admin-ajax.php — many plugins and themes need AJAX to function properly
Disallow /wp-includes/ to prevent search engines from indexing core WordPress files
Block /trackback/ and /feed/ endpoints if you don't want these indexed separately from your posts
Add your XML sitemap URL (usually /sitemap.xml or /sitemap_index.xml from your SEO plugin) to robots.txt
Try This Example
“Generate a WordPress robots.txt that blocks wp-admin, wp-includes, and common plugin directories while allowing content pages”