Crawler rule audit tool
Robots.txt to CSV
Turn robots.txt groups into a crawler rule table with user-agent, directive, value, and sitemap rows.
Input
Suggested workflow
Use this with adjacent SEO tools
Run one small step, export the result, then move to the next audit or migration task.
Good follow-up toolsClean the source list, generate the next file, and keep a downloadable record for your audit checklist.
Help shape this tool
Need a different output?
Tell us what this page should generate, convert, or calculate for your real workflow.