Crawler rule audit tool
Robots.txt to CSV
Turn robots.txt groups into a crawler rule table with user-agent, directive, value, and sitemap rows.
Input
Suggested workflow
Use this with adjacent SEO tools
Run one small step, export the result, then move to the next audit or migration task.
Good follow-up toolsClean the source list, generate the next file, and keep a downloadable record for your audit checklist.
Help shape this tool
What would make this output more useful?
Describe the input you have and the file, report, or snippet you need to take away.