Free technical SEO tool

Create a safer starting point for robots.txt.

Choose a crawler, add allowed or blocked paths, and generate a plain-text file for the root of your website.

✓Rules are generated in your browser and are not sent to our server.