Is this tool really free?

Yes — 100% free, no signup, no email wall. We built it because our operators needed it and decided to share.

Do you store my data?

No. All calculations run entirely in your browser. Nothing is sent to or stored on any server.

Can I embed this on my site?

Reach out — we will share an embed snippet for teams that want to use this inside their own workflows.

Is the Robots.txt Generator really free?

Yes. No signup required, no data collected, nothing sent to our servers. Everything runs in your browser. We publish free tools because they build trust with operators who might eventually hire us — that's the entire business model.

How accurate is the Robots.txt Generator?

The math is correct and the formulas are standard. The output is only as good as the inputs you provide — garbage in, garbage out applies here like anywhere. We recommend calibrating with at least 3 months of real data before making major decisions based on the results.

Can I embed or share the Robots.txt Generator?

The tool lives at a stable URL that you can share with your team. We don't currently offer embeds, but the output is shareable via the copy button on calculator results. For white-label or embedded versions, contact us directly.

Why did you build these free tools?

Three reasons. First, they help operators make better decisions even if they never hire us. Second, they let us show our thinking publicly — the frameworks behind these tools come straight from our client engagements. Third, they attract the kind of operators who later become great clients.

What if I need something more complex?

The free tools cover standard scenarios. For custom analysis — multi-channel attribution, cohort LTV modeling, MMM — we do this as part of paid engagements. Our CRO & Analytics service starts at $6k/month and includes custom dashboarding plus BigQuery setup if needed.

All tools

Paid Ads

100% Free · No Signup

Robots.txt Generator

Build a valid robots.txt fast.

Instant results

No data stored

Updated 2026

Quick Answer

robots.txt tells crawlers which paths they may or may not crawl. Set a user-agent, add disallow paths (one per line), and a sitemap URL — then copy the generated file to your site root.

User-agent

Sitemap URL

Disallow paths (one per line)

Allow paths (one per line, optional)