Build Stack
FormattersGeneratorsSecurityNetwork

Browse Tools

HomeGeneratorsrobots.txt Generator

robots.txt Generator

Build a robots.txt file with per-bot rules, sitemap and crawl-delay.

Tags

robots
seo
crawler
generate

Related Tools

Meta Tags & OG GeneratorGenerate SEO meta tags and Open Graph / Twitter Card markup with a live preview..htaccess GeneratorGenerate .htaccess rules for HTTPS redirects, www handling, caching and more.
Build Stack

Every tool developers reach for, in one place.

Categories

  • Formatters & Converters
  • Generators
  • Security & Crypto
  • Network & Web
  • Text & Strings
  • Numbers & Math
  • Design & CSS
  • Reference & Lookups

Popular Tools

  • JSON Formatter
  • JSON ↔ YAML
  • JSON ↔ CSV
  • JSON Escape / Unescape
  • JSON Schema Generator
  • XML Formatter

Site

  • Home
  • All Tools
© 2026 Build Stack. All tools run in your browser — nothing is sent to a server.buildstack.tools

Generated robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /api/

Sitemap: https://example.com/sitemap.xml