robots.txt Validator

Parse robots.txt — flag invalid lines, user-agent precedence, declared sitemaps.

Call this tool from the API

Get the same result via REST. Create a free API key at /account/api-keys — 100 calls/day on the free tier; 50k on Pro. 

# curl — JSON response (default)
curl https://internettimes.com:80/api/v1/robots-validator/example.com \
  -H "Authorization: Bearer YOUR_API_KEY"

# Markdown response — ingest-friendly for agents
curl "https://internettimes.com:80/api/v1/robots-validator/example.com?format=md" \
  -H "Authorization: Bearer YOUR_API_KEY"