robots.txt « static « landing - tidyindex.git - Tidy Index serves public and private data sets in an easily digestable form

about summary refs log tree commit diff

path: root/landing/static/robots.txt

blob: 6bddef44e9487de981f4b2953ee4426e6c7963c2 (plain)

User-agent: *
Allow: /

Sitemap: https://tidyindex.com/sitemap.xml

# Machine-readable site description for LLM agents:
# https://tidyindex.com/llms.txt