# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /*/edit$ Disallow: /api/* Disallow: /graphql$ Disallow: /policies/td-optout$ Disallow: /search Disallow: *.md Disallow: */items/*/revisions Disallow: */private/*/revisions Allow: /api/*/docs$ Sitemap: https://cdn.qiita.com/sitemap-https/sitemap.xml.gz