User-agent: * Allow: / # The link-preview card for a share is under /api, and crawlers that # honour this file (Reddit's does) must be let through to it, or a pasted # share link gets no thumbnail. Listed before the disallow for parsers # that take the first match, and more specific for those that take the longest. Allow: /api/og/ # The MCP endpoint answers a GET with what it is and where to read on, and # an agent's fetch tool that honours this file has to be let through to it. Allow: /api/mcp Disallow: /api/ Sitemap: https://www.tafla.is/sitemap.xml