# Kanvo - Robots.txt
#
# One group, deliberately.
#
# This file used to open with four more: Googlebot, Bingbot, Twitterbot and
# facebookexternalhit, each saying only `Allow: /`. That reads like a courtesy
# and behaves like an exemption. A crawler obeys the single most specific
# User-agent group that matches it and ignores every other group, so those four
# bots matched their own `Allow: /` and never saw the Disallow list below —
# which is to say the app's private routes were disallowed for everyone except
# the crawlers anybody would actually care about. `Allow: /` is also the default
# when no rule matches, so the four groups were granting nothing that was not
# already granted.
#
# Removing them puts every crawler on the list below. Add a named group again
# only to give some bot *different* rules, and if you do, copy the disallows
# into it — they are not inherited.

User-agent: *
Allow: /
Disallow: /dashboard/
Disallow: /auth
Disallow: /inbox
Disallow: /contacts
Disallow: /organizations
Disallow: /profile
Disallow: /settings/

# `/downloads` is deliberately absent. It is behind a shared password and asks
# not to be indexed through a `noindex` meta tag, and a Disallow here would
# defeat that: a crawler that is not allowed to fetch the page never reads the
# tag, so the URL can sit in the index as a bare link forever. Blocking a page
# and de-indexing a page are opposite instructions — this one wants the second.

# Sitemap
Sitemap: https://kanvo.ai/sitemap.xml