# Public pages are available to search, retrieval, and training crawlers. # All agents share these exclusions; a named group would override this one. User-agent: * Allow: / Disallow: /api/ Disallow: /create Disallow: /settings Disallow: /projects Disallow: /viewProject Disallow: /analytics Disallow: /temp-projects/ Disallow: /apple.html Disallow: /video.html Disallow: /puterTest.html # Authentication pages remain crawlable so their noindex directive can be read. Sitemap: https://toolai.us/sitemap.xml