# Learn

The technical path. Why the public web looks like this, how each file fails, and how Flowpane checks it. Product how-to lives at https://docs.flowpane.com.

## The files

- [Sitemaps](https://flowpane.com/learn/sitemaps.md): The list of what you want found. When it names pages that are gone and misses the ones that exist, search engines learn to ignore it.
- [robots.txt](https://flowpane.com/learn/robots-txt.md): One stray Disallow can hide a whole section overnight. It is also where you answer every named AI crawler, whether you meant to or not.
- [security.txt](https://flowpane.com/learn/security-txt.md): Tells a researcher where to report a vulnerability. The day its Expires date passes, the file stops counting under RFC 9116.
- [Cookies and consent](https://flowpane.com/learn/cookies-and-consent.md): Trackers that load before consent are visible to anyone who looks. You see the same outside evidence they would.
- [ads.txt](https://flowpane.com/learn/ads-txt.md): Declares who may sell your inventory. Seller lines drift as the ad stack changes, and buyers quietly stop bidding.
- [llms.txt](https://flowpane.com/learn/llms-txt.md): A curated map of your site for language models. Without one, assistants guess which of your pages matter.
- [ai.txt](https://flowpane.com/learn/ai-txt.md): States whether models may train on, quote, or scrape your content. When it disagrees with robots.txt, you have two policies.
- [humans.txt](https://flowpane.com/learn/humans-txt.md): Who builds and maintains the site. Small, and a visible sign that someone owns the origin.

## Method

- [Cross-file coherence](https://flowpane.com/learn/cross-file-coherence.md)
- [How Flowpane fetches](https://flowpane.com/learn/how-flowpane-fetches.md)
- [How the score works](https://flowpane.com/learn/scoring.md)