SkyfloBot

What it is

Skyflo runs coding agents for the people who use it. When an agent working on one of their missions needs to read a web page, such as library documentation or a changelog, Skyflo fetches that one page and gives its text to the agent. There is no Skyflo crawler: every request is a page an agent asked to read.

The request is made by the Skyflo app on the computer running the mission, normally the user’s own Mac, so it comes from their network rather than from a Skyflo server.

What a request does

• One GET request for the page the agent asked for. It sends no cookies, no sign-in and no form data.
• It reads HTML, plain text and Markdown. It does not run the page's scripts or load its images, stylesheets or other files, and it does not read PDFs.
• It follows up to five redirects on the same site. A redirect to another site is not followed: the agent is told where it pointed and has to ask for that address itself.
• It reads at most 8 MB of a response and gives up after 20 seconds.
• An agent reads pages one at a time. Skyflo does not retry a failed or refused request on its own.
• It does not follow links from the page, and it never requests private network or local addresses.

The page’s text, with scripts, navigation and hidden text removed, goes to the agent that asked for it as part of that person’s mission.

robots.txt and blocking

SkyfloBot does not read robots.txt. It requests only the page an agent asked for and never crawls from it.

To refuse it, answer requests whose user agent contains SkyfloBot with an error status, such as 403. Skyflo does not use the page, and the agent is told it could not be read.

Contact

For questions or concerns about SkyfloBot, email contact@skyflo.ai. Include the times of the requests, the pages they asked for, and the user agent you saw.