Give agents a crawler that saves docs as Markdown

Goal: Let my coding agents pull full documentation sites into local Markdown.
Setup: agents used in source: Claude, Codex; tools/MCPs stated: pulpie-mcp, uv.
Steps:
1. Install: uv tool install git+https://github.com/pinkpixel-dev/pulpie-mcp
2. Add to Claude Code: claude mcp add --scope user pulpie -- pulpie-mcp (or add it to ~/.codex/config.toml for Codex).
3. Ask the agent to crawl_docs a documentation site; it checks robots.txt and sitemaps first.
4. Pages are saved to files and only a summary returns, so the agent searches and reads them when needed.
Rules: ask me before anything irreversible (sending, posting, paying, deleting); don’t invent data, results or tools I haven’t given you; tell me what you couldn’t verify.
Based on: Jessica Doering — https://dev.to/sizzlebop/i-gave-my-ai-agents-their-own-documentation-crawler-and-pulled-60-pages-of-clean-markdown-in-49-2cl7

Steps are from the source. Includes a “Based on” credit line.