pagesift
A fast, memory-efficient tool that turns any website or document into clean text and structured data an AI system can actually use, as an alternative to existing scraping tools like Firecrawl.
View yolow92/pagesift on GitHub- GitHub stars
- 271
- Forks
- —
- Language
- Rust
Project details
- Repository
- yolow92/pagesift
- Licence
- Apache-2.0
- Primary language
- Rust
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.
Explore by topic
More tools in Knowledge & documents
- jevcrawl
rayenmlayeh · Apache-2.0
A small MCP server/CLI that crawls websites for AI agents and returns only the passage that actually answers the question, instead of whole pages.
- recollect
mikek184 · Apache-2.0
A self-hosted, Rust-built memory and MCP coordination layer that gives coding agents persistent context across repos and sessions.
- xerj
xerj-org · Apache-2.0
One command indexes your code, docs, logs and PDFs so AI agents can search and remember your data using far fewer tokens than grep, while staying Elasticsearch…
- nuphus-mcp
mrpulor-gh · MIT
Gives AI agents actual computer-use capability: they can see your screen and control windows, mouse, keyboard, and Chrome through a lightweight local server.