Connection check
verified live · 27h ago
br0ski777-web-scraper
Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.
Tools
2
GitHub stars
—
Installs / wk
—
Licence
MIT
Transport
sse
Last checked
27h ago
Tools & capabilities
2 toolsRead from the running server on 27h ago.
web_scrape_batch
urls*
Use this when you need to extract clean content from multiple web pages at once (up to 10 URLs). Returns the same structured markdown output as web_scrape_to_markdown for each URL.… Use this when you need to extract clean content from multiple web pages at once (up to 10 URLs). Returns the same structured markdown output as web_scrape_to_markdown for each URL. 1. results (array) -- each entry has title, description, author, content, wordCount, charCount, url 2. summary -- total pages scraped, total word count, failed URLs if any Example output: {"results":[{"url":"https://a.com","title":"Page A","wordCount":800},{"url":"https://b.com","title":"Page B","wordCount":1200}],"summary":{"total":2,"totalWords":2000,"failed":0}} Use this FOR building research corpora, comparing content across competitor pages, or bulk documentation extraction. Essential when you have 3+ URLs to process in one workflow. Do NOT use for single URLs -- use web_scrape_to_markdown instead. Do NOT use for SEO comparison -- use seo_audit_batch instead.
web_scrape_to_markdown
url*