markdown-crawler

A multithreaded ๐Ÿ•ธ๏ธ web crawler that recursively crawls a website and creates a ๐Ÿ”ฝ markdown file for each page, designed for LLM RAG

paulpierre/markdown-crawler

View on GitHub โ†—

A multithreaded ๐Ÿ•ธ๏ธ web crawler that recursively crawls a website and creates a ๐Ÿ”ฝ markdown file for each page, designed for LLM RAG

markdown-crawler grew +1.3% in the last 30 days, ranks 133rd of 348 in Data & Analytics, last commit 121 days ago.

Star trajectory

116 days tracked
2026-07-02479 stars today2026-10-26
Momentum

+1.3% in 30d, above the Data & Analytics median of +0.8%.

Maintenance

Last commit 121 days ago, staler than the median of 17d.

How it compares in Data & Analytics

markdown-crawler
479
stars
+1.3% 30d
commit 121 days ago
Data & Analytics median
321.5
stars
+0.8% 30d
commit ~17d ago
Leader ยท TrendRadar
63.2k
stars
+1.1% 30d
commit 6 days ago

Ranked 133rd of 348 by stars.

Language
Python
License
MIT License
Contributors
1
Forks
53
Watchers
5
Open issues
5
Releases
3
Created
2023-10-24
Stars this week
+3

You've seen where markdown-crawler stands today.

Get the moves before everyone else: the 5 Data & Analytics repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain markdown-crawler?

Claim this page to add your own call-to-action.

Claim this page