LLMWebCrawler
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
Aavache/LLMWebCrawler
View on GitHub ↗A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
LLMWebCrawler grew +0.9% in the last 30 days, ranks 1360th of 1,535 in Memory & Knowledge (RAG), last commit 1,105 days ago.
Star trajectory
115 days tracked+0.9% in 30d, below the Memory & Knowledge (RAG) median of +0.9%.
Last commit 1,105 days ago, staler than the median of 16d.
How it compares in Memory & Knowledge (RAG)
Ranked 1360th of 1,535 by stars.
- Language
- Python
- License
- -
- Contributors
- 1
- Forks
- 13
- Watchers
- 2
- Open issues
- 0
- Releases
- 0
- Created
- 2023-09-28
- Stars this week
- +0
You've seen where LLMWebCrawler stands today.
Get the moves before everyone else: the 5 Memory & Knowledge (RAG) repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.