Two powerful open-source tools to master Local AI efficiently

1️⃣ LEANN: Extreme Compression for RAG

This open-source repo compresses 60 million text chunks from approximately 201 GB to about 6 GB 🤯

That's about 97% less, while the quality of the retrieval remains very close to standard setups.

• No cloud
• No GPU
• Runs locally on a regular laptop
• Full privacy
• 100% open source

LEANN achieves this by not storing embeddings permanently.

Instead, it uses a compact graph and recalculates embeddings only when they are actually needed.

GitHub

2️⃣ Transformer Lab: All-in-One set of tools for working with LLMs.

☞ Allows you to train, fine-tune, and communicate with any LLM locally.

☞ One-click model loading,
Simple drag-and-drop interface for RAG.

☞ Completely open sourced.

GitHub

•••••••••••••••••••••••••••••••••
🤖 Data Science, ML & Big Data with @DataXplore