TGViewer
Data science/ML/AI Data science/ML/AI @datascience_bds · 14K subscribers
Post #1111 1.89K
🏠🤖 Run Your Own LOCAL LLM (Beginner Friendly)

LLMs are cool, but running your own local one hits different 😎
No cloud. No API keys. No limits.


🧩 Step 1: Install Ollama
Install Ollama on your machine (works on Mac, Windows, Linux).

Once installed, open your terminal.


🚀 Step 2: Run a model

ollama run llama3.2


This command:
• Downloads the model
• Starts it locally
• Lets you chat instantly 💬

If you see the prompt, your local LLM is running.



⚙️ Step 3: Do local inference (API style)
Ollama runs a local server on your machine.

curl http://127.0.0.1:11434/api/generate \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama3.2",
    "prompt": "Explain overfitting like I am 12",
    "stream": false
  }'


If you get a JSON response with text → ✅ it works.


💡 Why this is powerful
• Works offline
• Private by default
• Perfect for learning, testing, and small apps

This is the easiest way to start with LLMs locally.
  • ❤ 7
  • 👍 3
  • 🔥 1
More from @datascience_bds
  1. Oct 12, 2026Roadmap to Learn SQL
  2. Oct 11, 2026🧮 Why does NumPy let you add a number to an entire matrix? Look at this: import numpy as…
  3. Oct 10, 2026document post
  4. Oct 9, 20268 RAG architectures for AI Engineers, visually explained:
  5. Oct 8, 2026document post
  6. Oct 7, 2026🧮 NumPy: Why axis=0 and axis=1 Feel Backwards You've probably seen: np.mean(X, axis=0) an…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →