🚀 Generative AI Fundamentals – Part 5

🔎 Embeddings, Vector Databases, Semantic Search & RAG Deep Dive

These concepts are the backbone of modern enterprise GenAI applications. Most LLM Engineer and GenAI interviews include questions on them.

1. Why do LLMs need external knowledge?

LLMs are trained on historical data and have limitations:

Knowledge becomes outdated

Cannot access private company documents by default

May hallucinate

Cannot answer questions about new information unless connected to external data

Example: If a company's HR policy changes today, the LLM won't know it unless it retrieves the latest document.

This is why RAG (Retrieval-Augmented Generation) is widely used.

2. What are Embeddings?

Embeddings are numerical vector representations of text that capture semantic meaning.

Instead of storing text directly, AI converts it into vectors.

Example

Cat → [0.32, 0.45, 0.87...]

Dog → [0.31, 0.47, 0.85...]

Car → [0.91, 0.12, 0.44...]

Notice that Cat and Dog have similar vectors because their meanings are related.

3. Why are Embeddings Important?

Embeddings allow AI to understand meaning, not just exact words.

Applications:

Semantic Search

Recommendation Systems

RAG

Duplicate Detection

Document Clustering

Similarity Search

4. What is a Vector Database?

A Vector Database stores embeddings instead of plain text.

It enables fast similarity searches across millions of vectors.

Popular Vector Databases:

Pinecone

Chroma

Weaviate

FAISS

Milvus

Qdrant

These databases are optimized for vector similarity search rather than traditional SQL queries.

5. Traditional Search vs Semantic Search

Traditional Search:

Matches keywords

Exact words required

Limited context

Less accurate

Semantic Search:

Matches meaning

Understands intent

Context-aware

More relevant results

Example

Search: "How to lose weight"

Semantic search may also return:

Fat loss tips

Weight reduction strategies

Healthy diet plans

Even if the exact words don't match.

6. What is Vector Similarity Search?

Vector similarity search finds documents whose embeddings are closest to the query embedding.

Workflow

User Query

↓

Generate Query Embedding

↓

Compare with Stored Embeddings

↓

Find Most Similar Documents

↓

Return Results

Common similarity metrics:

Cosine Similarity

Euclidean Distance

Dot Product

7. What is RAG (Retrieval-Augmented Generation)?

RAG combines:

Information Retrieval

Large Language Models

Instead of relying only on the model's memory, RAG retrieves relevant information before generating an answer.

8. How does a RAG pipeline work?

User Question

↓

Embedding Model

↓

Vector Database

↓

Similarity Search

↓

Relevant Documents

↓

LLM

↓

Final Answer

Example:

Question: "What is our company's leave policy?"

The system:

1. Retrieves the HR policy document.

2. Sends the relevant section to the LLM.

3. Generates an accurate answer based on that document.