Moderate RAG Question 95 of 223

When can RAG still hallucinate?

GenAI / LLM · Speak this in 60–90 seconds · Faridabad & Delhi NCR

PICTURE THIS: RAG CHATBOT

QuestionEmbed query

SearchCompany docs

LLMAnswer with sources

Simple meaning

Retrieval can miss the right chunk, return conflicting sources, or pack so much text that the model ignores the key sentence.

WHY — RAG instead of guessing?

Why interviewers care about RAG:

They are checking judgment

on RAG.

A good answer names

the situation, the default choice, and one exception - that reads as experience.

Stay structured

Name the idea, why it exists, then one short example.

Close cleanly

End with when you use it and one common pitfall.

STEPS — What happens step by step?

Before you speak the answer, walk the interviewer through these steps:

1
Retrieval can miss the
right chunk, return conflicting sources, or pack so much text that the model ignores the key sentence.
2
The generator may also
blend parametric memory with retrieved text.
3
Instructing 'answer only from
context' helps but is not a proof of faithfulness.
4
Give an example
One tiny concrete case you can say aloud.
5
Common mistake
What juniors usually get wrong.
6
Close
When you pick this over the alternative.

EXAMPLE — See it in action

Here's a short line you can speak, broken into clear beats:

Say this line

“The generator may also blend parametric memory with retrieved text.”

Break into beats

Thegeneratormayalsoblendparametric

Speaking order

2987408337471632900

Note: Adapt this scaffold to your own project — keep it under 60–90 seconds.

Key takeaway

Retrieval can miss the right chunk, return conflicting sources, or pack so much text that the model ignores the key sentence. The generator may also blend parametric memory with retrieved text.