Easy LLM Question 214 of 223

What is a prompt in generative AI apps?

GenAI / LLM · Speak this in 60–90 seconds · Faridabad & Delhi NCR

PICTURE THIS: DATA SPLIT

Train 70%Val 15%Test 15%

Fit on train, tune on val, report on test once.

Simple meaning

The instruction and context you send the model.

1

WHY — Tokens instead of words?

LLMs use tokens (not full words) because it helps them:

LLM questions separate people

who only read docs from people who shipped.

Keep it short, concrete,

and tied to GenAI / LLM work.

Stable token IDs

Each piece maps to a number the network can learn.

Fits the model

Fixed pieces are what transformers expect as input.

2

STEPS — What happens with tokens?

Before the model can read a sentence, it goes through these steps:

  1. 1
    The instruction and context

    you send the model.

  2. 2
    Token IDs

    Clear constraints beat vague asks.

  3. 3
    Embeddings

    I version prompts like code.

  4. 4
    Context mix

    Attention looks at nearby tokens together.

  5. 5
    Next token

    The model scores what should come next.

  6. 6
    Decode

    IDs turn back into readable text.

3

EXAMPLE — See it in action

Let's see how a real sentence is tokenized (tokens may vary by model):

Input text
“Clear constraints beat vague asks.”
Tokenized output
Clearconstraintsbeatvagueasks
Token IDs (example)
298740833747163290

Note: Actual tokens and IDs depend on the tokenizer (e.g., GPT, Llama, etc.).

Key takeaway

The instruction and context you send the model. Clear constraints beat vague asks.

Previous question Next question
Chat with us