Moderate Kubernetes Question 95 of 221

What is HPA and when would you autoscale a model Deployment?

MLOps track · Speak this in 60–90 seconds · Faridabad & Delhi NCR

PICTURE THIS: DATA SPLIT

Train 70%Val 15%Test 15%

Fit on train, tune on val, report on test once.

Simple meaning

The Horizontal Pod Autoscaler adds replicas from CPU, memory, or custom metrics such as queue depth or QPS.

WHY — Kubernetes instead of guessing?

Why interviewers care about Kubernetes:

Kubernetes questions separate people

who only read docs from people who shipped.

Keep it short, concrete,

and tied to MLOps work.

Stay structured

Name the idea, why it exists, then one short example.

Close cleanly

End with when you use it and one common pitfall.

STEPS — What happens step by step?

Before you speak the answer, walk the interviewer through these steps:

1
The Horizontal Pod Autoscaler
adds replicas from CPU, memory, or custom metrics such as queue depth or QPS.
2
It helps diurnal traffic
but struggles with sudden spikes and with GPU scale-up lag.
3
Combine it with load
tests so you know the metric actually tracks user latency.
4
Give an example
One tiny concrete case you can say aloud.
5
Common mistake
What juniors usually get wrong.
6
Close
When you pick this over the alternative.

EXAMPLE — See it in action

Here's a short line you can speak, broken into clear beats:

Say this line

“It helps diurnal traffic but struggles with sudden spikes and with GPU scale-up ”

Break into beats

Ithelpsdiurnaltrafficbutstruggles

Speaking order

2987408337471632900

Note: Adapt this scaffold to your own project — keep it under 60–90 seconds.

Key takeaway

The Horizontal Pod Autoscaler adds replicas from CPU, memory, or custom metrics such as queue depth or QPS. It helps diurnal traffic but struggles with sudden spikes and with GPU scale-up lag.