Why can outlier capping leak target information if done on the full dataset?
PICTURE THIS: DATA SPLIT
Fit on train, tune on val, report on test once.
Simple meaning
Percentile caps computed with test rows included use future or holdout extremes to define the training transformation.
WHY — Outliers instead of guessing?
Why interviewers care about Outliers:
on Outliers.
the situation, the default choice, and one exception - that reads as experience.
Name the idea, why it exists, then one short example.
End with when you use it and one common pitfall.
STEPS — What happens step by step?
Before you speak the answer, walk the interviewer through these steps:
- 1Percentile caps computed with
test rows included use future or holdout extremes to define the training transformation.
- 2That is a mild
form of leakage and can bias error metrics downward.
- 3Fit caps on training
folds only, then apply the same thresholds forward.
- 4Give an example
One tiny concrete case you can say aloud.
- 5Common mistake
What juniors usually get wrong.
- 6Close
When you pick this over the alternative.
EXAMPLE — See it in action
Here's a short line you can speak, broken into clear beats:
Note: Adapt this scaffold to your own project — keep it under 60–90 seconds.
Key takeaway
Percentile caps computed with test rows included use future or holdout extremes to define the training transformation. That is a mild form of leakage and can bias error metrics downward.