Why use ridge regression when p is larger than n?
PICTURE THIS: HOW TO EXPLAIN IT
Simple meaning
Ordinary least squares needs X transpose X to be invertible, which fails when p exceeds n or columns are collinear.
WHY — Linear Regression instead of guessing?
Why interviewers care about Linear Regression:
on Linear Regression.
the situation, the default choice, and one exception - that reads as experience.
Name the idea, why it exists, then one short example.
End with when you use it and one common pitfall.
STEPS — What happens step by step?
Before you speak the answer, walk the interviewer through these steps:
- 1Ordinary least squares needs
X transpose X to be invertible, which fails when p exceeds n or columns are collinear.
- 2Ridge adds lambda I
so the system is well posed and coefficients shrink.
- 3How it works
Predictions can still work
- 4unregularized coefficients will not
be unique.
- 5Common mistake
What juniors usually get wrong.
- 6Close
When you pick this over the alternative.
EXAMPLE — See it in action
Here's a short line you can speak, broken into clear beats:
Note: Adapt this scaffold to your own project — keep it under 60–90 seconds.
Key takeaway
Ordinary least squares needs X transpose X to be invertible, which fails when p exceeds n or columns are collinear. Ridge adds lambda I so the system is well posed and coefficients shrink.