Why do duplicate rows matter, and how do you handle them?
Simple meaning
Duplicates inflate counts, double-weight users in means, and can be real repeated events or pipeline bugs.
Open the full page for Why, Steps, Example and Key takeaway.
Panel-ready Data Science track questions for freshers and experienced developers. Practice at Coding Cadre in Faridabad, or Online from Delhi NCR.
Duplicates inflate counts, double-weight users in means, and can be real repeated events or pipeline bugs.
Open the full page for Why, Steps, Example and Key takeaway.
Cardinality is the number of distinct values.
Open the full page for Why, Steps, Example and Key takeaway.
MCAR means missingness is unrelated to observed and unobserved values.
Open the full page for Why, Steps, Example and Key takeaway.
Median imputation is more robust on skewed numeric columns because a few giants do not dominate the fill value.
Open the full page for Why, Steps, Example and Key takeaway.
The fact of missingness can itself predict the outcome, for example users who skip billing fields.
Open the full page for Why, Steps, Example and Key takeaway.
Listwise deletion drops a whole row if any analysis variable is missing.
Open the full page for Why, Steps, Example and Key takeaway.
Values below Q1 minus one-and-a-half IQRs or above Q3 plus one-and-a-half IQRs are conventional box-plot outliers.
Open the full page for Why, Steps, Example and Key takeaway.
A common rule flags |z| greater than 3 under an approximate normal model.
Open the full page for Why, Steps, Example and Key takeaway.
Keep them when they are valid rare events you care about, such as whale spenders, outages, or fraud.
Open the full page for Why, Steps, Example and Key takeaway.
Winsorization caps extreme values at chosen percentiles instead of dropping rows, so sample size stays the same.
Open the full page for Why, Steps, Example and Key takeaway.
A box plot compactly compares medians, IQRs, and flagged extremes across groups, which is handy for many categories.
Open the full page for Why, Steps, Example and Key takeaway.
Heatmaps work well for correlation matrices, confusion matrices, or intensity over two discrete axes such as hour-by-weekday.
Open the full page for Why, Steps, Example and Key takeaway.
Lines preserve temporal order and make trends, seasonality, and shocks easy to see.
Open the full page for Why, Steps, Example and Key takeaway.
A confounder is a variable that influences both the treatment-like factor and the outcome, opening a back-door association.
Open the full page for Why, Steps, Example and Key takeaway.
Simpson's paradox is when a trend that appears in several groups reverses or vanishes when the groups are combined.
Open the full page for Why, Steps, Example and Key takeaway.
Reverse causality means the outcome is driving the supposed cause, not the other way around.
Open the full page for Why, Steps, Example and Key takeaway.
Stratified sampling draws separately within subgroups, such as country or plan tier, often in proportion to size.
Open the full page for Why, Steps, Example and Key takeaway.
Cluster sampling selects groups first, such as cities or schools, then observes units inside those groups.
Open the full page for Why, Steps, Example and Key takeaway.
The bootstrap resamples the observed dataset with replacement to approximate the sampling distribution of a statistic.
Open the full page for Why, Steps, Example and Key takeaway.
Sampling error is random fluctuation from drawing a finite sample, and it shrinks with n under good design.
Open the full page for Why, Steps, Example and Key takeaway.