Holdout
Published
Definition
Data deliberately kept separate from the observations used to select or tune a rule. Inspecting and repeatedly optimizing against a holdout erodes its value as an independent check.
Examples
- A learner can choose settings using one historical period and assess the fixed rule on a later untouched period without adjusting the settings to that result.
Also known as
- holdout sample
- out-of-sample
Related terms
Sources
For education only. Examples are illustrative and are not instructions to trade.