Skip to content

Holdout

Published

Definition

Data deliberately kept separate from the observations used to select or tune a rule. Inspecting and repeatedly optimizing against a holdout erodes its value as an independent check.

Examples

  1. A learner can choose settings using one historical period and assess the fixed rule on a later untouched period without adjusting the settings to that result.

Also known as

  • holdout sample
  • out-of-sample

Related terms

Sources

For education only. Examples are illustrative and are not instructions to trade.