Overfitting and Curve Fitting

Overfitting, also called curve fitting, happens when a strategy or model is tuned so closely to historical data that it captures random noise rather than a genuine, repeatable pattern. An overfit strategy produces a smooth, impressive backtest and then fails on new data, because the noise it learned will not repeat. It is the single most common reason trading strategies fail, and it affects both simple rule based systems and complex machine learning models.

How overfitting happens#

A simple illustration#

Warning signs#

• Very high backtest Sharpe ratios (for example above 2 or 3 for slow strategies) without a strong reason.
• Many rules and parameters relative to the number of trades.
• Sharp performance peaks: small parameter changes destroy results. See Parameter Optimization.
• Rules that only make sense in hindsight.
• Large drop from in sample to out of sample performance.
• Smooth equity curves with almost no losing periods.

Measuring overfitting#

How to avoid overfitting#

1. Start with a clear hypothesis grounded in economics or market structure.
2. Keep it simple: fewer rules and parameters.
3. Record every test and count trials.
4. Prefer robust regions of parameter space over the single best value.
5. Use realistic costs, which often eliminate overfit edges.
6. Validate out of sample and with walk forward tests.
7. Test on other markets and periods without changing rules.
8. Use regularisation in machine learning models. See Model Evaluation and Cross-Validation.
9. Trade small first and compare live results with expectations.

Underfitting#

The opposite problem, underfitting, means a model is too simple to capture a real pattern. In trading, overfitting is far more common and dangerous, because markets are noisy and the incentive to find a great backtest is strong.

Frequently asked questions#

What is overfitting in trading?#

Tuning a strategy so closely to historical data that it captures random noise rather than a real pattern, causing it to fail on new data.

How can I tell if my strategy is overfit?#

Warning signs include many parameters, very high backtest performance, sensitivity to small parameter changes and much worse out of sample results.

How do I avoid curve fitting?#

Use a clear hypothesis, keep rules simple, record all tests, prefer robust parameter regions, model costs and validate on unseen data.

Next, learn about using information from the future by mistake in Look-Ahead Bias.