TradeLabs AILearn

Why Strategies Fail

Most strategies that look good in backtests fail live. Learn the main causes, from overfitting and costs to regime changes, and how to guard against each.

Intermediate3 min readUpdated 3 Oct 2026
Markdown
Lesson 3 of 38

Many traders have built a strategy with a beautiful backtest, started trading it and watched it lose money. This is the norm, not the exception. Studies of published trading strategies and of retail trader results show that most apparent edges disappear in real trading. The reasons are well known and largely preventable. Understanding them is the best way to build strategies that have a chance of surviving contact with live markets.

The main causes#

CauseWhat goes wrongLesson
OverfittingThe strategy fits noise in historical dataOverfitting and Curve Fitting
Multiple testingThe best of many tests looks good by chanceP-Hacking and Multiple Testing
Look ahead biasThe backtest used information not available at the timeLook-Ahead Bias
Survivorship biasData excluded failed companies or delisted assetsSurvivorship and Selection Bias
Data leakageInformation from the test period leaked into trainingData Leakage
Unrealistic costsCommissions, spreads, slippage and borrow costs ignoredCosts and Slippage in Backtests
Unrealistic fillsAssuming trades fill at prices that were not availableFill Models, Partial Fills and Order Queues
Capacity limitsReturns vanish at real trading sizeAlpha Capacity and Crowding
Regime changeMarket conditions differ from the test periodStructural Breaks and Regime Changes
Edge decayCompetition removes the edgeSignal and Alpha Decay
Execution and operational errorsBugs, data outages, wrong ordersAlerts, Error Handling and Reconnection
Trader behaviourOverriding rules, abandoning in drawdownsDiscipline

A typical failure story#

The gap between backtest and live#

Researchers have documented large drops from backtest to live performance:

  • Academic anomalies lose a substantial share of returns after publication (McLean and Pontiff, 2016).
  • Quantopian research (2016), analysing hundreds of user strategies, found that backtest Sharpe ratios had little ability to predict out of sample performance, and that strategies tested more times showed bigger gaps.

Guarding against failure#

  1. Start with an economic rationale. See The Trading Research Process.
  2. Keep strategies simple with few parameters.
  3. Record every test and adjust expectations for the number of trials.
  4. Model costs conservatively, then add a margin of safety.
  5. Validate out of sample and with walk forward tests. See Walk-Forward Analysis.
  6. Stress test across regimes and parameter changes. See Robustness and Stress Testing.
  7. Start small live and scale only when results match expectations.
  8. Set rules for reducing or stopping before you start.

Expect lower live performance#

A practical rule of thumb used by many quant traders is to expect live performance to be well below backtest performance, sometimes cutting the backtest Sharpe ratio by half or more. If the strategy is still attractive under that assumption, it may be worth trading.

When a strategy fails, learn from it#

Review failures systematically: was it overfitting, costs, execution, regime or behaviour? Each answer improves the next research cycle. See Post-Trade Analysis.

Frequently asked questions#

Why do backtested strategies fail in live trading?#

Mainly because of overfitting, testing many variations, look ahead and survivorship bias, unrealistic costs and fills, regime changes and execution problems.

How much worse is live performance than backtests?#

It varies, but many practitioners expect live risk adjusted returns to be substantially lower, often half or less of backtested figures.

How can I make my strategy more likely to work live?#

Use a clear rationale, keep rules simple, model costs conservatively, validate out of sample, start small and monitor results against expectations.

Next, learn how to build a reliable backtest in Backtesting Methodology.

Check your understanding

3 quick questions on this lesson. Get them all right to finish it.

Turn on JavaScript to take the quiz.

Finished this lesson?Sign in to save your progress across devices.
Next lessonBacktesting MethodologyA backtest simulates a strategy on historical data. Learn the steps, the key performance metrics, common biases and a checklist for backtests you can trust.

Mentioned in