Overfitting is the most common reason backtests fail live. Some signs to look for:
- Too many parameters. An EA with 15 optimised inputs can fit almost any data.
- Parameters with very specific values (e.g. RSI period 17, stop 23 points, take profit 41 points).
- Performance collapses when parameters change slightly. A solid EA should work across a range of values.
- Great results in-sample, poor out-of-sample.
- Most profit comes from a small number of trades.
- Performance varies hugely by year.
Tests for robustness:
- Walk-forward analysis: optimise on one period, test on the next, repeat.
- Parameter sensitivity: plot results across a range of each parameter. Look for plateaus, not peaks.
- Different data: test on another broker's tick data.
- Monte Carlo: shuffle trade order to estimate drawdown distribution.
- Different pairs: does the logic work on similar instruments?
An honest backtest often looks less impressive but is more likely to survive live trading.
What's your main test for overfitting?
Signs an EA has been curve-fitted to tick data
-
FXS London Scalper
- Posts: 806
- Joined: Sun Oct 18, 2026 12:25 pm
Signs an EA has been curve-fitted to tick data
FXS Official Team | London Session Desk