Platforms often report a modelling quality figure for a backtest, and a high percentage can create false confidence. The number describes how much of the test used tick data that the platform considered real, not whether the simulated trading resembles live conditions.
The fine print is revealing. In some cases, a figure of ninety-nine percent only means that the data was complete from the tick source, which may itself be generated from minute bars through interpolation.
What matters more is whether the test accounts for variable spreads, commissions, slippage, rejected orders, and realistic latency. A strategy that earns two pips per trade in a perfect simulation can lose money once those factors are applied.
A more honest approach is to run the test on real tick data with recorded spreads, then add pessimistic assumptions for slippage and delay, and see whether the edge survives.
If it does, there is a decent basis for going forward. If it does not, the strategy has no edge to speak of, whatever the quality label says.
Running a walk-forward test, where the strategy is optimised on one period and tested on the next without changes, adds another layer of honesty. Results that hold up out of sample deserve far more trust than those fitted to a single block of history.
What checks do you run beyond the quality percentage before trusting a backtest?
Backtest quality: what a ninety-nine percent label really means
-
Shadow Trader
- Posts: 5594
- Joined: Wed Sep 09, 2026 5:19 pm
-
FXS Prop Desk
- Posts: 1689
- Joined: Wed Oct 07, 2026 9:52 am
Re: Backtest quality: what a ninety-nine percent label really means
The fine print is the point: the percentage measures how much of the test used tick data the platform accepted as real, nothing about spread, commission or slippage. A 99% run with a fixed 1 pip spread can be less realistic than a 90% run with recorded spreads. Anyone sharing a backtest should list the spread model and commission next to the quality figure, otherwise it's a number without context.
FXS Official Team | The Idea Lab & Strategy
-
Amanhasnoname
- Posts: 2060
- Joined: Fri Oct 30, 2026 9:45 am
Re: Backtest quality: what a ninety-nine percent label really means
I got burned by exactly this. An expert advisor I bought showed a beautiful curve at the highest modelling quality, and when I reran it myself on the same pair with recorded spreads it went from strongly positive to roughly flat. The original test had used a fixed spread that was tighter than anything I ever saw on my account during the hours the robot traded most.
The first check I run now is to look at when the trades actually happen. If a big share of entries fall around the daily rollover or straight after news, I know the spread assumption is doing most of the work, so I rerun those hours with a deliberately wide spread and see what is left.
After that I add one pip of slippage on every market order and look at the average trade in pips rather than the total profit. If the average is smaller than a pip, I treat the edge as too thin to survive live trading. Then I split the history in half, optimise on one part and run the other untouched, which has quietly killed most of the ideas I was excited about.
The first check I run now is to look at when the trades actually happen. If a big share of entries fall around the daily rollover or straight after news, I know the spread assumption is doing most of the work, so I rerun those hours with a deliberately wide spread and see what is left.
After that I add one pip of slippage on every market order and look at the average trade in pips rather than the total profit. If the average is smaller than a pip, I treat the edge as too thin to survive live trading. Then I split the history in half, optimise on one part and run the other untouched, which has quietly killed most of the ideas I was excited about.