Advertisement IC Markets

Parameter Plateaus: Why a Stable Region Beats the Best Single Setting

Share, develop, and backtest custom MQL4/MQL5 Expert Advisors, Python data-scraping scripts, trading bots, and automated market alert systems.
Post Reply
FXS Prop Desk
Posts: 1689
Joined: Wed Oct 07, 2026 9:52 am

Parameter Plateaus: Why a Stable Region Beats the Best Single Setting

Post by FXS Prop Desk »

Optimisation often finds a "best" parameter set. If nearby values perform much worse, the result is likely luck.

What to look for:
  • A plateau: a range of parameter values with similar results.
  • Smooth changes in results across parameters.
  • Choosing a value in the middle of the plateau, not at the peak.
Methods:
  • Heatmaps of results across two parameters.
  • Sensitivity tables.
Strategies with few parameters and wide plateaus tend to hold up better in live trading.

A useful habit is to look at the worst result inside the plateau, not the best. If even the weakest neighbouring setting is acceptable, the strategy is less likely to disappoint when conditions change slightly.

Walk-forward results can confirm a plateau: if the chosen value stays inside the stable region in most windows, the setting is far more trustworthy than one that only works in a single period.

Do you check parameter stability when optimising?
FXS Official Team | The Idea Lab & Strategy
Recommended broker for automated trading & scalping IC Markets
Shadow Trader
Posts: 5594
Joined: Wed Sep 09, 2026 5:19 pm

Re: Parameter Plateaus: Why a Stable Region Beats the Best Single Setting

Post by Shadow Trader »

FXS Prop Desk, I check stability, but I learned the hard way that a plateau under one cost assumption can vanish under another. My breakout EA had a flat region for the lookback between 14 and 22 bars at 0.6 pips of spread, and at 1.2 pips half of that region turned negative.

So my heatmaps now come in pairs, one at normal costs and one at roughly double. If the plateau survives the expensive version I take the middle of what is left, not the middle of the original.

I also agree on judging by the worst neighbour. My rule is that every cell within two steps of the chosen value must keep a profit factor above 1.15, and if one cell drops below that I treat the whole area as suspect.

One thing I would add is the number of trades per cell. A cell with 40 trades can look like a peak purely from noise, so I grey out anything under 150 trades before reading the map.

Do you optimise more than two parameters at a time? Past two I find the plateau hard to see, so I start fixing one parameter by logic instead.
Shadow Trader
Posts: 5594
Joined: Wed Sep 09, 2026 5:19 pm

Re: Parameter Plateaus: Why a Stable Region Beats the Best Single Setting

Post by Shadow Trader »

FXS Prop Desk, your walk-forward point is where the breakout EA from my earlier reply either earned trust or lost it. I split the history into 8 windows of six months each, optimised the lookback inside each one, and recorded where the best value landed.
img_13698_r2.png
img_13698_r2.png (76.03 KiB) Viewed 101 times
In 6 of the 8 windows the best lookback fell inside the 14 to 22 band, and the chart marks the two that did not, at 26 and 11. Both were unusual stretches for volatility, which is reassuring in one way and worrying in another.

The reassuring part is that the fixed value of 18 still made money in both of them out of sample, just less. The worrying part is that a run of windows like those would move the plateau, and I would only notice after the fact.

So I now track the distance between each window's optimum and the fixed setting as a number of its own. If two windows in a row land outside the band, I rerun the whole map rather than nudging the setting toward the new peak.

How many windows do you consider enough? Eight felt thin to me, but shorter windows gave fewer than 150 trades each, which breaks my own rule on cell size.
Shadow Trader
Posts: 5594
Joined: Wed Sep 09, 2026 5:19 pm

Re: Parameter Plateaus: Why a Stable Region Beats the Best Single Setting

Post by Shadow Trader »

Optimizing a strategy's parameters to maximize historical profit often produces a curve fitted to noise. The resulting settings look excellent in testing and fail live. This is overfitting, one of the most common pitfalls in systematic trading.

A telltale sign is a parameter cliff, where a small change in a setting produces a dramatic drop in performance. A robust strategy shows a plateau, with similar results across a range of nearby values. A spike surrounded by poor results suggests luck.

Testing sensitivity by varying each parameter within a reasonable range reveals the shape of the performance landscape. Choosing settings from the middle of a broad plateau, instead of the single best point, increases the chance of survival. Limiting the number of parameters also reduces the risk. Each additional variable offers another way to fit noise. Simplicity, combined with out-of-sample validation, remains the most reliable guard against deceiving oneself with a beautiful but meaningless backtest.
Post Reply