Walk-forward testing for scalpers: window size matters

[Fairman]

Walk-forward testing for scalpers: window size matters

Walk-forward analysis means optimizing on one segment of data and testing on the following segment, then rolling forward. For scalpers, the choice of window lengths is critical. Too short, and the optimization chases noise. Too long, and the system adapts too slowly to changing conditions.

Because scalping systems trade often, a month can contain thousands of trades, so shorter windows can still provide enough data. Yet market regimes change over weeks and months, and volatility patterns shift. A window that spans a single regime may not generalize.

A practical approach is to test several combinations, such as optimizing on 3 months and testing on 1 month, then 6 months and 2 months, and comparing the stability of out-of-sample results. If results vary wildly between configurations, the system is fragile.

Look at the ratio of out-of-sample to in-sample performance. A ratio near 1 suggests the system generalizes. A ratio near zero or negative means the optimization found nothing real.

What window lengths work for the strategies tested, and how stable are the out-of-sample results?