Sample Size: How Many Trades Before the Numbers Mean Something?

[Fairman]

Sample Size: How Many Trades Before the Numbers Mean Something?

You took 20 trades and made 8R. Is the strategy good? The honest answer is that you cannot tell yet.

With small samples, luck dominates. Consider a coin that wins 50 percent. In 20 flips, getting 13 or more heads occurs in about one in eight tries. Applied to trading, a break-even strategy can show a handsome profit over 20 trades simply by chance.

Confidence grows with the square root of the sample size, which means that to halve your uncertainty, you need four times the trades. Rough guidance suggests at least 100 trades for a basic impression, and 200 to 300 for more reliable conclusions, especially for strategies with low win rates or high variance in outcomes.

Streaks of results can mislead in both directions. A good strategy can show a losing month, and a poor one can show a winning month.

This has practical implications. Do not abandon a promising strategy after ten losses, and do not scale up after ten wins. Decide in advance how many trades you will take before evaluating, and stick to that.

Lower-frequency strategies take longer to evaluate, which is a hidden cost of swing trading.

When assessing a vendor or signal service, ask for sample size before looking at returns.

Practical step: count the trades in your current track record and write down how many more you need before you will judge it.

[Fairman]

Worth saying out loud: 20 trades is about a month for a lot of part-time traders. So the honest timeline for knowing anything is more like four to six months, not a couple of weeks.

[Fairman]

If waiting for 100 live trades feels too slow, backtest the same rules to get the sample, then use the live trades only to check you're executing them the way the test assumes. Two different jobs.

[Fairman]

Low win rate setups need even more patience. With a 30 percent win rate, ten losses in a row is not rare at all, so a short sample can make a decent system look broken.