Backtesting Software — Test Your Edge on Real Market History

Backtesting software means two different things

Automated backtesters take rules written as code and run them over years of history in seconds. You get thousands of trades, a parameter sweep and an equity curve before you've finished your coffee. MetaTrader's Strategy Tester, Python libraries like backtrader, and the strategy engines built into charting platforms all live here.

Manual replay tools do the opposite. They hide everything to the right of the current candle and step price forward one bar at a time while you read the chart and click your own entries, stops and targets. No code, no optimiser, no thousands of trades — you get however many setups you can work through by hand.

The mistake is buying across the divide, and it's extremely common: discretionary traders buy an optimiser, discover their setup can't be expressed as code, and never open it again; mechanical traders buy a replay tool and spend three weeks clicking through what a script would have answered in an afternoon.

There's a clean test for which side you're on. Could a stranger read your rules, never see the chart, and take exactly the trades you'd take? If yes, your strategy is mechanical — automate it. If your honest answer involves the words "it depends" or "you'd see it", it's discretionary, and no optimiser can test it. Replay is the only honest option. If you're not sure which you have, that ambiguity is itself the finding — writing rules precisely enough to be testable settles it faster than any software will.

The real options, compared

Every serious tool in this space is good at something and bad at something else, and the marketing never tells you which. Here's the honest version.

Third-party plan limits and prices above were checked against each vendor's own pricing page on the date shown at the top of this page. These vendors run frequent sales — check their current pricing yourself before deciding.

What good backtesting software should do

Four things separate real backtesting software from a chart you can drag. It should replay real historical data bar by bar so hindsight can't creep in. It should log every trade and turn them into stats — win rate, average R, profit factor, drawdown. It should cover the markets you actually trade. And it should be fast enough that you can run hundreds of setups without it becoming a chore.

That last one gets dismissed as a nice-to-have and it is the one that decides whether you finish. A sample of 100 setups is not a big ask; at two minutes of clicking per setup it's a few evenings, and at ten it's a project you abandon. The arithmetic of backtesting throughput is worth doing before you pick a tool, not after.

The one feature that decides whether your results are real

If the software lets you drag the chart backwards and forwards freely, you will do it. Not deliberately — you'll nudge it two candles to "check", and you'll have seen the outcome before you marked the entry. That is the entire mechanism behind traders reporting 90% win rates in testing and 40% live. It isn't dishonesty, it's that the tool made the honest version optional.

Real replay makes it impossible rather than discouraged: the right-hand side does not exist, you commit before the next candle prints, and a trade you'd have skipped live is a trade you skip here. Everything else on a feature list is secondary to that one property. The related failures — cherry-picking the sample, quietly editing rules mid-test, calling twenty trades a result — are covered in the seven mistakes that make backtest results worthless.

Watch for the subtler version too. Software that fills you at a level price merely touched, or that lets you enter on a candle only after seeing it close, is producing a result you cannot reproduce live. That gap has a name and a size — why backtest results differ from live trading puts numbers on it.

How to choose, in three questions

1. Is your strategy mechanical or discretionary? Answered by the stranger test above. This decides the category, and nothing else matters until it's settled.

2. Do you need your broker's exact data? If your rules hinge on a level being taken by a fraction of a point, or on spread at a specific hour, you need tick data from the feed you trade — that's MetaTrader or a desktop app with imported data. If you're testing structure, sweeps and session behaviour, any honest feed answers the question, and arguing about the last 0.2 of a pip is a way of avoiding the test.

3. How many setups can you realistically get through in a week? Multiply it by four. If that number isn't in the low hundreds, your bottleneck is throughput, not features — and you should pick whichever tool gets you from opening it to clicking a trade fastest, then optimise later.

Two questions that feel important and aren't: how many symbols the tool offers (you will test one or two, seriously, and testing thirty is how correlated markets inflate an apparent sample), and how many years of history it holds (until you've logged a few hundred trades, depth is not your constraint).

What it costs, and what you should pay to start

Browser-based replay tools run roughly $15–35 a month. Desktop simulators are sold as a licence plus a data package and run into the hundreds one-off. Automated testers built into trading terminals are typically free, because the broker wants you trading. Coding it yourself is free and costs you weeks.

You should not pay anything to start. Every credible option in this space has a free tier or a demo, and the honest reason to upgrade is not features — it's history depth. A free plan gets you enough real data to learn the tool and find out whether you'll actually sit down and do the reps. Only when you've logged a hundred trades and want to know whether your edge survives a different market regime does more history become the thing standing in your way. Buying depth before that is buying a bigger library before you've read a book.

What CRTLAB gives you

CRTLAB is browser-based backtesting software built around candle-by-candle replay — the manual side of the divide, deliberately. 38 markets: 17 US stocks and ETFs, seven crypto pairs, NAS100, US30, SP500, EURUSD, GBPUSD, USDJPY, gold, silver, oil and Bitcoin — replayed on real data, with your win rate, average R and profit factor tracked automatically as you go. It also ships with the CRT × Mitigation strategy and a full ICT course if you want a method to test rather than one to invent.

The free tier gives you 21 of the 38 markets — everything except the US stocks and ETFs — on the most recent two weeks of real data, every timeframe including intraday, no card, running in about 30 seconds. Pro ($29/month) unlocks all 38 markets with up to ten years of history each, plus the complete strategy and course, and you cancel it in one click.

Size each test properly while you're at it — a backtest that ignores position sizing isn't reflecting real money. The position size calculator takes about ten seconds per market, and the backtest sample size calculator will tell you when you've logged enough trades for the result to mean anything.