How to Read a Backtest Report: Costs, Drawdown, Trade Log

How to read a backtest in the right order: assumptions, Deflated Sharpe, PBO, drawdown, trade count and the trade log, with a worked example and red flags.

Trigr Research6 min read
On this page
  1. Why does the order you read a backtest matter?
  2. Step 1: What did the backtest assume?
  3. Step 2: Is the edge more than luck? DSR and PBO
  4. Step 3: How bad did it get? Drawdown and underwater time
  5. Step 4: Is there enough evidence? Trade count and concentration
  6. Step 5: Read the trade log and monthly returns
  7. A worked example: reading one hypothetical result
  8. A one-page backtest reading checklist
  9. Next steps

TL;DR: Read a backtest in order of how easily each number can be inflated: first the assumptions (data, fills, costs), then a selection-adjusted statistic such as the Deflated Sharpe Ratio and PBO, then drawdown depth and duration, then trade count and concentration, and only then the headline return. The trade log is where claims get checked. A result that survives that order is worth paper trading; one that does not is still useful, because it saved you money.

Why does the order you read a backtest matter?

Most backtest reports put the biggest, friendliest number at the top: total return. It is also the number most sensitive to leverage, lucky timing and missing costs. If you read it first, everything after it gets interpreted in its light.

A better habit is to read from the least flattering evidence to the most. Start with what the simulation assumed, then check whether the edge survives a correction for luck, then look at the pain, and finish with the gain. The principles behind the first step are covered in our guide to point-in-time backtesting.

Step 1: What did the backtest assume?

Before any metric, answer four questions:

  • Data. Was every input knowable at each bar's close? Were any inputs simulated or missing?
  • Fills. Do entries fill at the next bar's open or at the signal close? What happens when a take-profit and stop-loss share a bar?
  • Costs. Are fees included? Is the result gross or net of slippage and funding?
  • Window. Which period does it cover, and does that period include both rising and falling markets?

On Trigr these answers are part of the result. Every run includes an audit trail that flags which inputs were real and which were simulated. Fees are always applied, and a result without slippage and funding is labeled gross. Signals fill at the next bar's open. When a take-profit and stop-loss share a bar, the engine replays 5-minute candles if the strategy's timeframe is coarser, and the stop wins if that still cannot decide; a stop gapped through fills at the worse open. All of this is explained in next-bar-open fills. If you see a gross result, rerun it with the costs described in slippage and funding in perp backtests before going further.

Step 2: Is the edge more than luck? DSR and PBO

The next question is whether the result could plausibly come from trying many ideas and keeping the best one.

The Deflated Sharpe Ratio (DSR), introduced by Bailey and López de Prado, is the probability that the strategy's true Sharpe is above the best Sharpe you would expect from luck across all the variants tested. Values close to 1 are strong evidence; values near 0.5 or below mean the result is hard to distinguish from search. The full intuition, with a table by trial count, is in the Deflated Sharpe Ratio explained.

The Probability of Backtest Overfitting (PBO), from Bailey, Borwein, López de Prado and Zhu, estimates how often the configuration that looks best in-sample ranks below the median out-of-sample. Lower is better; a PBO around 0.5 means your selection process is roughly as good as picking at random.

On Trigr, both statistics come from Optimize with ML runs, which report the DSR with the run's own trial count and PBO from a separate combinatorial validation grid, next to out-of-sample Sharpe. A standard backtest does not compute them: its headline row shows net return, win rate, raw Sharpe and max drawdown, and the "Deep dive" section lists DSR and PBO as "Not yet computed." Until they exist, read the raw Sharpe as optimistic, because it has not been corrected for how many variants you tried.

Step 3: How bad did it get? Drawdown and underwater time

Drawdown is the fall from a previous equity peak. Two numbers matter:

  • Maximum drawdown depth. A −40% drawdown needs a +67% gain to recover; a −60% drawdown needs +150%.
  • Longest time underwater. How many months passed between a peak and the next new high. Long underwater periods are where people abandon strategies.

Ask yourself honestly whether you would have kept running the strategy through its worst stretch. If not, its average return is irrelevant to you. Also remember that a backtest's worst drawdown is a sample of one; live trading can be worse. Backtests are not guarantees; perps are leveraged and can lose more than expected.

Step 4: Is there enough evidence? Trade count and concentration

Statistics need observations. A strategy with 25 trades over three years has little to say, no matter how good its numbers look.

Look at:

  • Trade count. A few dozen trades leave wide error bars.
  • Concentration. What share of total profit comes from the top three trades? If removing them turns the result negative, the strategy may depend on rare events it cannot reliably repeat.
  • Win rate with payoff. A 35% win rate is fine if winners are much larger than losers; a 90% win rate is fragile if a single loss can erase months of gains.
  • Profit factor. Gross profits divided by gross losses. Close to 1 means the strategy barely pays for its losers.

Step 5: Read the trade log and monthly returns

The trade log is where every other claim is checked. Open it and sample a few trades by hand:

  • Do entry prices match the next bar's open after the signal?
  • On bars where both the target and the stop were in range, does the exit match the first level touched on finer data, or the stop when that cannot be decided?
  • Are there clusters of trades in one short period that account for most of the result?

Monthly returns show whether performance is spread across time or bunched into one regime. A strategy that made all its money in a single bull quarter is really a bet on that quarter repeating.

Finally, compare the equity curve with buy-and-hold of the same asset. A leveraged long strategy that tracks the market is not an edge; it is exposure you could get more cheaply.

The trailing 25% shading

Trigr shades the trailing 25% of a full-history backtest so you can compare recent behavior with the earlier curve. Use it to spot degradation. Do not treat it as an out-of-sample test: once you inspect it while choosing or tuning a strategy, it is part of your research data. For genuine out-of-sample evidence, use the anchored, purged walk-forward results from ML optimization, or freeze the strategy and forward-test it on a paper agent.

A worked example: reading one hypothetical result

Here is a hypothetical 4H ETH trend strategy, read in the order above. The numbers are invented for illustration, and the DSR and PBO assume an ML optimization run has been done on it:

Item Reported value Reading
Costs Gross (slippage and funding off) Rerun net before trusting anything else
Deflated Sharpe Ratio 0.55, from an ML optimization run Weak evidence after correcting for search
PBO 0.45 Selection barely better than random
Max drawdown −38%, 9 months underwater Needs +61% to recover; long pain period
Trades 64 Thin evidence
Top 3 trades 70% of total profit Highly concentrated
Win rate / profit factor 38% / 1.6 Reasonable payoff shape
Net return vs buy-and-hold +85% vs +120% Underperformed simple exposure
Raw Sharpe 1.4 Looks good, but read last for a reason

Read top-down, this is a strategy to keep researching, not to deploy. Read bottom-up, a 1.4 Sharpe and +85% return look attractive. That difference is the whole point of reading in order.

A one-page backtest reading checklist

Metric What it tells you Red flag
Audit trail and cost labels What was real, what was assumed Simulated inputs, gross presented as net
Deflated Sharpe Ratio Edge after correcting for trials Near 0.5 or below, or not computed
PBO Reliability of the selection process Around 0.5 or higher
Max drawdown and duration The pain you must sit through Deeper or longer than you would tolerate
Trade count Weight of evidence A few dozen or fewer
Profit concentration Dependence on rare events A few trades make most of the profit
Monthly returns Consistency across regimes All gains in one period
Equity vs buy-and-hold Whether it beats simple exposure Leveraged beta, not edge

Next steps

Take the last backtest you were excited about and read it again in this order, starting with the cost labels. To compare against strategies that were published with a stored, verified full-history backtest, browse the Trigr marketplace, or read the backtesting docs for every assumption Trigr makes.

Frequently asked questions

What is the most important metric in a backtest?

No single number is enough, but start with the assumptions and a selection-adjusted statistic such as the Deflated Sharpe Ratio. Raw return and raw Sharpe are the easiest numbers to inflate, so read them last rather than first.

How many trades does a backtest need to be meaningful?

There is no fixed cutoff, but a few dozen trades leave very wide error bars, and results driven by a handful of trades are fragile. More trades over more market regimes give the statistics more to work with.

What is a red flag in a backtest?

Common red flags include gross results presented as net, a very high win rate with small targets on coarse bars, most profit coming from a few trades, long flat or underwater periods, and a strategy that simply tracks buy-and-hold with leverage.

Is the shaded recent period in Trigr an out-of-sample test?

No. Trigr shades the trailing 25% of a full-history backtest as a recent-period diagnostic to help spot degradation. Once you inspect it while choosing a strategy, it becomes part of your research data rather than a holdout.

Put the idea to an honest test.

Describe a strategy in plain English or from your own AI assistant, backtest it on point-in-time data, and forward-test it on paper before any real money is involved.