The Deflated Sharpe Ratio Explained for Crypto Traders

The Deflated Sharpe Ratio corrects a backtest's Sharpe for how many strategies you tried. See the intuition, the formula and a worked example by trial count.

Trigr Research6 min read
On this page
  1. Why is the raw Sharpe ratio misleading?
  2. What does the Deflated Sharpe Ratio actually measure?
  3. How is the Deflated Sharpe Ratio calculated?
  4. Worked example: how the trial count changes the verdict
  5. What counts as a trial?
  6. How does Trigr use the Deflated Sharpe Ratio?
  7. How should you use the DSR in practice?
  8. What the Deflated Sharpe Ratio does not tell you
  9. Next steps

TL;DR: The Deflated Sharpe Ratio (DSR) is the probability that a strategy's true Sharpe ratio beats the best Sharpe you would expect from pure luck, given how many variants you tried. It was introduced by Bailey and López de Prado to correct for selection bias, short samples and non-normal returns. The more trials behind a result, the higher the bar, so an impressive Sharpe from a large search can deflate to a coin flip.

Why is the raw Sharpe ratio misleading?

The Sharpe ratio measures average excess return per unit of volatility. It is a fine descriptive statistic for one strategy tested once. Research rarely works that way.

A typical session tries a moving-average length, then another, swaps RSI for a funding filter, tests three assets and two timeframes, and adjusts the stop. After fifty variants, the best one is reported. Its Sharpe ratio is now the maximum of fifty noisy estimates, and maximums of noisy numbers are biased upward even when every variant has zero true edge.

Three more issues compound this:

  • Short samples. A Sharpe estimated from one or two years of data has wide error bars.
  • Fat tails and negative skew. Crypto returns often have occasional large losses. The standard Sharpe error formula assumes normal returns and understates uncertainty when they are not.
  • Silent trials. Variants you discarded without writing them down still count.

This is why point-in-time backtesting alone is not enough. A simulation can be perfectly honest about data and costs and still mislead you through selection.

What does the Deflated Sharpe Ratio actually measure?

David Bailey and Marcos López de Prado introduced the DSR in their 2014 paper, The Deflated Sharpe Ratio: Correcting for Selection Bias, Backtest Overfitting and Non-Normality (SSRN 2460551). It builds on two ideas.

The first is the Probabilistic Sharpe Ratio (PSR): the probability that the true Sharpe ratio is above some benchmark, given the observed Sharpe, the number of observations, and the skewness and kurtosis of returns.

The second is the benchmark itself. Instead of zero, the DSR uses the Sharpe ratio you would expect as the maximum across N independent trials that have no real edge. The DSR is the PSR evaluated against that expected maximum.

In plain language: the DSR asks how likely it is that your winner is genuinely better than the best of N lottery tickets.

How is the Deflated Sharpe Ratio calculated?

You do not need to compute it by hand, but seeing the pieces makes the intuition concrete. The expected maximum Sharpe across N trials is approximately:

SR0 = sqrt(V) × [ (1 − γ) × Φ⁻¹(1 − 1/N) + γ × Φ⁻¹(1 − 1/(N × e)) ]

where V is the variance of the Sharpe estimates across trials, γ ≈ 0.5772 is the Euler–Mascheroni constant, Φ⁻¹ is the inverse standard normal distribution, and e is Euler's number.

The DSR is then the probability:

DSR = Φ( (SR − SR0) × sqrt(T − 1) / sqrt(1 − skew × SR + ((kurtosis − 1) / 4) × SR²) )

where SR is the observed Sharpe per observation (not annualized) and T is the number of return observations. Two things to notice:

  • SR0 grows with N, roughly with the square root of the logarithm of the number of trials. More trials, higher bar.
  • Negative skew and fat tails widen the denominator, so the evidence from any given sample counts for less.

Worked example: how the trial count changes the verdict

Take a hypothetical strategy with an annualized Sharpe of 1.5, measured on four years of daily returns (T = 1,460 observations, since crypto trades every day). The assumptions behind the table:

  • Annualization uses the square root of 365, so the per-observation Sharpe is 1.5 / √365 ≈ 0.0785.
  • The Sharpe estimates across your trials have an annualized standard deviation of 0.5, so √V ≈ 0.5 / √365 ≈ 0.0262 per observation.
  • Returns are normal: skewness 0 and kurtosis 3, which makes the denominator √(1 + 0.5 × SR²).
  • With N = 1 there is no search to correct for, so SR0 = 0 and the DSR equals the PSR against zero.
Trials tested (N) Expected best Sharpe from luck (annualized) Deflated Sharpe Ratio
1 0.00 0.999 (≈ 0.9986)
10 0.79 0.92
100 1.27 0.68
1,000 1.63 0.40

For example, at N = 100 the bracket in the SR0 formula is about 2.53, so SR0 ≈ 0.0262 × 2.53 ≈ 0.066 per observation (1.27 annualized). The z-score is (0.0785 − 0.066) × √1,459 / √1.003 ≈ 0.47, and Φ(0.47) ≈ 0.68. All figures are rounded and purely illustrative.

The same equity curve tells four different stories. Reported as a single, pre-registered idea, a 1.5 Sharpe over four years is strong evidence. Reported as the best of 1,000 variants, it is worse than a coin flip: you would expect the luckiest of 1,000 edgeless strategies to show a Sharpe around 1.6.

Notice also that going from 10 to 100 trials costs more than going from 1 to 10 in DSR terms at this Sharpe level. Small searches are cheap; large, undisciplined searches are expensive.

What counts as a trial?

This is the part that depends on you. A trial is any variant you evaluated before choosing the one you kept:

  • Parameter values, such as lookback lengths and thresholds.
  • Structural choices, such as swapping an indicator or adding a filter.
  • Assets and timeframes you tried the idea on.
  • Exit rules: stop distance, take-profit, time stops.

Trials that are highly correlated, like a 20-bar and a 21-bar moving average, carry less independent information than genuinely different ideas, so the effective N can be lower than the raw count. An appendix of the Bailey and López de Prado paper shows how to estimate N when trials are not independent. What you should not do is round N down to 1 because the other variants were "just exploring."

How does Trigr use the Deflated Sharpe Ratio?

Trigr computes the DSR in ML optimization, not in a standard backtest. In a standard Studio backtest, the headline row shows net return, win rate, raw Sharpe and max drawdown, with a Robustness Score. The "Deep dive" section lists the Deflated Sharpe Ratio and PBO as "Not yet computed" until you run Optimize with ML. Trigr does not estimate a DSR it has not computed, and while neither statistic exists the Robustness Score is labeled a heuristic and capped below its top tier.

An Optimize with ML run reports a DSR computed with that run's own trial count, next to out-of-sample Sharpe from anchored, purged walk-forward validation, a leak verdict, and the Probability of Backtest Overfitting (PBO) from a separate combinatorial grid. PBO estimates how often choices that look best in-sample underperform out-of-sample, and is covered in what PBO tells you. The run picks among LightGBM, random forest and XGBoost, each with fixed parameters, by walk-forward out-of-sample performance, which keeps its trial count small. The results treat a DSR of 0.60 as the research floor. The AI and ML optimization docs describe what each run returns.

How should you use the DSR in practice?

The DSR is most useful as a habit rather than a single gate. A few practical rules follow from the formula:

  • Log every trial. Keep a simple research journal of each variant you run, including the ones you discard in seconds. That count is the input the DSR needs.
  • Decide the search space up front. Choosing three lookbacks and two filters before you start gives you a small, honest N. Tweaking until something works gives you a large, unknown one.
  • Prefer longer samples. For the same Sharpe, more observations raise the DSR, because the estimate becomes more precise.
  • Compare like with like. A DSR computed on net returns is not comparable to one computed on gross returns from another strategy.
  • Treat a low DSR as information. It does not prove there is no edge. It tells you the evidence so far cannot separate the result from search, which is a reason to gather new data, for example by paper trading a frozen version.

What the Deflated Sharpe Ratio does not tell you

The DSR is a correction for selection, not a certificate of quality. It cannot detect:

  • Look-ahead bias or unrealistic fills. A leaky backtest produces a high Sharpe and a high DSR together.
  • Missing costs. Run it on net returns, after slippage and funding, not gross.
  • Regime change. A strategy can be statistically real over the past and still stop working.
  • Understated trials. The DSR is only as honest as the N you give it.

For a broader reading order, including drawdown and the trade log, see how to read a backtest. The concepts come from López de Prado's Advances in Financial Machine Learning (Wiley, 2018), which treats backtest overfitting at length. Backtests are not guarantees; perps are leveraged and can lose more than expected.

Next steps

Before your next research session, write down every variant you test so you can report an honest trial count. To run backtests and ML optimization with DSR on your own ideas, see the plans on the pricing page.

Frequently asked questions

What is the Deflated Sharpe Ratio?

The Deflated Sharpe Ratio, introduced by David Bailey and Marcos López de Prado in 2014, is the probability that a strategy's true Sharpe ratio is above what you would expect from the best of many random trials. It adjusts for the number of strategies tested, the sample length, and skewness and fat tails in returns.

What is a good Deflated Sharpe Ratio?

Because the DSR is a probability, values near 1 mean the observed Sharpe is very unlikely to be a product of search alone. A common convention is to require 0.95 or more, the 95% confidence level, but any value is only as good as the trial count behind it.

What counts as a trial for the Deflated Sharpe Ratio?

Every distinct variant you evaluated before choosing the winner: parameter settings, indicator swaps, assets, timeframes and exit rules. Highly correlated variants count for less than independent ones, but leaving trials out makes the DSR look better than it should.

Does Trigr show the Deflated Sharpe Ratio?

Yes, from ML optimization runs. An Optimize with ML run reports the DSR using that run's trial count, next to PBO and out-of-sample Sharpe. A standard backtest shows raw Sharpe in its headline and lists DSR and PBO as not yet computed, rather than showing an invented number.

Put the idea to an honest test.

Describe a strategy in plain English or from your own AI assistant, backtest it on point-in-time data, and forward-test it on paper before any real money is involved.