What Are the Correct Methods for Evaluating a Trading Strategy?

Follow us on LinkedIn

The trading literature deals mostly with the design and development of trading strategies. There is very little discussion on the topic of how to properly validate them, and most of the system validation techniques have been developed under a traditional statistical framework. Article [1], however, argued that using a traditional single testing framework is not enough, and provided some guidance on how to properly evaluate trading strategies using a multiple testing framework. It concluded,

In summary, the message of our research is simple. Researchers in finance, whether practitioners or academics, need to realize that they will find seemingly successful trading strategies by chance. We can no longer use the traditional tools of statistical analysis that assume that no one has looked at the data before and there is only a single strategy tried. A multiple testing framework offers help in reducing the number of false strategies adapted by firms. Two sigma is no longer an appropriate benchmark for evaluating trading strategies.

We agree that evaluating a trading strategy under a single testing framework is not enough, as the strategy might happen to be a winner by chance. However, we believe that the approach proposed by the authors is not practical, i.e. it’s not scalable, intuitive, and cannot be easily implemented.

The article then pointed out that the Sharpe ratio is not an appropriate measure of risk-adjusted return. This is true, especially with options trading strategies whose PnLs are not normally distributed and are often heavily skewed.

Our work has two important limitations. First, for a number of applications the Sharpe Ratio is not appropriate because the distribution of the strategy returns is not Normal. For example, two trading strategies might have identical Sharpe Ratios but one of them might be preferred because it has less severe downside risk.…

The article also discussed the importance of adding a low-correlated trading strategy as a diversifier to a portfolio.

…our work focuses on individual strategies. In actual practice, the investment manager needs to examine how the proposed strategy interacts with the current collection of strategies. For example, a strategy with a lower Sharpe might be preferred because the strategy is relatively uncorrelated with current strategies. The denominator in the Sharpe Ratio is simply the strategy volatility and does not measure the contribution of the strategy to the portfolio volatility. The strategy portfolio problem, i.e. adding a new strategy to a portfolio of existing strategies is the topic of Harvey and Liu (2014c).

For more discussion on the benefit of adding a diversifier to a portfolio, read Impact of a Low Correlation Trading Strategy

References

[1] Harvey, Campbell R. and Liu, Yan, Evaluating Trading Strategies, https://ssrn.com/abstract=2474755, 2014

Further questions

What's your question? Ask it in the discussion forum

Have an answer to the questions below? Post it here or in the forum

LATEST NEWSJamie Dimon endorses Disney CEO Bob Iger in proxy fight with Nelson Peltz's Trian Partners
Jamie Dimon endorses Disney CEO Bob Iger in proxy fight with Nelson Peltz's Trian Partners

JPMorgan Chase CEO Jamie Dimon endorsed Disney CEO Bob Iger in his proxy battle with activist Trian Partners, CNBC's David Faber has learned.

Stay up-to-date with the latest news - click here
LATEST NEWSElevated Signals Digitizes North America’s First Vertical Hydroponic Greenhouse
Elevated Signals Digitizes North America’s First Vertical Hydroponic Greenhouse

Vertical Harvest has selected Elevated Signals as its manufacturing software partner to drive profitability and support its planned 800-fold increase in cultivation space VANCOUVER, British Columbia & JACKSON HOLE, Wyo. — Elevated Signals Inc. (“Elevated Signals”), a company pioneering modern manufacturing software, announces its successful…

Stay up-to-date with the latest news - click here
LATEST NEWSA mom had her first baby at 25 and her second at 42. There were big differences.
A mom had her first baby at 25 and her second at 42. There were big differences.

An older mom gave birth to her second baby at 42. Her first pregnancy came at age 25. She discusses the differences and similarities in the age gap.

Stay up-to-date with the latest news - click here
LATEST NEWSDow Jones Futures Rise As Nvidia Gets Big Price-Target Hike; Tesla Stock Slides On Downgrade To Sell
Dow Jones Futures Rise As Nvidia Gets Big Price-Target Hike; Tesla Stock Slides On Downgrade To Sell
Stay up-to-date with the latest news - click here
LATEST NEWSTrueContext Announces Definitive Agreement to Be Acquired by Battery Ventures in An All-Cash Transaction
TrueContext Announces Definitive Agreement to Be Acquired by Battery Ventures in An All-Cash Transaction

OTTAWA, March 13, 2024 (GLOBE NEWSWIRE) — TrueContext Corporation (“TrueContext” or the “Company”) (TSXV:TCXT), a global leader in field intelligence, is pleased to announce that the Company and an entity (the “Buyer”) controlled by Battery Ventures (“Battery”) have entered into an arrangement agreement (the “Arrangement…

Stay up-to-date with the latest news - click here

Leave a Reply