Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

BlueHorseshoe

The Non-Optimisation Myth

Recommended Posts

Everything you do can be considered optimization one way or the other. The important question is whether the optimization process results in different system dynamics when it varies the parameters. Different dynamics can be assessed by different trade distributions. In that case the system is data-mining and it is subject to data-mining bias, i.e. the uncovering of spurious hypotheses. So this should be a criterion. If this criterion holds then you should take the final system and see if it performs well in several unrelated markets. If it does not, you have wasted you time and possibly money. The following posts in price action blog provide some good initial background but I think one must go even further than that:

 

Curve-fitting and Optimization | Price Action Lab Blog

 

Fooled by Randomness Through Selection Bias | Price Action Lab Blog

Share this post


Link to post
Share on other sites

I second your recommendation to study what Michal Harris of Price Action Lab's has disclosed. Everyone (serious) like all of you posting to this thread, should understand the advantages and disadvantes of artificial intelligence. Some of you should specialize in it and take it beyond where it is, to something that can benefit us as a species.

 

Everything you do can be considered optimization one way or the other. The important question is whether the optimization process results in different system dynamics when it varies the parameters. Different dynamics can be assessed by different trade distributions. In that case the system is data-mining and it is subject to data-mining bias, i.e. the uncovering of spurious hypotheses. So this should be a criterion. If this criterion holds then you should take the final system and see if it performs well in several unrelated markets. If it does not, you have wasted you time and possibly money. The following posts in price action blog provide some good initial background but I think one must go even further than that:

 

Curve-fitting and Optimization | Price Action Lab Blog

 

Fooled by Randomness Through Selection Bias | Price Action Lab Blog

Share this post


Link to post
Share on other sites

I had read the Price action Blog previously and it is definitely highly recommended.

One of his conclusions sums it up nicely for the Q of this thread.....

 

"As a conclusion we can state that the issue is not whether a system is optimized, because all systems are in one way or another, but to what degree optimization impacts the probability that the system will fail in the future due to its nature."

Share this post


Link to post
Share on other sites

For my own 'optimizationing' of the types of systems being discussed in this thread , I would amend

"As a conclusion we can state that the issue is not whether a system is optimized, because all systems are in one way or another, but to what degree optimization impacts the probability that the system will fail in the future due to its nature."

 

to

 

"As a conclusion ...the issue is not whether a system is optimized, because all systems are in one way or another, but to what degree optimization impacts the probability that the system will degrade in the future due to its nature."

 

ie...to "failure" is too kiss... if the parameters are optimizable for a system, get busy on them to the left or the right as soon as it degrades

Share this post


Link to post
Share on other sites
For my own 'optimizationing' of the types of systems being discussed in this thread , I would amend

"As a conclusion we can state that the issue is not whether a system is optimized, because all systems are in one way or another, but to what degree optimization impacts the probability that the system will fail in the future due to its nature."

 

to

 

"As a conclusion ...the issue is not whether a system is optimized, because all systems are in one way or another, but to what degree optimization impacts the probability that the system will degrade in the future due to its nature."

 

ie...to "failure" is too kiss... if the parameters are optimizable for a system, get busy on them to the left or the right as soon as it degrades

 

Good suggestion. It is important to always be alert to prevent failure by constantly analyzing and upgrading systems. It is a horrible mistake to assume that a system should not be changed after it is deployed.

 

This is another good one by Harris where he argues that certain types of exits, like trailing stops, may produce curve-fitted systems:

 

Trailing Stops and Curve-Fitting in Trading System Development | Price Action Lab Blog

Share this post


Link to post
Share on other sites

thx Equtrader...

 

One reason that I do not use this type of stop when developing trading systems and in algorithms I have developed for machine design of trading systems is that it renders the entry signals irrelevant in most cases. However, the robustness of the entry signals and their predictive ability under the majority of possible market conditions is what secures longer-term positive performance for trading system. Trailing stops can be used during actual trading to enhance profits and cut losses. One way to check whether signals generated by a trading system have predictive ability is to set a small percent or dollar stop. If the profit factor when the stops are set like that is not sufficiently high, you are probably dealing with a random entry generator.

The risk of curve-fitting is also high when using indicators to exit signals although entry signals may not be rendered irrelevant. But this is an even more interesting and complex case that will be the subject of another post.

from the closing of the article you cited

 

Haven’t posted these particular yada yadas in a while so…

>It is ALWAYS a “3 body problem” (anecdotally borrowing the phrase to illustrate the integral interplay, not same as it’s used in real physics, btw) ---

entry, exit, stop – never isolated

"optimized" close to, but not at, optimal - all at once…

 

>In system and automation design, any tweak is actually not a tweak, it is a whole distinct new system

 

If he persists, I predict before he’s done he will

1) retract that across the board “the robustness of the entry signals and their predictive ability under the majority of possible market conditions is what secures longer-term positive performance for trading system”

You can make such generalities about certain types of systems, but you can’t make such generalities about all systems… ie that is a good generality for systems exploiting limit cycles / oscillations of markets. It is not a good generality for systems exploiting ‘trend’ where “entry signals [can be rendered more] irrelevant” and

2) he will also conclude that “using indicators to exit” really isn’t an “even more and complex case” ...

 

Not a criticism at all… I periodically check in with this blog, learn a lot, and admire his development

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • AMZN Amazon stock, nice buying at the 187.26 triple+ support area at https://stockconsultant.com/?AMZN
    • DELL Dell Technologies stock, good day moving higher off the 90.99 double support area, from Stocks to Watch at https://stockconsultant.com/?DELL
    • MCK Mckesson stock, nice trend and continuation breakout at https://stockconsultant.com/?MCK
    • lmfx just officially launched their own LMGX token, Im planning to grab a couple of hundred and maybe have the option to stake them. 
    • Date: 2nd April 2025.   Market on Edge: Tariff Announcement and Volatility Ahead!   The US economic and employment data continues to deteriorate with the job vacancies figures dropping to a 5-month low. In addition to this, the IMS Manufacturing PMI also fell below expectations. However, both the US Dollar and Gold declined simultaneously following the release of the two figures, an uncommon occurrence in the market. Traders expect a key factor to be today’s ‘liberation day’ where the US will impose tariffs on imports. USDJPY - Traders Await Tariff Confirmation! Traders looking to determine how the USDJPY will look today will find it difficult to determine until the US confirms its tariff plan. Today is the day when Trump previously stated he would finalize and announce his tariff plan. The administration has not yet released the policy, but investors expect it to be the most expansionary in a century. President Trump is due to speak at 20:00 GMT. On HFM's Calendar the speech is stated as "US Liberation Day Tariff Announcement". Currently, analysts are expecting Trump’s Tariff Plan to impose tariffs on the EU, chips and pharmaceuticals later today as well as reciprocal tariffs. Economists have a good idea of how these tariffs may take effect, but reciprocal tariffs are still unspecified. In addition to this, 25% tariffs on the car industry will start tomorrow. The tariffs on the foreign cars industry are a factor which will particularly impact Japan. Although, traders should note that this is what is expected and is not yet finalised. Last week, President Trump stated that he would implement retaliatory tariffs but allow exemptions for certain US trade partners. Treasury Secretary Mr Bessent and National Economic Council Director Mr Hassett suggested that the restrictions would primarily target 15 countries responsible for the bulk of the US trade deficit. However, yesterday, Trump contradicted these statements, asserting that additional duties would be imposed on any country that has implemented similar measures against US products. The day’s volatility will depend on which route the US administration takes. The harshness of the policy will influence both the Japanese Yen as well as the US Dollar.   USDJPY 5-Minute Chart   US Economic and Employment Data The JOLT Job Vacancies figure fell below expectations and is lower than the previous month’s figure. The JOLT Job Vacancies read 7.57 million whereas the average of the past 6 months is 7.78 million. The ISM Manufacturing Index also fell below the key level of 50.00 and was 5 points lower than what analysts were expecting. The data is negative for the US Dollar, particularly as the latest release applies more pressure on the Federal Reserve to cut interest rates. However, this is unlikely to happen if the trade policy ignites higher and stickier inflation. In the Bank of Japan’s Governor's latest speech, Mr Ueda said that the tariffs are likely to trigger higher inflation. USDJPY Technical Analysis Currently, the Japanese Yen Index is the worst performing of the day while the US Dollar Index is more or less unchanged. However, this is something traders will continue to monitor as the EU session starts. In the 2-hour timeframe, the USDJPY is trading at the neutral level below the 75-bar EMA and 100-bar SMA. The RSI and MACD is also at the neutral level meaning traders should be open to price movements in either direction. On the smaller timeframes, such as the 5-minute timeframe, there is a slight bias towards a bullish outcome. However, this is only likely if the latest bearish swing does not drop below the 200-Bar SMA.     The key resistant level can be seen at 150.262 and the support level at 149.115. Breakout levels are at 149.988 and 149.674. Key Takeaway Points: Job vacancies hit a five-month low, and the ISM Manufacturing PMI missed expectations, adding pressure on the Federal Reserve regarding interest rate decisions. Traders await confirmation on Trump’s tariff policy, which is expected to impact the EU, chips, pharmaceuticals, and foreign car industries. The severity of the tariffs will influence both the JPY and the USD, with traders waiting for final policy details. The Japanese Yen Index is the worst index of the day while the US Dollar Index is unchanged. Always trade with strict risk management. Your capital is the single most important aspect of your trading business.   Please note that times displayed based on local time zone and are from time of writing this report.   Click HERE to access the full HFM Economic calendar.   Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding of how markets work. Click HERE to register for FREE!   Click HERE to READ more Market news.   Michalis Efthymiou HFMarkets   Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in Leveraged Products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.