Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

darthtrader

data mining in tradestation?

Recommended Posts

i've really been trying to get into learning easylanguage the past few weeks and had a post all typed up yesterday in the candlestick thread after seeing common candle patterns as reserved words in ez. The post was pretty unclear though so i deleted it. Surfing around then I found the data mining webinar on the tradestation site, which was basically i guess what i was going to ask if tradestation could do.

Has anyone ever done any type of data mining with tradestation? I was thinking something along the lines of mining for candle patterns around a setup.

I also think it would be interesting to mine for an optimal stop/profit target on a setup. I mean how do you know that a 22 or a 17 point stop is not actually better than a 20 point stop?

Anyone use this stuff or find that its a huge waste of time?

Also, anyone ever do anything with the probability maps in TS? Seems like that should be usefull somehow with market profile.

Share this post


Link to post
Share on other sites

Hi Darth,

 

Data mining is generally a waste of time. It is the same as curve fitting, and for most circumstances un-useable. The reason is that that market is dynamic and irrational, just like the human mind.

 

I have been around easy language for years, almost everything I have developed I have tossed. The reason most tools are not helpful is because nothing competes with the human eye.

 

If you are trading stocks it can be helpful to program in logic to call attention to certain conditions with easylanguage. My opinion is that easylanguage is useful to test very general ideas, but at all times runs the risk of distraction.

 

You can be sure that just about every worthwhile idea you could come up with is begin exploited - especially candles.

 

I think there are very few tools that you need - everything is really just an extraction of price and volume. Tools like market profile are a good way of organizing information, but the same information is available there to the naked eye.

 

The probability map seems to be garbage also.

 

I think I can speak for a large number of people who can look back and say they have spent way too much time programming, time that could better be used refining and practicing one approach.

 

hope that helps!

 

ws

Share this post


Link to post
Share on other sites

I'm torn on siding with or against ws' comments. It's true it takes alot of time to come up with something useful enough to even consider trading it real time. Even then, these are not suitable for daytrading (swing or higher). Having said that I've found a few systems through data mining but took me a 2 years drudging at it. So, if you have time and 2 years, then learning this side of trading is very valuable. These data mining finds have to be done with extreme care (ie. very skeptical) or it'll be your $$$ with a wrong assumptions or operating with full knowledge of the matter involved.

Share this post


Link to post
Share on other sites

Interesting responses to think about guys.

The time involved with this isn't an issue, i took alot of programming classes in college and i'm finding it so much fun to actually be able to program something that actually does something.

I soppose it is something I will not exactly concentrate on but just explore when i have extra time.

Figured the probability maps were useless just being i've never found anything that uses them, shame because they do look cool. :)

 

 

thanks guys.

Share this post


Link to post
Share on other sites

Hey Darth, have fun - enjoy! It's great to have a program present the market to you the way you want to see it. My only point was that you shouldn't expect to find the key to the markets through data mining.

I agree 100% with Torero, there are some valid methods to be found using the daily time frame. I manage a fund that I trade only on daily signals, the system I developed to trade the fund is 90% mechanical.

Also, as he mentioned, you have to be very critical of any results you may come up with. Testing them on virgin data, un-correlated markets, etc.

 

ws

Share this post


Link to post
Share on other sites

Looking back, my first mistake when I first got involved with program trading was I got so excited seeing all these $$$ after running a few tests I put it on real trading right away. Took a week to realize what I saw and what I thought I saw was completely unrealistic. Lesson learned: if it looks good and easy, double-check, triple-check and test it from all angles and read the forums on program trading as much as you can before taking it for a real spin. There are tons of traps imaginable and unimaginable.

Share this post


Link to post
Share on other sites

good stuff.

i guess in some sense though i'm less interested in finding a mechanical system and more so interesting in mining for information around a discretionary setup.

Thats where i thought the candle pattern stuff might be interesting, a full setup you would normally trade discretionary(without looking at candles) but then maybe mine to see if if there are any candle patterns that occured better than chance. Not that i would then make that mechanical but just something to look for. Or if volatility is X, mine to see what the average move was or the average loss was from the setup, more things like that.

 

did you guys use any kind of volatility measure in your systems? I've been trying to think what the best measure of volatility would be, implied volatility on the index options?

Share this post


Link to post
Share on other sites

I used a few things to measure volatility: price channels, ATR, Bollinger bands, and Keltner. They are useful in some ways but not in others.

 

About candlesticks, one thing I've done wrong with them was identifying setups based on a single or 2 candlesticks. These i found out led to alot of false signals. In mining, it's better to group the bars at least 5 or more and describe them in more details before the false signals are taken out. One or two bars cannot say much when 50-60 bars have already been voted, even if they are tops or bottoms.

Share this post


Link to post
Share on other sites

I can't help feeling that it could be useful. Knowing that the high/low of the day is put in during the first 15 minutes of trading 75% of the time (figures made up on the spot) should be exploitable. Knowing that price trades withing 5 ticks of yesterdays floor pivot 70% of the time likewise. Knowing that if price travels yy points above last weeks high that it is likely to go on and close (daily) above this value xx% of the time etc. etc. etc.

 

I guess what I am saying is things should be statisticaly significant (i.e. a good high number personally I'd like to see 70% or even 80%+). And that the 'thing' you are measuring should make some sense based on market structure. I guess you have to be pretty careful that you are uncovering some fundamental structure rather than curve fitting some random numbers of course.

 

I have only ever tried a data mining exercise once as the tools are a little unwieldy (I used Excel). If there where simple tools I might be inclined to try more.

 

Cheers.

Share this post


Link to post
Share on other sites

I am not saying you shouldn't look into it. I encourage it and find the answers for yourself. Just my limited observation on this area that steered me to other approaches.

Share this post


Link to post
Share on other sites

blowfish, thats absolutely the type of stuff i'm interested in. I would think it would be interesting for extra confirmation as opposed to trying to use things like that outright in and of itself.

 

you guys ever try trade ideas? I believe thats what Brett Steenbarger uses to do stuff kind of like this, i'm not sure how deep that gets though as far as on more microstructure type stuff.

http://www.trade-ideas.com/DOSA/

 

i would also think this type of stuff would work better if you had a decent measure of volatility and some rough measure if the market is trending or range bound. if you had something like that you could at least make sure your in the ball park for current conditions vs past conditions.

 

candlesticks were really just an example i threw out. i agree with looking at 5 bars or what have you. i soppose the problem there would be how fuzzy the patterns would be and would probly be quite hard to program anything usefull in that area.

Share this post


Link to post
Share on other sites

Thank you Blowfish.

I have recently started with Tradestation 2000i . Still confused about what indicators to use,what guidelines to follow.

 

Your suggestion of pivots is good and I begin to explore that.

 

As related to formulae, I found two things really interesting to me which I like to share with experienced people over here. I like to swing trade.

1. Jim berg formula

ref link

http://www.traders.com/Documentation/FEEDbk_docs/ Archive/022005/TradersTips/TradersTips.html

 

2.support-resistance formula

Support and resistance levels using RSI.

BY Graham Kavanagh May 2003 Ref Amibroker library

I dont have this written in easy language yet, trying still.

The concept is as I see

 

Go for the easiest AND simple formula there in, Wait for the mkt to come to support levels AND Buy, wait for the mkt to reach resistance level AND Sell

take your bucks.

The point I keep wondering is- do I chase the market? or do I wait till market comes to my choice levels of support and resistance?

 

I am a newbie and looking forward to seeing useful,dependable indicators and formule that can be applied in tradestation. My friends tell me go for JMA ,ASC trend etc.

Please advise ways to shorten learning curve in TS application-

advance thanks for your time

rvlv

Share this post


Link to post
Share on other sites

A couple of random thoughts.

 

Someone once told me that in the ES traded at the floor pivot about 70% of the time (within a tick or two on a within the day basis). I got 68% when I put the numbers in Excel. Now that same person also used the pivot as a crude directional indicator above the pivot bullish below bearish. Fair enough but this clearly is not behaviour that could be expected from the test. (We would need to measure something like where the close would be compared to the open compared to the pivot)

 

Seems to me that a strategy could be built to trade a return to the pivot based on the fact that 68% of the time you would get there.

 

Opening range break outs are a strategy that hopes to capitalise on a certain market behaviour (un-confirmed by me) and that is that the high or low is 'often' put in in the first xx minutes of trading.

 

Still no real thoughts on tools - Excel will do the job to a degree but it would be nice to have something simple and fairly non programmatic to use.

Share this post


Link to post
Share on other sites

Not sure if this thread is still active but in case someone wanders in. I have done quite a bit of data mining with easylanguage. Developing mechanical systems based on EOD data. From my experiences I found a few tendencies that can be turned into decent mechanical systems (that meet my own criteria anyway!). The key I found was keeping it as simple as possible. For example the best I found was not using any indicators and just looking at the HLOC relative to each other over 2 to 5 days (eg. Gaps). Other interesting tendencies come from volatility analysis (range expansion or contraction). IMO you need results that give you >50-60 occurrences per year and that work without too much variance for 10 years + or even 20 years (Gaps).

 

I also agree there are many traps but a little bit of research can overcome this (check the link below!).

 

There are some successul traders using this approach at http://www.thechartist.com.au/forum/ubbthreads.php and a wealth of info.

 

Cam

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Thx for reminding us... I don't bang that drum often enough anymore Another part for consideration is who that money initially went to...
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
    • How long does it take to receive HFM's withdrawal via Skrill? less than 24H?
    • My wife Robin just wanted some groceries.   Simple enough.   She parked the car for fifteen minutes, and returned to find a huge scratch on the side.   Someone keyed her car.   To be clear, this isn’t just any car.   It’s a Cybertruck—Elon Musk's stainless-steel spaceship on wheels. She bought it back in 2021, before Musk became everyone's favorite villain or savior.   Someone saw it parked in a grocery lot and felt compelled to carve their hatred directly into the metal.   That's what happens when you stand out.   Nobody keys a beige minivan.   When you're polarizing, you're impossible to ignore. But the irony is: the more attention something has, the harder it is to find the truth about it.   What’s Elon Musk really thinking? What are his plans? What will happen with DOGE? Is he deserving of all of this adoration and hate? Hard to say.   Ideas work the same way.   Take tariffs, for example.   Tariffs have become the Cybertrucks of economic policy. People either love them or hate them. Even if they don’t understand what they are and how they work. (Most don’t.)   That’s why, in my latest podcast (link below), I wanted to explore the “in-between” truth about tariffs.   And like Cybertrucks, I guess my thoughts on tariffs are polarizing.   Greg Gutfield mentioned me on Fox News. Harvard professors hate me now. (I wonder if they also key Cybertrucks?)   But before I show you what I think about tariffs… I have to mention something.   We’re Headed to Austin, Texas This weekend, my team and I are headed to Austin. By now, you should probably know why.   Yes, SXSW is happening. But my team and I are doing something I think is even better.   We’re putting on a FREE event on “Tech’s Turning Point.”   AI, quantum, biotech, crypto, and more—it’s all on the table.   Just now, we posted a special webpage with the agenda.   Click here to check it out and add it to your calendar.   The Truth About Tariffs People love to panic about tariffs causing inflation.   They wave around the ghost of the Smoot-Hawley Tariff from the Great Depression like it’s Exhibit A proving tariffs equal economic collapse.   But let me pop this myth:   Tariffs don’t cause inflation. And no, I'm not crazy (despite what angry professors from Harvard or Stanford might tweet at me).   Here's the deal.   Inflation isn’t when just a couple of things become pricier. It’s when your entire shopping basket—eggs, shirts, Netflix subscriptions, bananas, everything—starts costing more because your money’s worth less.   Inflation means your dollars aren’t stretching as far as they used to.   Take the 1800s.   For nearly a century, 97% of America’s revenue came from tariffs. Income tax? Didn’t exist. And guess what inflation was? Basically zero. Maybe 1% a year.   The economy was booming, and tariffs funded nearly everything. So, why do people suddenly think tariffs cause inflation today?   Tariffs are taxes on imports, yes, but prices are set by supply and demand—not tariffs.   Let me give you a simple example.   Imagine fancy potato chips from Canada cost $10, and a 20% tariff pushes that to $12. Everyone panics—prices rose! Inflation!   Nope.   If I only have $100 to spend and the price of my favorite chips goes up, I either stop buying chips or I buy, say, fewer newspapers.   If everyone stops buying newspapers because they’re overspending on chips, newspapers lower their prices or go out of business.   Overall spending stays the same, and inflation doesn’t budge.   Three quick scenarios:   We buy pricier chips, but fewer other things: Inflation unchanged. Manufacturers shift to the U.S. to avoid tariffs: Inflation unchanged (and more jobs here). We stop buying fancy chips: Prices drop again. Inflation? Still unchanged. The only thing that actually causes inflation is printing money.   Between 2020 and 2022 alone, 40% of all money ever created in history appeared overnight.   That’s why inflation shot up afterward—not because of tariffs.   Back to tariffs today.   Still No Inflation Unlike the infamous Smoot-Hawley blanket tariff (imagine Oprah handing out tariffs: "You get a tariff, and you get a tariff!"), today's tariffs are strategic.   Trump slapped tariffs on chips from Taiwan because we shouldn’t rely on a single foreign supplier for vital tech components—especially if that supplier might get invaded.   Now Taiwan Semiconductor is investing $100 billion in American manufacturing.   Strategic win, no inflation.   Then there’s Canada and Mexico—our friendly neighbors with weirdly huge tariffs on things like milk and butter (299% tariff on butter—really, Canada?).   Trump’s not blanketing everything with tariffs; he’s pressuring trade partners to lower theirs.   If they do, everybody wins. If they don’t, well, then we have a strategic trade chess game—but still no inflation.   In short, tariffs are about strategy, security, and fairness—not inflation.   Yes, blanket tariffs from the Great Depression era were dumb. Obviously. Today's targeted tariffs? Smart.   Listen to the whole podcast to hear why I think this.   And by the way, if you see a Cybertruck, don’t key it. Robin doesn’t care about your politics; she just likes her weird truck.   Maybe read a good book, relax, and leave cars alone.   (And yes, nobody keys Volkswagens, even though they were basically created by Hitler. Strange world we live in.) Source: https://altucherconfidential.com/posts/the-truth-about-tariffs-busting-the-inflation-myth    Profits from free accurate cryptos signals: https://www.predictmag.com/       
    • No, not if you are comparing apples to apples. What we call “poor” is obviously a pretty high bar but if you’re talking about like a total homeless shambling skexie in like San Fran then, no. The U.S.A. in not particularly kind to you. It is not an abuse so much as it is a sad relatively minor consequence of our optimism and industriousness.   What you consider rich changes with circumstances obviously. If you are genuinely poor in the U.S.A., you experience a quirky hodgepodge of unhelpful and/or abstract extreme lavishnesses while also being alienated from your social support network. It’s about the same as being a refugee. For a fraction of the ‘kindness’ available to you in non bio-available form, you could have simply stayed closer to your people and been MUCH better off.   It’s just a quirk of how we run the place and our values; we are more worried about interfering with people’s liberty and natural inclination to do for themselves than we are about no bums left behind. It is a slightly hurtful position and we know it; we are just scared to death of socialism cancer and we’re willing to put our money where our mouth is.   So, if you’re a bum; you got 5G, the ER will spend like $1,000,000 on you over a hangnail but then kick you out as soon as you’re “stabilized”, the logistics are surpremely efficient, you have total unchecked freedom of speech, real-estate, motels, and jobs are all natural healthy markets in perfect competition, you got compulsory three ‘R’’s, your military owns the sky, sea, space, night, information-space, and has the best hairdos, you can fill out paper and get all the stuff up to and including a Ph.D. Pretty much everything a very generous, eager, flawless go-getter with five minutes to spare would think you might need.   It’s worse. Our whole society is competitive and we do NOT value or make any kumbaya exception. The last kumbaya types we had werr the Shakers and they literally went extinct. Pueblo peoples are still around but they kind of don’t count since they were here before us. So basically, if you’re poor in the U.S.A., you are automatically a loser and a deadbeat too. You will be treated as such by anybody not specifically either paid to deal with you or shysters selling bejesus, Amway, and drugs. Plus, it ain’t safe out there. Not everybody uses muhfreedoms to lift their truck, people be thugging and bums are very vulnerable here. The history of a large mobile workforce means nobody has a village to go home to. Source: https://askdaddy.quora.com/Are-the-poor-people-in-the-United-States-the-richest-poor-people-in-the-world-6   Profits from free accurate cryptos signals: https://www.predictmag.com/ 
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.