darthtrader

Steenbarger made a good point in reference to #3. If you gave people a system that is guaranteed to make 40% a year, but it only trades 4 times a year and only holds each trade for a half hour, most people would tinker with the system and ruin it. Its not because people want to make the system more complex, its because trading is filling a "need" outside of making money and you wouldn't know what to do with your time waiting for the system to trade. While an extreme example its good to think about as far as keeping things in perspective and what the goal truely is. As far as keeping things simple, I think this idea gets confused with keeping things simplistic. You obviously want to cut the fat and use occam's razor when judging a trading idea but that doesn't mean that keeping things simplistic is the optimal way to view a trading strategy against something as complex as the markets.

I would suggest just jumping in and altering photos. If there is anyway you can downgrade back to photoshop 4 it might be easier too. IMO there really hasn't been anything to add to the program since then, all the new features after that are pretty niche. Tools to focus on are lasso/rectangle selector thing, understanding layers, eraser, color balance, levels...then more advanced..dodge/burn tool, layer blending options, using pathes to select/delete parts of an image. You can pretty much do anything to a photo with just those when you start combining them. Painting is a whole other story. I have no talent with drawing so I've never bothered. Like this stuff is just mind blowing http://youtube.com/watch?v=8K_NQe57C-k

ahh good stuff, FuturesTrader71 is the guy on elite. This thread "Market Depth patterns" is pretty interesting. He made a great point as far as recording the entire session with camtasia with the tape and DOM up and then going over it again after the market with the chart. From my experience with the tape is to just have patience, I still really get nothing from it after a year of trying but I haven't worked that hard with it. I wouldn't really waste much time with learning materials outside of screen time, that Hubert quote is probly spot on.

Dr Brett just did a great webinar I would highly recommend watching and absorbing the parts up until he starts talking about specific patterns. http://ioamt.com/media/videos/brett/brettapril24/brettapril24.html His advice is to start out by simply looking at tons of charts and learning to idenity a range. Then use the common tools(price/volume, candle sticks, whatever) to either trade breakouts from a range or to fade a reversion from the top/bottom of a range. If I had to start over again I would start from the beginning of his blog and read all 1500 posts in order, googling what you don't understand along the way. Then maybe half way through read Enhancing Trader Performance. http://traderfeed.blogspot.com/search?updated-min=2005-01-01T00%3A00%3A00-06%3A00&updated-max=2006-01-01T00%3A00%3A00-06%3A00&max-results=33 At some point spend 50 a month on a DTN iq feed and use Ninja Trader to paper trade SPY. Put on paper trades in 100 trade blocks of various techniques until you find one that works for you. Once you find one that seems to work put on another 500 paper trades to make sure it wasn't just luck. Keep detailed metrics/journal of each trade and figure out what went wrong or right. The biggest thing though I think is if you can't envision yourself trading for your main income in 5-10 years then your just wasting your time. You will get knocked down and if you don't have those kind of goals one of the knock downs will KO you.

very cool. I look forward to reading your future blog post on this subject too.

Just some general R resources before I lose them. RExcel is probly the way to go at this level. You can basically either use R within excel or read and write excel files directly in R. Should be able to get R doing real time market stuff with a data providers DDE link with this. http://sunsite.univie.ac.at/rcom/server/doc/RExcel.html Good R learning resource http://www.mayin.org/ajayshah/KB/R/index.html http://www.agr.kuleuven.ac.be/vakken/statisticsbyR/ good financial stuff in R http://www.burns-stat.com/ charts for R http://addictedtor.free.fr/graphiques/RGraphGallery.php?graph=65 financial engineering stuff http://www.rmetrics.org/

Well I have already given up on Rapidminer. While extremely interesting there simply is no way documentation wise that someone with no background in stats/data mining is going to be able to get up to speed with it. R is a different story having entire series of textbooks written on its use from introductory stats to extremely complex stuff. I've just ordered this textbook which sounded like a good way to get up to speed on the various mining algorithms Data Mining: Concepts and Techniques, 2nd ed http://www.amazon.com/Data-Mining-Second-Techniques-Management/dp/1558609016/ref=pd_sim_b_3 I'm still trying to figure out what R book to go with but this one sounds pretty nice, focusing on working code and available data sets to learn R with. http://www.amazon.com/Statistics-Introduction-Michael-J-Crawley/dp/0470022981/ref=pd_bbs_sr_1?ie=UTF8&s=books&qid=1209041520&sr=1-1

Well, this is easily the strangest book in my entire library. I had bought this book almost immediately when it came out. I tried to read a few chapters the first day I got it and it basically sat on the shelf since that day. My intial opinion was that it was complete and utter garbage having nothing at all to do with the title. Having recently started to get into data mining I ran across mention of it in a thread, opened up it tonight and completely ripped through half of it in awe. The problem with this book is the title really should be in quotes as the author is essentially proposing a new form of technical analysis based on data mining and statistical inference as opposed to showing what traditional chart patterns or what not have positive expectancy. A more honest title would be "data mining and statistical inference of financial data for dummies". As far as trading wisdom there really is none, if you embrace the concepts of this book it basically is setting out on a path of much learning and down a very different road from traditional TA. What I found quite interesting is that it brought together alot of things I found in this area from different sources in one book. Data mining traps and what to watch out for, the importance of judging your results against a random system....In all though it really is more of a philosophy book with a stats primer. If you trade purely discretionary this book will be utterly worthless. Even for alot of systems trading it may be totally worthless. If your open to the idea of setting off on a new course though of basically leveraging what the computer is good at and what your brain is good it this may be worth several times its weight in gold but an incredible amount of work lays ahead if you embrace the concept of "EBTA". I'm pretty much sold on the concept.

great rundown, the create custom series stuff sounds really amazing. In another thread i've mentioned i've been looking for a tick database solution but it really seems stupid to not go with this or open quant. I guess I'm really going to have to just take the plunge and buy this program. The biggest selling point to me is I've never once read about anyone who has taken the plunge and regretted it. Its always the same story like this... I know deep down part of my problem with it is that its not using .net's beautifull anti aliased charts like ninja but even there I would imagine there could be a work around. Not to mention thats an extremely irrational reason to not use something. thanks a bunch

I might have to just buy Neoticker at some point. I've read its pretty hard to top as far as its database goes. Still the only issue is see with that is running into something where you want to change software down the road and have this massive database of tick data that can't be converted and would cost far too much to buy. In the meantime I'm just going with flat csv files and will progress as needed. From what i've read about sql is that its just overkill on the overhead and not really ment for time series data. This DB was mentioned on elite, its for storing massive amounts of scientific data and might be interesting, free and open source. http://www.hdfgroup.org/products/index.html

Here is possibly an even better piece of software. http://rattle.togaware.com/ Its basically a java GUI built on top of R. Sounds like it makes it easy to explore various mining algorithms but then also spits out R code to learn from once you want to progress beyond whats already been built.

From the thread that brownsfan and I posted in about Steenbarger and his volume/days range stuff until now I've stumbled across some AMAZING stuff in this area. To program alot of this stuff in stock software is to reinvent the wheel. This interesting thread came up on Elite that mentions Rapidminer. http://elitetrader.com/vb/showthread.php?s=&threadid=117361 In trying to find information about it I finally installed and actually loaded some YM data into the heavy weight open source statistical computing environment, R. Its amazing how simple it makes tasks that are far beyond most stock software analysis wise. Here is an entire course on data mining with R http://www.stats202.com/ The videos for the class are all up on google video if you search for data mining + long format. This is an entire free book on data mining with R, 2 different hands on projects and one is a forecast for IBM stock prices using nets. http://www.liaad.up.pt/~ltorgo/DataMiningWithR/ this has a 5 part video tutorial on using Rapidminer: http://www.neuralmarkettrends.com/tutorials/ Jerry in that elite thread had a project idea for rapidminer and I had just sent him a message inviting him to bring it to TL. The premium section here would be quite an ideal place for such results. is anyone else interested in this stuff? While I'm not interested in "prediction" it just seems like a huge waste of time to not use these tools to find relationships that would take years of experience to uncover(if ever).

hey brownsfan, I think the ultimate for this stuff would be able to do it on a basket of actual stocks. That might be a little harder on S&P but for using it against on YM that really shouldn't be much of an issue. I wouldn't doubt alot of what would mess things up with SPY is how much volume is arbitrage against the underlieing. today he has a cool post too that would make an interesting indicator. http://traderfeed.blogspot.com/2008/04/volume-in-stock-index-futures-market_17.html Plot the volume and range on a 15 minute chart, then take some kind of moving window to get an average 15 minute volume to guage if we are above or below "normal" volume.

I think if I had to pick one thing information wise to take to a desert Island I would just take his blog. His website also has alot of good stuff, just older. http://www.brettsteenbarger.com/articles.htm tons of good stuff in his weblog there too as text files. http://www.brettsteenbarger.com/weblog.htm

I think this is where you really want to learn some basic VBA if you really want to work with excel like this. I've been contemplating this but just haven't got around to learning it. For a straight out spreadsheet it shouldn't be too bad though, just alot of columns. Subtract A2 from A1 to get the 15 minute change in price. Once you have those make the columns for all the correlations and use the CORREL function , ie =CORREL(A1:A27, B1:B27). Once you have those make one more column, add the six correlation values across and divide by 6.