Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

Dinerotrader

Extensive Historical Data

Recommended Posts

Okay. I have been looking into getting historical data in varying amounts but now I am thinking, "doesn't someone just offer all available historical data for each given future?" I just want all the data down to the tick level for a few different futures.

 

I trade oil a lot and say I want to go back to see how price reacted to weekly inventory numbers each week for the past 2 years. I don't want a day, hour, or a 5 minute chart. I want to be able to look at what price did sometimes at the tick level.

 

So my question is who offers this and how much should it cost? I guess it is just a bunch of data with a price and then from there you can just use any ol' charting software to show you charts of whatever time frame you want in whatever scale you want.

 

I get ideas for different trading strategies all the time that I simply cannot even start to evaluate because I don't have nearly enough data.

 

Also, is there a good way to start saving the data I do receive (I use OEC) so that I can keep tick level data even when OEC stops making it available on their service?

Share this post


Link to post
Share on other sites

usually the respective exchange offers the data for sale.

 

A friend recently bought 20 yrs of ag future data,

it set him back $900.

 

(I don't know how many symbols or exact # of contract months)

Share this post


Link to post
Share on other sites
usually the respective exchange offers the data for sale.

 

A friend recently bought 20 yrs of ag future data,

it set him back $900.

 

(I don't know how many symbols or exact # of contract months)

 

So I just call them up and say, "hey there, I am looking for a boat load of oil data, who do I need to haggle with to get a good price on 5 to 10 years of CL data?" or something to that effect.

 

Maybe I just need to find out if some other trader already bought this data and is willing to sell it to me. Thanks for the ideas.

 

Is there a specific charting service that is cheap that I can plug a bunch of expensive data into it and do my analysis?

 

attachment.php?attachmentid=16671&stc=1&d=1261005145

5aa70f845d016_12-16-20095.png.59b58fe23a9dbb4b736486fb27adf785.png

Edited by Dinerotrader

Share this post


Link to post
Share on other sites
So I just call them up and say, "hey there, I am looking for a boat load of oil data, who do I need to haggle with to get a good price on 5 to 10 years of CL data?" or something to that effect.

...

 

 

.........check their website under Market Data Service

data is intellectual property...selling data is a business

 

http://www.cmegroup.com/market-data/licensed-quote-vendors/index.html

 

 

you are not the first one, nor the last one, to look for historical data.

Edited by Tams

Share this post


Link to post
Share on other sites

Quite awhile ago I purchased some data and it wasn't that costly. For the life of me I can't recall the name of the site or company but somewhere (buried deeply) on TL is the link. I'll see if I can find it somewhere around here.

Share this post


Link to post
Share on other sites
Quite awhile ago I purchased some data and it wasn't that costly. For the life of me I can't recall the name of the site or company but somewhere (buried deeply) on TL is the link. I'll see if I can find it somewhere around here.

 

I figured someone would have already gone through this process and evaluated what is the easiest cheapest path.

 

CQP.com looks like the main google search result so far.

 

I need the CL globex, correct (noted below)?

 

attachment.php?attachmentid=16679&stc=1&d=1261018907

5aa70f848bf59_SNAG-12-16-200901.png.cb520b9280d9129f7475c57e8adc502e.png

Share this post


Link to post
Share on other sites

Dinero - another option would be to use TradeStation for this kind of stuff. I was on their site and here's what data is available: http://www.tradestation.com/strategy_testing/hist_market_data.shtm

 

Over 27 Years of Intraday Futures Data

TradeStation also provides the historical data you need to thoroughly test your futures trading strategies. You'll have access to 6 months of tick-by-tick data, plus over 27 years of intraday (minute and above) data for both continuous and individual contracts for the real-time exchanges you have chosen to receive. Click here for a list of available intraday data. Additionally, you'll have up to 48 years of daily data.

 

Custom Continuous Futures Contracts

 

You can now customize the rules that determine when and how your continuous futures contracts roll from one month to the next. This includes the ability to choose the specific months to include in the continuous contract, the data series on which to base the continuous data, the rollover trigger event, and the back adjustment method. You also have the option to "use this symbol for trading", which means that you will be able to automate a strategy that is applied to a chart with this symbol.

 

To create a custom continuous contract from a Chart Analysis or RadarScreen window simply open the Symbol Lookup dialog and click on the "Custom Futures" tab and specify the settings that you would like to use. Once you click on the OK button the platform will automatically create a custom continuous contract symbol based on the settings that you specified.

 

Tick data is very intensive, so I'm not surprised they only offer 6 months of it. You do get a ton of minute data (27 years). Perhaps you could just drill it down to a 1 minute chart and get the same effect you are after. If nothing else, you could see the price action.

 

It's times like this when having TradeStation is very nice. I would not use them as my primary broker by any stretch, but you can get the platform for free if you do 10 round turns per month. Depending on how much trading you are doing, that could literally be knocked out in 1 day. There will be data fees though, regardless of how many trades are being done.

 

So if you used TS and traded 10 round turns, you'd be looking at just data fees. Which isn't terrible if this is what you need/want for your trading. And there's nothing saying you have to stay w/ them forever. You might stay a month or two, get what you need and then close the account.

Share this post


Link to post
Share on other sites

Another option is to collect the data yourself and/or use a downloader. Years ago I used QCollector for that purpose with mixed results. It did permit you to download a lot of tick data unattended. Beware though, the data from your charting platform provider is not always what you would expect.

 

I've heard good things about Tickdata. Never used them and I think it is on the expensive side (which is probably relative).

 

If you choose tickdata.com, they offer something (that used to be) called "pick 15" and "pick 30". You get to pick 15 or 30 years of tick data in any combination of symbols/years, which is a less expensive entry point. Still pricey though.

 

I have used them for several years and never had any problems. Service and support is ok. They used to deliver tick data once a month (if you have a subscription), now you get it every day after market close.

 

There are cheaper (and more expensive options) out there. It all comes down to how important quality is to you, and what timeframe you are testing on. As always you get what you pay for. And to have any use of high quality data you probably need a platform that can use it in an efficient manner.

 

Best wishes

TB

Edited by TrueBalance

Share this post


Link to post
Share on other sites
I'm going to buy data from these guys:

 

FOREX Historical Data, Major Indices and Futures Historical Intraday and Daily Market Data - Through Download and on DVDs/CDs.

 

Will post what I think of it.

 

Would be good if anyone has any random months of tick data for quality comparison.

 

If you are looking for FX data you can find it for free at Oanda/FXTrade. The data is bid/ask, going back to Jan 1, 2004 and is what was actually used for trading. You need an FXTrade account with some minimum balance to be able to get it. They offer five pairs (and of course you can create synthetic pairs from the ones supplied).

 

To get some ideas on what constitutes quality data, check out High Frequency Data Filtering from tickdata.com. It is worth reading even though it was written by a vendor.

Edited by TrueBalance

Share this post


Link to post
Share on other sites

For the longest time I got all the info I wanted for free from finam. I downloaded years of back data in multiple time frames, right down to the minute time frame for data concerning all the emini futures products, no delay as well, real time. It was some Russian source I stumbled across, but I just today noticed they are asking for a subscription. I guess the free ride is over with them. If you're not too picky get the free stuff from CRB, it gives you about 6 months of free info which you can build upon. Pretty good source, as Tick Data provides for them Also give TimingCharts.com a try, not bad. Nowadays I just use Esignal at $25.00 per month plus an extra $10.00 for intraday back to Mar 2007. Anybody found any better?

Share this post


Link to post
Share on other sites

Hi dinotrader,

 

I'm curious to know what you are going to do with all that past data and how it's going to help you:roll eyes:. Oil is not something thats' heavily weighted like the S&P or NASDAQ. Maybe I'm wrong and I'll except the fact that it's possible. I just can't think of one reason why 27 years worth of news related data will help you trade todays markets. It's really not that serious. JMO

 

Happy Trading

 

Ektrader

Share this post


Link to post
Share on other sites
Hi dinerotrader,

 

I'm curious to know what you are going to do with all that past data and how it's going to help you:roll eyes:. Oil is not something thats' heavily weighted like the S&P or NASDAQ. Maybe I'm wrong and I'll except the fact that it's possible. I just can't think of one reason why 27 years worth of news related data will help you trade todays markets. It's really not that serious. JMO

 

Happy Trading

 

Ektrader

 

I wouldn't be looking for 27 years. More like 5-10 years. I have a fundamental belief that markets do some similar things over time and that you can learn from the past in order to determine what future movements have higher probabilities. I don't have the ability to trade using history but I would like to test some ideas that I have. For example, I would like to look at how oil prices reacted to the weekly oil inventory report going back over the past couple years. To do this I would need tick data since the moves are so fast when inventory comes out.

Share this post


Link to post
Share on other sites
I wouldn't be looking for 27 years. More like 5-10 years. I have a fundamental belief that markets do some similar things over time and that you can learn from the past in order to determine what future movements have higher probabilities. I don't have the ability to trade using history but I would like to test some ideas that I have. For example, I would like to look at how oil prices reacted to the weekly oil inventory report going back over the past couple years. To do this I would need tick data since the moves are so fast when inventory comes out.

 

I understand your rationale. Thing is, the markets, the economy, and volume levels have changed. Whos' to say that the same speculators and operators from 10 years ago still have interest in oil. Could be a whole new set of players. Anyway, not to discourage you. If that's what you want to do. Good luck with your analysis and your trading.

 

Happy Trading

 

Ektrader

Share this post


Link to post
Share on other sites

If you buy data from anyone, ensure that they have gone through and made sure the data is clean. There is a lot of stuff that is full of repeated days, gaps, etc;

the good stuff is not cheap. Make sure the data you receive is able to be changed because I guarantee there will be modifications needed.

eg; when is the close. As the exchange says, or the last recorded trade.

eg; when to the futures contract roll over months, to which month.

There will be big gaps.

 

I would suggest that if you want to look at announcements etc then tick data is overkill, its just noise. a 5 min chart would be plenty....but thats up to you.

Share this post


Link to post
Share on other sites
If you buy data from anyone, ensure that they have gone through and made sure the data is clean. There is a lot of stuff that is full of repeated days, gaps, etc;

the good stuff is not cheap. Make sure the data you receive is able to be changed because I guarantee there will be modifications needed.

eg; when is the close. As the exchange says, or the last recorded trade.

eg; when to the futures contract roll over months, to which month.

There will be big gaps.

 

I would suggest that if you want to look at announcements etc then tick data is overkill, its just noise. a 5 min chart would be plenty....but thats up to you.

 

Watch oil next time inventory comes out on Wednesday at 10:30 am ET and see how well a 5 min charts works for you.:)

Share this post


Link to post
Share on other sites

Hi Dinerotrade

i've just bought 2 years of data(tick) from HISTORICAL TICK DATA ? Historical tick data for stocks, equities, futures, options, indexes and indicators!

ES and XX , i'm satisfied about the data quality , i've checked with another data and it's all ok .

i sent email, several time,to the support center and always they replied quickly.

 

Tick Data - Available Futures Data

Share this post


Link to post
Share on other sites
Hi Dinerotrade

i've just bought 2 years of data(tick) from HISTORICAL TICK DATA ? Historical tick data for stocks, equities, futures, options, indexes and indicators!

ES and XX , i'm satisfied about the data quality , i've checked with another data and it's all ok .

i sent email, several time,to the support center and always they replied quickly.

 

Tick Data - Available Futures Data

 

Thanks for the post. Nice to here from a happy customer before I go spend some money.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • How long does it take to receive HFM's withdrawal via Skrill? less than 24H?
    • My wife Robin just wanted some groceries.   Simple enough.   She parked the car for fifteen minutes, and returned to find a huge scratch on the side.   Someone keyed her car.   To be clear, this isn’t just any car.   It’s a Cybertruck—Elon Musk's stainless-steel spaceship on wheels. She bought it back in 2021, before Musk became everyone's favorite villain or savior.   Someone saw it parked in a grocery lot and felt compelled to carve their hatred directly into the metal.   That's what happens when you stand out.   Nobody keys a beige minivan.   When you're polarizing, you're impossible to ignore. But the irony is: the more attention something has, the harder it is to find the truth about it.   What’s Elon Musk really thinking? What are his plans? What will happen with DOGE? Is he deserving of all of this adoration and hate? Hard to say.   Ideas work the same way.   Take tariffs, for example.   Tariffs have become the Cybertrucks of economic policy. People either love them or hate them. Even if they don’t understand what they are and how they work. (Most don’t.)   That’s why, in my latest podcast (link below), I wanted to explore the “in-between” truth about tariffs.   And like Cybertrucks, I guess my thoughts on tariffs are polarizing.   Greg Gutfield mentioned me on Fox News. Harvard professors hate me now. (I wonder if they also key Cybertrucks?)   But before I show you what I think about tariffs… I have to mention something.   We’re Headed to Austin, Texas This weekend, my team and I are headed to Austin. By now, you should probably know why.   Yes, SXSW is happening. But my team and I are doing something I think is even better.   We’re putting on a FREE event on “Tech’s Turning Point.”   AI, quantum, biotech, crypto, and more—it’s all on the table.   Just now, we posted a special webpage with the agenda.   Click here to check it out and add it to your calendar.   The Truth About Tariffs People love to panic about tariffs causing inflation.   They wave around the ghost of the Smoot-Hawley Tariff from the Great Depression like it’s Exhibit A proving tariffs equal economic collapse.   But let me pop this myth:   Tariffs don’t cause inflation. And no, I'm not crazy (despite what angry professors from Harvard or Stanford might tweet at me).   Here's the deal.   Inflation isn’t when just a couple of things become pricier. It’s when your entire shopping basket—eggs, shirts, Netflix subscriptions, bananas, everything—starts costing more because your money’s worth less.   Inflation means your dollars aren’t stretching as far as they used to.   Take the 1800s.   For nearly a century, 97% of America’s revenue came from tariffs. Income tax? Didn’t exist. And guess what inflation was? Basically zero. Maybe 1% a year.   The economy was booming, and tariffs funded nearly everything. So, why do people suddenly think tariffs cause inflation today?   Tariffs are taxes on imports, yes, but prices are set by supply and demand—not tariffs.   Let me give you a simple example.   Imagine fancy potato chips from Canada cost $10, and a 20% tariff pushes that to $12. Everyone panics—prices rose! Inflation!   Nope.   If I only have $100 to spend and the price of my favorite chips goes up, I either stop buying chips or I buy, say, fewer newspapers.   If everyone stops buying newspapers because they’re overspending on chips, newspapers lower their prices or go out of business.   Overall spending stays the same, and inflation doesn’t budge.   Three quick scenarios:   We buy pricier chips, but fewer other things: Inflation unchanged. Manufacturers shift to the U.S. to avoid tariffs: Inflation unchanged (and more jobs here). We stop buying fancy chips: Prices drop again. Inflation? Still unchanged. The only thing that actually causes inflation is printing money.   Between 2020 and 2022 alone, 40% of all money ever created in history appeared overnight.   That’s why inflation shot up afterward—not because of tariffs.   Back to tariffs today.   Still No Inflation Unlike the infamous Smoot-Hawley blanket tariff (imagine Oprah handing out tariffs: "You get a tariff, and you get a tariff!"), today's tariffs are strategic.   Trump slapped tariffs on chips from Taiwan because we shouldn’t rely on a single foreign supplier for vital tech components—especially if that supplier might get invaded.   Now Taiwan Semiconductor is investing $100 billion in American manufacturing.   Strategic win, no inflation.   Then there’s Canada and Mexico—our friendly neighbors with weirdly huge tariffs on things like milk and butter (299% tariff on butter—really, Canada?).   Trump’s not blanketing everything with tariffs; he’s pressuring trade partners to lower theirs.   If they do, everybody wins. If they don’t, well, then we have a strategic trade chess game—but still no inflation.   In short, tariffs are about strategy, security, and fairness—not inflation.   Yes, blanket tariffs from the Great Depression era were dumb. Obviously. Today's targeted tariffs? Smart.   Listen to the whole podcast to hear why I think this.   And by the way, if you see a Cybertruck, don’t key it. Robin doesn’t care about your politics; she just likes her weird truck.   Maybe read a good book, relax, and leave cars alone.   (And yes, nobody keys Volkswagens, even though they were basically created by Hitler. Strange world we live in.) Source: https://altucherconfidential.com/posts/the-truth-about-tariffs-busting-the-inflation-myth    Profits from free accurate cryptos signals: https://www.predictmag.com/       
    • No, not if you are comparing apples to apples. What we call “poor” is obviously a pretty high bar but if you’re talking about like a total homeless shambling skexie in like San Fran then, no. The U.S.A. in not particularly kind to you. It is not an abuse so much as it is a sad relatively minor consequence of our optimism and industriousness.   What you consider rich changes with circumstances obviously. If you are genuinely poor in the U.S.A., you experience a quirky hodgepodge of unhelpful and/or abstract extreme lavishnesses while also being alienated from your social support network. It’s about the same as being a refugee. For a fraction of the ‘kindness’ available to you in non bio-available form, you could have simply stayed closer to your people and been MUCH better off.   It’s just a quirk of how we run the place and our values; we are more worried about interfering with people’s liberty and natural inclination to do for themselves than we are about no bums left behind. It is a slightly hurtful position and we know it; we are just scared to death of socialism cancer and we’re willing to put our money where our mouth is.   So, if you’re a bum; you got 5G, the ER will spend like $1,000,000 on you over a hangnail but then kick you out as soon as you’re “stabilized”, the logistics are surpremely efficient, you have total unchecked freedom of speech, real-estate, motels, and jobs are all natural healthy markets in perfect competition, you got compulsory three ‘R’’s, your military owns the sky, sea, space, night, information-space, and has the best hairdos, you can fill out paper and get all the stuff up to and including a Ph.D. Pretty much everything a very generous, eager, flawless go-getter with five minutes to spare would think you might need.   It’s worse. Our whole society is competitive and we do NOT value or make any kumbaya exception. The last kumbaya types we had werr the Shakers and they literally went extinct. Pueblo peoples are still around but they kind of don’t count since they were here before us. So basically, if you’re poor in the U.S.A., you are automatically a loser and a deadbeat too. You will be treated as such by anybody not specifically either paid to deal with you or shysters selling bejesus, Amway, and drugs. Plus, it ain’t safe out there. Not everybody uses muhfreedoms to lift their truck, people be thugging and bums are very vulnerable here. The history of a large mobile workforce means nobody has a village to go home to. Source: https://askdaddy.quora.com/Are-the-poor-people-in-the-United-States-the-richest-poor-people-in-the-world-6   Profits from free accurate cryptos signals: https://www.predictmag.com/ 
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.