Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

JKLM

IB Tick Data ... is It Worth Anything ?

Recommended Posts

IB does not send tick data. The data it sends are 0.2 - 0.3 second snapshots. So they aggregate ticks in 0.2 - 0.3 second intervals and this is the greatest detail you can get.

Share this post


Link to post
Share on other sites

OK

I understand that it may delayed 0.2-0.3 second ..but when I get new refresh do I get info what was happening between two refresh ( trader volume and ticks )

Share this post


Link to post
Share on other sites
  JKLM said:
OK

I understand that it may delayed 0.2-0.3 second ..but when I get new refresh do I get info what was happening between two refresh ( trader volume and ticks )

No. Sorry for not being clear enough. Actually you dont get tick data in 0.2-0.3 second snapshots, but you get 0.2-0.3 second bars (or candles or whatever).

Share this post


Link to post
Share on other sites

No. You actually get the last price and accurate or probable volume for that 0.2 seconds - there may be other prices during that period but they are not represented.

 

Thats why IB did the 5-second bars ... which do contain an accurate count of volume + a bar representing OHLC for the 5 seconds. But never a tick count that matches other tick counts.

 

Its not that its complete crap - just that if ticks happen more frequently that 0.1-0.2 seconds then the missing count is missing. It can still be very useful - its just not a count of all ticks.

Share this post


Link to post
Share on other sites

Your options are

 

1) use IB's .2 seconds snapshots you will find a size that has the same look and feel as the tick size that you are used too.

 

2) Use constant volume, time or range charts (different look and feel). Constant volume is likely to be closest to what you are used to and some would argue better for some purposes.

 

3) Use another data provider (Zen Fire, Esignal, DTNIQ) spring to mind.

 

 

Be aware that some exchanges will aggregate ticks certain circumstances. I'm pretty sure (from memory) Globex is one so essentially its impossible to get absolutely full tick data for instruments trading there.

Share this post


Link to post
Share on other sites

Of the three mentioned above I would first go with DTN IQ data without opening another broker service. They just supply data for you and are usually pretty solid. Not sure about Zen or how they work. I would not recomend esignal anymore as I have had a lot of trouble with them in the past.

Share this post


Link to post
Share on other sites

Esignal is a headache. The data is never reliable and bad tick is a common occurrence. Clean data in my opinion is a must in trading. Ive used DTN in the past but never had a problem with them. Though I think this industry needs more data vendors.

Share this post


Link to post
Share on other sites

The question of reliability is an interesting one though blowfish.

 

I use IB tick data to generate tick charts. I have for the last few years.

 

I know that backfill won't give it (because backfill is limited to 5 seconds per bar or 30 seconds per bar or whatever best granularity your chart package requests from IB).

 

But in real time my tick charts spread out fast action so that action I wouldn't see on a minute chart after a breakout becomes clear and tradable. So for me, the tick chart is reliable (I don't care that the maximum ticks per second is 10 because thats still 600 tick or 100 6 tick bars in 1 minute).

 

So, for my use, IB ticks are perfectly "reliable." The show slow progress during slow times but spread the action out for clearer signals during fast action.

 

Personally, if you draw channels and trendlines or other angled lines on charts I recommend that you do that with minute charts because tick and volume charts distort them depending on current speed of action. But, although thats a common view, its just one view.

Share this post


Link to post
Share on other sites

Absolutely! I really like the 'look and fee'l of IB's 'pseudo' ticks and find them 'reliable'. In a fast market I would far rather have a 200ms sample with timely information than a full tick feed lagging by x seconds.

 

I really don't believe its a big a deal as some people make out though I guess some black boxes or quantitative systems might function better with an un-aggregated feed. I guessed that was the point of your question about application. I really can't imagine too many that would be impaired using IB's data despite its compromises.

Share this post


Link to post
Share on other sites

OK ..I understand that RT tick chart is diferent because IB 0.2 sec snapshot data

 

but when I request history tick chart from IB in MC ...what would I get ?

true tick chart as it should be, or something other ?

 

I am asking this because I am not sure... can I test anything on IB history tick charts and expect similar results when it goes live ?

 

in other words ...If I trade on IB tick data ....what data should I use for backtesting and building my system ?

Share this post


Link to post
Share on other sites

It depends on what history granularity you charting requests. 5 second is the finest and SierraChart only requests that when you are in a 1 hour or below situation. 30 second is used by SC for longer term backfill requests.

 

 

If you are backtesting a system based on ib tick data you need to use the same fill you will use live ... ie live.

 

But to be frank if you want to test based on tick data you had better pay the money and get a feed that provides you true tick data live and backfill.

Share this post


Link to post
Share on other sites

I have used DTN IQfeed for almost one year and have never experienced a problem with them. They have been very reliable, and their customer service has been very good.

 

Another one I've heard about, but have not tried is Open Tick. I understand they are not accepting any new customers right now, though.

Share this post


Link to post
Share on other sites

I just need to see how good is IB tick data

so if anyone have historical CL data ( year or two ) in ASCI format please post it here

 

thanks

Edited by JKLM

Share this post


Link to post
Share on other sites

Well personally, I wouldn't worry about IB data if your not on it already. Forget about the data and make your choice broker wise that way.

I think what gets lost in this is most people don't trade off 1 tick charts, most of what we do involves snapshots of ticks and throwing out data to make a usefull summary at much slower intervals than .2 seconds...

The real difference between IB and a real tick provider is probly nothing unless your doing some high frequency autotrader deal..

If you like their broker services then just go with them and if you really need tick precise data then add DTN into the mix. DTN is impossible to beat bang for the buck wise.

Share this post


Link to post
Share on other sites

It really depends on on what you are trading and what you want to do with your charts. On something like ES, having an aggregate tick count based on 0.2-0.3 second snapshots has little similarity to what's actually happening in the market. On a true tick data feed, the charts can turn a lot more quickly.

 

I have some indicator based strategies that I run on tick charts. I have other strategies that I run on 5-min candlestick charts. IB data is fine for the candlestick charts but is entirely unreliable for the tick strategies. I use a different broker for charting data.

 

As a risk control strategy, having a separate data feed for charting works out well. At least once a week, market data on one of my brokers will freeze. It's very convenient to have another vendor to inform you that the market is moving against your position.

 

Good trading,

 

Bam-Bam

Share this post


Link to post
Share on other sites
  Bam-Bam said:

 

On a true tick data feed, the charts can turn a lot more quickly.

 

Bam-Bam

 

I thought they only aggregated ticks at the same price? So in theory they should turn at the same time.

Share this post


Link to post
Share on other sites

Some confusion arising here about tick and historical data download from IB.

 

 

There are 3 different kind of quote data available form IB:

 

1. Tick data (realtime) is coming (as stated) in 0.2 to 0.3 sec intervals. It is mostly truly realtime but it can (rarely) be lagging max. a few seconds.

It comes as price (of trade) and volume information. If any trades at price levels away from the given price took place you will never know (this could happen only for very liquid instruments). Good thing is you never loose track of volume traded.

 

2. Historical data (to be downloaded). It can be ordered in various granularities (1 sec=minimum NOT 5 sec as was stated, 5 sec, 10 sec ... 1 day). The data comes as: Open, High, Low, Close, Volume (OHLC).

In one data request you can get (depending on interval chosen) about 2000 data points (33.3 minutes if 1 sec interval chosen).

Data download is throttled: If you make several data requests, you can only have one data request every 11 secs or so. That makes downloading of 1 sec data of a longer time interval pretty slow.

 

3. Realtime Bars (realtime at 5 sec intervals, OHLC bars). Currently it is only possible to get 5 sec realtime bars. Data comes (as with historicals) as Open, High, Low, Close, Volume.

The advantage over tick data is that you can be sure that you will see if a new High or Low has been made.

Tick data and Realtime bars from one symbol can be ordered in parallel.

 

 

Main question is in what kind of program you want to use the data.

If you want to make your own program, IB will be fine.

 

I am not aware of any commercially available program that could use all the possibilities that the different IB data formats give you.

 

Program to download data from IB in text form:

http://home.cidadevirtual.pt/jtwsdump/

(I am not the programmer and do not use it).

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • My wife Robin just wanted some groceries.   Simple enough.   She parked the car for fifteen minutes, and returned to find a huge scratch on the side.   Someone keyed her car.   To be clear, this isn’t just any car.   It’s a Cybertruck—Elon Musk's stainless-steel spaceship on wheels. She bought it back in 2021, before Musk became everyone's favorite villain or savior.   Someone saw it parked in a grocery lot and felt compelled to carve their hatred directly into the metal.   That's what happens when you stand out.   Nobody keys a beige minivan.   When you're polarizing, you're impossible to ignore. But the irony is: the more attention something has, the harder it is to find the truth about it.   What’s Elon Musk really thinking? What are his plans? What will happen with DOGE? Is he deserving of all of this adoration and hate? Hard to say.   Ideas work the same way.   Take tariffs, for example.   Tariffs have become the Cybertrucks of economic policy. People either love them or hate them. Even if they don’t understand what they are and how they work. (Most don’t.)   That’s why, in my latest podcast (link below), I wanted to explore the “in-between” truth about tariffs.   And like Cybertrucks, I guess my thoughts on tariffs are polarizing.   Greg Gutfield mentioned me on Fox News. Harvard professors hate me now. (I wonder if they also key Cybertrucks?)   But before I show you what I think about tariffs… I have to mention something.   We’re Headed to Austin, Texas This weekend, my team and I are headed to Austin. By now, you should probably know why.   Yes, SXSW is happening. But my team and I are doing something I think is even better.   We’re putting on a FREE event on “Tech’s Turning Point.”   AI, quantum, biotech, crypto, and more—it’s all on the table.   Just now, we posted a special webpage with the agenda.   Click here to check it out and add it to your calendar.   The Truth About Tariffs People love to panic about tariffs causing inflation.   They wave around the ghost of the Smoot-Hawley Tariff from the Great Depression like it’s Exhibit A proving tariffs equal economic collapse.   But let me pop this myth:   Tariffs don’t cause inflation. And no, I'm not crazy (despite what angry professors from Harvard or Stanford might tweet at me).   Here's the deal.   Inflation isn’t when just a couple of things become pricier. It’s when your entire shopping basket—eggs, shirts, Netflix subscriptions, bananas, everything—starts costing more because your money’s worth less.   Inflation means your dollars aren’t stretching as far as they used to.   Take the 1800s.   For nearly a century, 97% of America’s revenue came from tariffs. Income tax? Didn’t exist. And guess what inflation was? Basically zero. Maybe 1% a year.   The economy was booming, and tariffs funded nearly everything. So, why do people suddenly think tariffs cause inflation today?   Tariffs are taxes on imports, yes, but prices are set by supply and demand—not tariffs.   Let me give you a simple example.   Imagine fancy potato chips from Canada cost $10, and a 20% tariff pushes that to $12. Everyone panics—prices rose! Inflation!   Nope.   If I only have $100 to spend and the price of my favorite chips goes up, I either stop buying chips or I buy, say, fewer newspapers.   If everyone stops buying newspapers because they’re overspending on chips, newspapers lower their prices or go out of business.   Overall spending stays the same, and inflation doesn’t budge.   Three quick scenarios:   We buy pricier chips, but fewer other things: Inflation unchanged. Manufacturers shift to the U.S. to avoid tariffs: Inflation unchanged (and more jobs here). We stop buying fancy chips: Prices drop again. Inflation? Still unchanged. The only thing that actually causes inflation is printing money.   Between 2020 and 2022 alone, 40% of all money ever created in history appeared overnight.   That’s why inflation shot up afterward—not because of tariffs.   Back to tariffs today.   Still No Inflation Unlike the infamous Smoot-Hawley blanket tariff (imagine Oprah handing out tariffs: "You get a tariff, and you get a tariff!"), today's tariffs are strategic.   Trump slapped tariffs on chips from Taiwan because we shouldn’t rely on a single foreign supplier for vital tech components—especially if that supplier might get invaded.   Now Taiwan Semiconductor is investing $100 billion in American manufacturing.   Strategic win, no inflation.   Then there’s Canada and Mexico—our friendly neighbors with weirdly huge tariffs on things like milk and butter (299% tariff on butter—really, Canada?).   Trump’s not blanketing everything with tariffs; he’s pressuring trade partners to lower theirs.   If they do, everybody wins. If they don’t, well, then we have a strategic trade chess game—but still no inflation.   In short, tariffs are about strategy, security, and fairness—not inflation.   Yes, blanket tariffs from the Great Depression era were dumb. Obviously. Today's targeted tariffs? Smart.   Listen to the whole podcast to hear why I think this.   And by the way, if you see a Cybertruck, don’t key it. Robin doesn’t care about your politics; she just likes her weird truck.   Maybe read a good book, relax, and leave cars alone.   (And yes, nobody keys Volkswagens, even though they were basically created by Hitler. Strange world we live in.) Source: https://altucherconfidential.com/posts/the-truth-about-tariffs-busting-the-inflation-myth    Profits from free accurate cryptos signals: https://www.predictmag.com/       
    • No, not if you are comparing apples to apples. What we call “poor” is obviously a pretty high bar but if you’re talking about like a total homeless shambling skexie in like San Fran then, no. The U.S.A. in not particularly kind to you. It is not an abuse so much as it is a sad relatively minor consequence of our optimism and industriousness.   What you consider rich changes with circumstances obviously. If you are genuinely poor in the U.S.A., you experience a quirky hodgepodge of unhelpful and/or abstract extreme lavishnesses while also being alienated from your social support network. It’s about the same as being a refugee. For a fraction of the ‘kindness’ available to you in non bio-available form, you could have simply stayed closer to your people and been MUCH better off.   It’s just a quirk of how we run the place and our values; we are more worried about interfering with people’s liberty and natural inclination to do for themselves than we are about no bums left behind. It is a slightly hurtful position and we know it; we are just scared to death of socialism cancer and we’re willing to put our money where our mouth is.   So, if you’re a bum; you got 5G, the ER will spend like $1,000,000 on you over a hangnail but then kick you out as soon as you’re “stabilized”, the logistics are surpremely efficient, you have total unchecked freedom of speech, real-estate, motels, and jobs are all natural healthy markets in perfect competition, you got compulsory three ‘R’’s, your military owns the sky, sea, space, night, information-space, and has the best hairdos, you can fill out paper and get all the stuff up to and including a Ph.D. Pretty much everything a very generous, eager, flawless go-getter with five minutes to spare would think you might need.   It’s worse. Our whole society is competitive and we do NOT value or make any kumbaya exception. The last kumbaya types we had werr the Shakers and they literally went extinct. Pueblo peoples are still around but they kind of don’t count since they were here before us. So basically, if you’re poor in the U.S.A., you are automatically a loser and a deadbeat too. You will be treated as such by anybody not specifically either paid to deal with you or shysters selling bejesus, Amway, and drugs. Plus, it ain’t safe out there. Not everybody uses muhfreedoms to lift their truck, people be thugging and bums are very vulnerable here. The history of a large mobile workforce means nobody has a village to go home to. Source: https://askdaddy.quora.com/Are-the-poor-people-in-the-United-States-the-richest-poor-people-in-the-world-6   Profits from free accurate cryptos signals: https://www.predictmag.com/ 
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
    • TDUP ThredUp stock, watch for a top of range breakout above 2.94 at https://stockconsultant.com/?TDUP
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.