Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

skan

Check Missing Data from Strategy

Recommended Posts

Hello

 

How can I check from a easylanguage strategy or indicataor if some data is missing?

 

I'm trying to code a pair trading strategy. Sometimes the data from one of the instruments has gaps but the other one is still continuous.

Some of these gaps are right because of a weekend or holiday but sometimes is because of data feed problems.

Either way, I need to detect it from the code.

 

If my strategy is running on the the "continuous" instrument and waiting for data from the one with gaps in order to exit I could have a serious problem.

 

What easylanguage instruction can check if data is missing?

 

thanks

Share this post


Link to post
Share on other sites
Hello

 

How can I check from a easylanguage strategy or indicataor if some data is missing?

 

I'm trying to code a pair trading strategy. Sometimes the data from one of the instruments has gaps but the other one is still continuous.

Some of these gaps are right because of a weekend or holiday but sometimes is because of data feed problems.

Either way, I need to detect it from the code.

 

If my strategy is running on the the "continuous" instrument and waiting for data from the one with gaps in order to exit I could have a serious problem.

 

What easylanguage instruction can check if data is missing?

 

thanks

 

instead of asking "What easylanguage instruction can check if data is missing?"

try to think, what would you be looking for if you were looking at the data manually?

what would constitute a "bad" data?

what would raise a red flag in your head?

what would sound an alarm in your ears?

Share this post


Link to post
Share on other sites

Hi

 

Maybe something as simple as

If Close > 0 then ....

 

But Maybe there is something more correct.

Some other languages has some instruction to detect nonnumeric numbers or missing data.

Share this post


Link to post
Share on other sites
Hi

 

Maybe something as simple as

If Close > 0 then ....

 

But Maybe there is something more correct.

Some other languages has some instruction to detect nonnumeric numbers or missing data.

 

do you need something more "sophisticated" than what you have written above?

 

note: I am not saying you do, or you don't. This is just the continuation of the thinking process in programming. Remember, you are teaching the computer to think like you.

Edited by Tams

Share this post


Link to post
Share on other sites

If the chart were supposed to be continuous I could check that the current bar's datetime is exactly equal to the previous one plus the bar interval. But this is not as simple because there are weekends, holidays, trading hours,...

Share this post


Link to post
Share on other sites
If the chart were supposed to be continuous I could check that the current bar's datetime is exactly equal to the previous one plus the bar interval. But this is not as simple because there are weekends, holidays, trading hours,...

 

ok, you are bringing more clarity to the table.

what now do you think you need to do? or what EasyLanguage "should" do?

can you articulate it in a step by step process?

Share this post


Link to post
Share on other sites

Hi

I don't know it, that's why I'm asking.

I need to know what to write within an IF expression in order to check if a price doesn't exist on the current bar.

Something like is.na() on R.

Edited by skan

Share this post


Link to post
Share on other sites

Ah, data verification, the bane of any attempt to back test. Not only are you probably missing data, how exactly do you know that the data you do have is correct. You don't. So, now your faced with the nasty task of cross-referencing your data against a different data source. And then that leads to having to further cross-reference to yet another source since you'll inevitably find differences. And then you realize, there's enough differences in all the data such that it's going to materially impact the results of any back test. Now whatcha gonna do? Probably what most do, ignore it...pretend it doesn't matter or that your data is the "real" data.

Share this post


Link to post
Share on other sites

Yes, I quickly moved on from your initial concern, but the answer was implied. It sounds like your relying on one data source. You need another source (i.e., you need at a minimum 2 sources from different providers and preferably 3-4 total different sources if you're serious about the ultimate results) so as to do the comparison and flag the differences. Missing data is easy to isolate. Then just cut and paste until you build your own "reliable" data set. But it won't be quite that simple. You'll likely see many other differences when you start your comparisons (and it's then that you'll realize you need more than 2 sources). From there you'll begin to better understand my initial post.

Share this post


Link to post
Share on other sites

Hello.

I think we are not speaking about the same thing.

 

Checking data quality is very important but is not what I need to do now.

I just need to check if a bar has a price associated or not.

 

Imagine I have a chart with data1= 15min EURUSD forex

and data2=15min TF.

Even If all my data were correct I'll have many bars were data1 exist and data2 doesn't, because data2 has shorter opening sessions and TS or MC fills data2 chart with gaps.

 

If a try to calculate something, such as exit stop, from data2 there will be moments in which my system won't be able to do anything.

I need to detect this gaps on data2 in order to exit from data1, just in case. Or in order to make different calculations.

Share this post


Link to post
Share on other sites

I will look into the on-line broker http://www.thinkorswim.com that has a strategy builder called prodigio. There a cci cross over strategy setup where you can modify to suite your needs, No programming language is required. All done through drag-and-drop system in prodigio.

 

if you open a funded account with thinkorswim, you can use the prodigio strategy builder for free. it can autotrade foe you.

Share this post


Link to post
Share on other sites

back checking in TS forums - there were wireless connectivity issues especially with EUREX at times (i.e. it is on your side not the transmission side), and also Norton Antivirus causes some issues.

Share this post


Link to post
Share on other sites

No algorythm can be programmed to fix bad data which wont introduce a new adverse side effect somewhere. There is no substitute for good information. Redundant data sources are essential to correct bad data. You need to merge them by taking the best inside quotes that don't cross each other.

Last trade info can be filtered by comparing it to the best inside quotes. This will clean up spike and gaps in poor quality data.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Back in the early 2000s, Netflix mailed DVDs to subscribers.   It wasn’t sexy—but it was smart. No late fees. No driving to Blockbuster.   People subscribed because they were lazy. Investors bought the stock because they realized everyone else is lazy too.   Those who saw the future in that red envelope? They could’ve caught a 10,000%+ move.   Another story…   Back in the mid-2000s, Amazon launched Prime.   It wasn’t flashy—but it was fast.   Free two-day shipping. No minimums. No hassle.   People subscribed because they were impatient. Investors bought the stock because they realized everyone hates waiting.   Those who saw the future in that speedy little yellow button? They could’ve caught another 10,000%+ move.   Finally…   Back in 2011, Bitcoin was trading under $10.   It wasn’t regulated—but it worked.   No bank. No middleman. Just wallet to wallet.   People used it to send money. Investors bought it because they saw the potential.   Those who saw something glimmering in that strange orange coin? They could’ve caught a 100,000%+ move.   The people who made those calls weren’t fortune tellers. They just noticed something simple before others did.   A better way. A quiet shift. A small edge. An asymmetric bet.   The red envelope fixed late fees. The yellow button fixed waiting. The orange coin gave billions a choice.   Of course, these types of gains are rare. And they happen only once in a blue moon. That’s exactly why it’s important to notice when the conditions start to look familiar.   Not after the move. Not once it's on CNBC. But in the quiet build-up— before the surface breaks.   Enter the Blue Button Please read more here: https://altucherconfidential.com/posts/netflix-amazon-bitcoin-blue  Profits from free accurate cryptos signals: https://www.predictmag.com/ 
    • What These Attacks Look Like There are several ways you could get hacked. And the threats compound by the day.   Here’s a quick rundown:   Phishing: Fake emails from your “bank.” Click the link, give your password—game over.   Ransomware: Malware that locks your files and demands crypto. Pay up, or it’s gone.   DDoS: Overwhelm a website with traffic until it crashes. Like 10,000 bots blocking the door. Often used by nations.   Man-in-the-Middle: Hackers intercept your messages on public WiFi and read or change them.   Social Engineering: Hackers pose as IT or drop infected USB drives labeled “Payroll.”   You don’t need to be “important” to be a target.   You just need to be online.   What You Can Do (Without Buying a Bunker) You don’t have to be tech-savvy.   You just need to stop being low-hanging fruit.   Here’s how:   Use a YubiKey (physical passkey device) or Authenticator app – Ditch text message 2FA. SIM swaps are real. Hackers often have people on the inside at telecom companies.   Use a password manager (with Yubikey) – One unique password per account. Stop using your dog’s name.   Update your devices – Those annoying updates patch real security holes. Use them.   Back up your files – If ransomware hits, you don’t want your important documents held hostage.   Avoid public WiFi for sensitive stuff – Or use a VPN.   Think before you click – Emails that feel “urgent” are often fake. Go to the websites manually for confirmation.   Consider Starlink in case the internet goes down – I think it’s time for me to make the leap. Don’t Panic. Prepare. (Then Invest.)   I spent an hour in that basement bar reading about cyberattacks—and watching real-world systems fall apart like dominos.   The internet going down used to be an inconvenience. Now, it’s a warning.   Cyberwar isn’t coming. It’s here.   And the next time your internet goes out, it might not just be your router.   Don’t panic. Prepare.   And maybe keep a backup plan in your back pocket. Like a local basement bar with good bourbon—and working WiFi.   As usual, we’re on the lookout for more opportunities in cybersecurity. Stay tuned.   Author: Chris Campbell (AltucherConfidential) Profits from free accurate cryptos signals: https://www.predictmag.com/   
    • DUMBSHELL:  re the automation of corruption ---  200,000 "Science Papers" in academic journal database PubMed may have been AI-generated with errors, hallucinations and false sourcing 
    • Does any crypto exchanges get banned in your country? How's about other as Bybit, Kraken, MEXC, OKX?
    • Does any crypto exchanges get banned in your country? How's about other as Bybit, Kraken, MEXC, OKX?
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.