Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

Ranger

Neural Networks and Genetic Optimizers

Recommended Posts

I attached a zip file with screenshots showing how I setup a model for CAT using 60 Minute data. I made some notes so that interested forum members can follow along.

 

Note:

 

a) I didn't include any other timeseries in this model. That will be the next step ie a SMA model for S&P; DJI etc.

 

b) I checked with Tradecision and they said that pre-processing on minute data is probably unnecessary. I need to check my data set and make sure that it's statistically sound but I'll leave that as a future excercise following review of model output.

 

c) Tradecision has implemented a filter for outliers that will help normalize data but the beta version has crashed on me a couple of times ... in all fairness to Tradecision, I got this hot off the press. I sent them error reports.

 

d) The screenshots show a henious estimated time for completion. The estimated time at posting is now 1.5 hrs and I'm on stage 2. If it completes soon I'll post the results.

 

e) I'll likely need to improve the directional accuracy .... let's see what happens.

 

Any comments especially on the inputs would be really helpful.

 

RANGER

CAT Model NN.zip

Share this post


Link to post
Share on other sites

Attached find a predictive MACD developed using Tradecision. For the most part the MACD is triggering approximately 1-3 intervals before the standard MACD(can post the full time series).

 

Directional accuracy and error of model shown.

 

RANGER

MACD.pdf

Share this post


Link to post
Share on other sites

The next step would be to examine the equity curves of these systems as a time series through the lens of a Neural Net. If the neural net indicated that the equity curve would rise for one of the systems, might would take the trade. In a sense it's just a confirmation of your signal. One could take 100 various systems and examine the NN consensus, etc.

 

Make sense? I'd be surprised if this isn't being done somewhere..

 

One thing I would question is if you can look for the most robust system as opposed to the max profit. I don't see how you get around that the system with the max profit is probably the most fragile unless you expect the markets distribution to stop moving.

Share this post


Link to post
Share on other sites

Actually there is another intervening (crucial) step and that is to concider how you might take potential trades based on what the forecast MACD is. The output from this would presumably go into your equity net?

Share this post


Link to post
Share on other sites
Actually there is another intervening (crucial) step and that is to concider how you might take potential trades based on what the forecast MACD is. The output from this would presumably go into your equity net?

 

Thanks BlowFish ...

 

I've heard of MACD strategies but I don't have one that works so I intend to use this as a permissive that I'll poll as part of an overall autoexecution strategy.

 

I started modeling a Stochastic using similar inputs but the results are partly heinous and partly unbelievable. I queried Tradecision on the matter and hope to hear back today.

 

One of things that I'd like to do is filter the noise found in intraday price data and use the output for the neural models. I've been reading some research papers; investigating websites etc and found some resources but I haven't found a starting point for easy language. I seems like I might have to generate my own wavelet filter .... talk about inventing the wheel on some of this stuff .... :crap:

Edited by Ranger
correct spelling errors

Share this post


Link to post
Share on other sites

Urma

 

I think that in one of your posts you mentioned that you use JMA for smoothing. Do you use this MA to filter the data of your indicators before modeling ie volume or others for your regression models?

 

Also, do you have an opinion on the use of wavelet algorithms for smoothing data sets for use in NN?

 

Trust all is well

 

RANGER

Share this post


Link to post
Share on other sites
UrmaI think that in one of your posts you mentioned that you use JMA for smoothing. Do you use this MA to filter the data of your indicators before modeling ie volume or others for your regression models?Also, do you have an opinion on the use of wavelet algorithms for smoothing data sets for use in NN?Trust all is well RANGER

 

A year or two ago we developed our own smoothing which tests much closer to the mean than JMA. It involves serial exponential smoothing, much like the Hull, and we have not used the JMA since. We also use a regression curve for smoothing.

 

We have fooled around with wave & wavelet utilities in the past and even bought the Gista Caterpillar from the Russians but currently use none of them for anything.

 

 

cheers

Share this post


Link to post
Share on other sites

Hi Urma

 

Perhaps my questions was unclear. Do you smooth your price and volume data prior to regression modeling?

 

I compared JMA a version of Hull and found them comparable. My partner and I compared JMA; Hull and Haar Wavelet MAs and found Wavelet more responsive. The Wavelet MA seems to make the curves with little under/overshoot.

 

Thanks

 

RANGER

Share this post


Link to post
Share on other sites
There is a free open-source application called RapidMiner that's powerful. It incorporates the WEKA learning library and libSVM. Also has parameter optimization built-in. I actually use this platform for all my trade system development and data mining. The only thing it is missing is R integration which was present in version 4.x and in development for 5.x.

 

Shell128, How do you use Rapidminer to trade....or more specifically how to you get it to do predictions?

 

Thanks in advance.

 

DBG

Share this post


Link to post
Share on other sites
Shell128, How do you use Rapidminer to trade....or more specifically how to you get it to do predictions?

 

Thanks in advance.

 

DBG

 

Each pre-processing step is an operator. I made my own operators, not too hard to do. I recommend that you buy the RM developer's guide, shows you how to do it. Each operator outputs an ExampleSet which can be input to any of the hundreds (now thousands thanks to R integration) of learning algorithms and statistical processing routines available in RM. However, I you will need to hack some of the classes to make it run real-time prediction. For example, one of my classes loads incoming data an outputs an example set. I then added update listeners to the RM's ExampleSet class as well as all my custom operators. If you're starting from scratch, I don't recommend doing this. RM is a great platform for system development, but when you get to the prediction stage, you're probably better off making a stand-alone system which operates outside of RM. Updating ExampleSets is not most efficient for a real-time application. But I have found RM productive for prototyping.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Back in the early 2000s, Netflix mailed DVDs to subscribers.   It wasn’t sexy—but it was smart. No late fees. No driving to Blockbuster.   People subscribed because they were lazy. Investors bought the stock because they realized everyone else is lazy too.   Those who saw the future in that red envelope? They could’ve caught a 10,000%+ move.   Another story…   Back in the mid-2000s, Amazon launched Prime.   It wasn’t flashy—but it was fast.   Free two-day shipping. No minimums. No hassle.   People subscribed because they were impatient. Investors bought the stock because they realized everyone hates waiting.   Those who saw the future in that speedy little yellow button? They could’ve caught another 10,000%+ move.   Finally…   Back in 2011, Bitcoin was trading under $10.   It wasn’t regulated—but it worked.   No bank. No middleman. Just wallet to wallet.   People used it to send money. Investors bought it because they saw the potential.   Those who saw something glimmering in that strange orange coin? They could’ve caught a 100,000%+ move.   The people who made those calls weren’t fortune tellers. They just noticed something simple before others did.   A better way. A quiet shift. A small edge. An asymmetric bet.   The red envelope fixed late fees. The yellow button fixed waiting. The orange coin gave billions a choice.   Of course, these types of gains are rare. And they happen only once in a blue moon. That’s exactly why it’s important to notice when the conditions start to look familiar.   Not after the move. Not once it's on CNBC. But in the quiet build-up— before the surface breaks.   Enter the Blue Button Please read more here: https://altucherconfidential.com/posts/netflix-amazon-bitcoin-blue  Profits from free accurate cryptos signals: https://www.predictmag.com/ 
    • What These Attacks Look Like There are several ways you could get hacked. And the threats compound by the day.   Here’s a quick rundown:   Phishing: Fake emails from your “bank.” Click the link, give your password—game over.   Ransomware: Malware that locks your files and demands crypto. Pay up, or it’s gone.   DDoS: Overwhelm a website with traffic until it crashes. Like 10,000 bots blocking the door. Often used by nations.   Man-in-the-Middle: Hackers intercept your messages on public WiFi and read or change them.   Social Engineering: Hackers pose as IT or drop infected USB drives labeled “Payroll.”   You don’t need to be “important” to be a target.   You just need to be online.   What You Can Do (Without Buying a Bunker) You don’t have to be tech-savvy.   You just need to stop being low-hanging fruit.   Here’s how:   Use a YubiKey (physical passkey device) or Authenticator app – Ditch text message 2FA. SIM swaps are real. Hackers often have people on the inside at telecom companies.   Use a password manager (with Yubikey) – One unique password per account. Stop using your dog’s name.   Update your devices – Those annoying updates patch real security holes. Use them.   Back up your files – If ransomware hits, you don’t want your important documents held hostage.   Avoid public WiFi for sensitive stuff – Or use a VPN.   Think before you click – Emails that feel “urgent” are often fake. Go to the websites manually for confirmation.   Consider Starlink in case the internet goes down – I think it’s time for me to make the leap. Don’t Panic. Prepare. (Then Invest.)   I spent an hour in that basement bar reading about cyberattacks—and watching real-world systems fall apart like dominos.   The internet going down used to be an inconvenience. Now, it’s a warning.   Cyberwar isn’t coming. It’s here.   And the next time your internet goes out, it might not just be your router.   Don’t panic. Prepare.   And maybe keep a backup plan in your back pocket. Like a local basement bar with good bourbon—and working WiFi.   As usual, we’re on the lookout for more opportunities in cybersecurity. Stay tuned.   Author: Chris Campbell (AltucherConfidential) Profits from free accurate cryptos signals: https://www.predictmag.com/   
    • DUMBSHELL:  re the automation of corruption ---  200,000 "Science Papers" in academic journal database PubMed may have been AI-generated with errors, hallucinations and false sourcing 
    • Does any crypto exchanges get banned in your country? How's about other as Bybit, Kraken, MEXC, OKX?
    • Does any crypto exchanges get banned in your country? How's about other as Bybit, Kraken, MEXC, OKX?
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.