Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

TheNegotiator

Massively Parallel Processing

Recommended Posts

Does anyone know CUDA or CUDA.net? Is anyone integrating it in any way? Are there any good alternatives to it? I think there is ATI Stream maybe.

 

but the market is a sequential event...

Share this post


Link to post
Share on other sites

A single market in real-time is a sequential event yes. What about if you were interested in processing real-time data of all the stocks in the S&P 500 for example? How much quicker might you be able to run backtesting and optimisations if you are clever about how you use the programming? I know that cuda is used already by various financial companies. Why should it be their edge though when all we have to do is pop a couple of gpu's in sli into our own pc's? Not that you could compete at the same level, just on the same playing field.

Share this post


Link to post
Share on other sites
A single market in real-time is a sequential event yes. What about if you were interested in processing real-time data of all the stocks in the S&P 500 for example? How much quicker might you be able to run backtesting and optimisations if you are clever about how you use the programming? I know that cuda is used already by various financial companies. Why should it be their edge though when all we have to do is pop a couple of gpu's in sli into our own pc's? Not that you could compete at the same level, just on the same playing field.

 

backtest is still a sequential event

 

you can use genetic algorithm to simulate optimization,

that speeds up processing without added hardware.

 

 

ps. CUDA is good for vector processing (Look up Google)... ok to make 3D financial models, but not sequential events like trading.

 

One famous charting software (which should remain nameless) had to turn off multi-core CPU and multi-thread processing, because of problem with data integrity. This should give you an idea the practical application of massively parallel processing.

Share this post


Link to post
Share on other sites

Hmm. Interesting. It seems to not be of huge benefit right now. If you were backtesting/optimising, could the time period you were analysing not be broken up into many constituent parts, tested and then reformed to give an output?

 

I am sure there are applications for this, perhaps at a later date as the technology evolves.

Share this post


Link to post
Share on other sites
Hmm. Interesting. It seems to not be of huge benefit right now. If you were backtesting/optimising, could the time period you were analysing not be broken up into many constituent parts, tested and then reformed to give an output?

 

I am sure there are applications for this, perhaps at a later date as the technology evolves.

 

the basic fact is.... you have to buy before you can exit long -- that is an sequential event.

You cannot chop up a sequential event and process the exit long before a buy is executed.

 

 

furthermore, most of the trading logics require something like this:

if price is larger than 50 SMA ... then buy...

if number of loss trades today is smaller than "max_allowed_loss_trade"... then proceed...

 

 

that 50 SMA is a sequential event that must go back 50 bars... you cannot chop up this event for parallel processing.

 

same goes for any conditional decisions that looks back in time.

 

 

Hope these examples helps.

Share this post


Link to post
Share on other sites

Hello guys,

 

I was considering learning CUDA for making a backtester of my own making faster, but the problem with GPGPU is that these technologies are greatly hindered by the RAM -> GPU bandwidth. Hence it is benefitial for backtests where a large part of RAM is moved onto the graphics card once, from where the GPUs can perform the whole backtest. However, with today's cards having at max 3GBs of memory, you can't possibly hold more than 1.5 year of tick data for some less liquid instruments (say TF).

 

Backtesting is a sequential event, however not in the sense discussed here. The fact that SMA50 needs to look back 50 periods is valid, however once you precompute the the indicator for the whole investigated period, you can have each core investigate a different period of the market (searching for entries). The same can be applied for exits. However, it is the synchronization of entries and exits on patterns/SL/PT that cannot be done in parallel. So, in my view, GPGPU in backtesting if worth it only if you have enormously complicated entry patterns that take a lot of time to evaluate, where having 3000 cores evaluating entries at every tick is what makes the backtest fast. In any other setup, the power of GPGPU can't be used for quicker backtesting in my view.

Share this post


Link to post
Share on other sites
Hello guys,

.... However, it is the synchronization of entries and exits on patterns/SL/PT that cannot be done in parallel. ....

 

.......... LOL ..........

 

there is a genius in every clown.

Share this post


Link to post
Share on other sites
the basic fact is.... you have to buy before you can exit long -- that is an sequential event.

You cannot chop up a sequential event and process the exit long before a buy is executed.

 

 

furthermore, most of the trading logics require something like this:

if price is larger than 50 SMA ... then buy...

if number of loss trades today is smaller than "max_allowed_loss_trade"... then proceed...

 

 

that 50 SMA is a sequential event that must go back 50 bars... you cannot chop up this event for parallel processing.

 

same goes for any conditional decisions that looks back in time.

 

 

Hope these examples helps.

 

Unless you are executing the same process for many tickers ;-) From simple view of the world and our actions to it - yes it is not really possible to do stuff in parallel. But when you move a bit into what is really going on - you'll find a lot of things for parallel computing ;)

 

Anyway back to topic - CUDA is usually about heavy C programs. If your are able to do that - than try first to write backtest for your data on your CPU in C... maybe you will find the performance sufficient.... / like me, I was planning to the same. Then I found that by using optimized libraries and 4 CPU cores my speed up was :haha: 250x

Share this post


Link to post
Share on other sites
...Then I found that by using optimized libraries and 4 CPU cores my speed up was :haha: 250x

 

Hello andro, just ouf ot curiosity, what libraries do you use?

Share this post


Link to post
Share on other sites
Hello andro, just ouf ot curiosity, what libraries do you use?

 

Python and Numpy, for code overfilled with "if"s Cython.

 

And just to be precise I'm talking about code "vectorization" and "parallelization". But the same applies to CUDA.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Date: 20th January 2025.   The NASDAQ Rises As Trump Inauguration Edges Closer!   US indices increased in value for the first time after struggling for 5 consecutive weeks. Of the main US indices the NASDAQ witnessed the strongest gains (4.12%). Risk indicators point to a higher risk appetite under the new US President, Donald Trump. President Trump's inauguration will take place this afternoon and has promised to sign over 100 consecutive orders within his first week. NASDAQ - Higher Investor Confidence! NASDAQ traders begin to stomach less frequent interest rate adjustments, the market turns its attention to earnings and Trump’s presidency. Investors are becoming more bullish under expectations that Trump will apply policies to support the US economy and entice further investment into the US stock market. A "risk-on" sentiment is evident in today's sessions, reflected in risk indicators like the VIX, High-Low Index, and Bond yields.     Investors this week will concentrate on two factors. The first factor is Trump’s consecutive orders which he has advised will be signed within his first week. Investors will closely monitor how and if these policies influence the US economy and stocks. The second factor is earnings season, which will start to gain momentum this week. Tomorrow, Netflix will release its quarterly earnings report after the market closes. Netflix is the NASDAQ’s 10th most influential company and 11th most impactful stock. Analysts expect the company’s earnings per share to drop from $5.40 to $4.21, but for Revenue to rise to $10.11 Billion. If Netflix is able to beat the earnings per share and revenue expectations, fundamental elections would indicate a rise in the price. Over the past 12 months the price has risen 76%. A further increase would further support the NASDAQ. Thereafter, investors will turn their attention to Intuitive Surgical’s earnings report. Currently, investors believe the company’s earnings per share and revenue will rise compared to the previous quarter. Intuitive’s stock has risen by more than 9% in the past week alone indicating that investors believe the company will continue to beat earnings expectations. The company has beat expectations over the past 12-months. How are Markets Reacting to Trump's inauguration? Trump pledged to issue executive orders aimed at advancing artificial intelligence programs and establishing the Department of Government Efficiency (Doge). Analysts expect these two alone to support US stocks. However, investors are not yet certain to what extent upcoming tariffs will pressure the NASDAQ and stocks. During the previous trade wars, the NASDAQ fell by 25% over a period of 4-months. Traders also should note that the NASDAQ rose in the 6-weeks after Trump won the elections. Over the past week, the VIX index fell by more than 12% indicating that the market believes US stocks will perform well under a Trump presidency. Simultaneously, US Bond yields have fallen from 4.80% to 4.58% which is known to positively influence the US stock market. Both the VIX and lower bond yields indicate higher investor confidence as Trump advises that policies will prompt more employment, US made products and more pro-US policies. NASDAQ - Technical Analysis The price of the NASDAQ trades above the 200-bar Moving Average on a 5-minute Chart indicating bullish price movement. Moving Averages have also crossed over upwards and the price trades above the VWAP indicating that the asset is maintaining its bullish momentum. Price action is also forming clear higher highs and higher lows, but investors will be cautious if the price does not find resistance at the $21,637 resistance level. In order to break above this level, investors will be hoping for positive earnings data from Netflix and Intuitive.     Key Takeaways: President Trump's inauguration will take place this afternoon with promise to sign over 100 consecutive orders within his first week. US indices rise after 5 weeks of declines, with the NASDAQ leading at 4.12%. Trump pledged to issue executive orders aimed at advancing artificial intelligence programs and establishing the Department of Government Efficiency. Analysts expect Netflix earnings per share to drop from $5.40 to $4.21, but for Revenue to rise to $10.11 Billion. Investors are becoming more bullish under expectations that President Trump will apply policies to support the US economy and entice further investment into the US stock market. Always trade with strict risk management. Your capital is the single most important aspect of your trading business.   Please note that times displayed based on local time zone and are from time of writing this report.   Click HERE to access the full HFM Economic calendar.   Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding of how markets work. Click HERE to register for FREE!   Click HERE to READ more Market news. Michalis Efthymiou HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in Leveraged Products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • Consider: some 80% of small to medium-sized businesses around the world don’t have a website.   Many businesses in emerging economies rely on social media platforms (e.g., WhatsApp, Facebook) as their primary digital presence instead of formal websites.   But even in more digitally advanced economies, the number can hover around half.   Why? Simple answer: although we’ve made it easier to make a website, it’s still not easy enough.   Let’s say a yoga instructor wants to offer online classes but lacks tech skills or a budget.   Instead of struggling with confusing platforms, she tells her AI agent, “Set up a website for me to host yoga classes.”   The AI handles everything.   It integrates Stripe for payments, Zoom for live classes, scheduling services for in-person classes, and a chat module for inquiries.   It even suggests templates.   When the instructor picks one and asks for a purple and white color scheme, the AI updates it instantly.   No coding. No frustration. Just results.   And the best part? She didn’t have to touch a single screen or key.   This is the future Wilson describes in Age of Invisible Machines.   And, as mentioned, it’s powered by three core technologies:   Conversational User Interfaces (CUIs): Say what you need; the system handles it. From building websites to booking flights, it’s fast and human-like.   Composable Architecture: Traditional business solutions become “modules”. Like LEGO bricks, modular tools—payments, chats, scheduling—snap together to create custom solutions without starting from scratch.   No-Code Programming: AI agents code for you, empowering anyone to create without needing a developer. It’s not just a better way to interact with technology…   It’s a complete reimagining of how industries operate.   As Harvard Business School’s Marco Iansiti says, “This isn’t disruption—it’s a fundamental shift in production and interaction.”   And, the thing is…   It’s not just possible. It’s already happening.   Early examples are already here. – Chris Campbell, AltucherConfidential Profits from free accurate cryptos signals: https://www.predictmag.com/ 
    • Question: My name is Omobola Sikiru from Lagos, Nigeria. I am mechanical engineering. Where can I find someone that can be my helper to relocate me to the USA?   Answer: According to your own profile, you are trying to enter other countries through deception and immigration fraud.   You are an engineer in Nigeria, but you are not licensed as an engineer in any other country.   There are no helpers, no sponsors, and nobody is going to give you money, get you an engineering job, or get you a visa.   You must qualify to immigrate. Nobody can help you with that.   Either you qualify and have settling in money, or you don’t.   You need to improve your English before trying to get a job in a Western, English speaking country. Engineers write reports. You wrote, ‘I am mechanical engineering’. Nobody will hire you if you write like this. Rathkeale Source: https://www.quora.com/My-name-is-Omobola-Sikiru-from-Lagos-Nigeria-I-am-mechanical-engineering-Where-can-I-find-someone-that-can-be-my-helper-to-relocate-me-to-the-USA   Profits from free accurate cryptos signals: https://www.predictmag.com/  
    • QRVO Qorvo stock, big bottom breakout at https://stockconsultant.com/?QRVO
    • MRVL Marvell Technology stock good day and breakout at https://stockconsultant.com/?MRVL  
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.