Event Processing at Massive Scale
Recorded at:
Clarification
by
Cameron Purdy
There are obviously other markets (besides the NYSE) that do use different technology for their market engines. The last I heard, for example, the largest and the third largest foreign exchange markets did not rely on database technology for their real time systems of record, and instead used a combination of in-memory technology and a more custom form of durable storage.
Peace,
Cameron Purdy | Oracle
Re: Clarification
by
Ali Motaz
I see you still like to debunk them (I mean that in a good spirited way)
So does the NYSE uses oracle? what else do you know about their stack?
Re: Clarification
by
Wu Sheng
Most of the hedge funds are using kx KDB to process and store taq data from NYSE, but not sure if NYSE is using KDB
Re: Clarification
by
Cameron Purdy
Obviously I have been known to skirmish a bit with the guys from Gigaspaces, but it's as friendly and as respectful as two long-time and fierce competitors can be ;-)
I will try to find out what information is public, so I can respond with more detail.
Peace,
Cameron Purdy | Oracle
Re: Clarification
by
Cameron Purdy
Oracle is not fast enough for this.
I find that the level of one's surety is at times inversely proportional to the level of one's knowledge.
(Needless to say, I am quite surprised that you would state such a thing unequivocally.)
Most of the hedge funds are using kx KDB to process and store taq data from NYSE, but not sure if NYSE is using KDB
There are many, many hedge funds. I've only personally worked with a few dozen of them, so I cannot speak authoritatively. I do know that KDB is a well-regarded solution in specific use cases in financial services, and even though I have not personally seen it in use at hedge funds, I am not surprised by the likelihood that it would be used. Here's a number of products in the general OLTP database arena that I've seen in use at hedge funds:
1) Oracle database
2) Microsoft SQL Server
3) MySQL (surprisingly common)
I haven't seen any Sybase in use at hedge funds, even though it is very common in the more established financial services businesses (because they all purchased unlimited perpetual licenses back in the early 1990s for almost nothing.)
For analysis (OLAP etc.), I've seen a number of other more specialized solutions.
For order books, trading systems, algo systems, etc., I've seen the use of in-memory data grids. (That's not surprising, since that is probably why I was there talking to them in the first place. ;-)
Peace,
Cameron Purdy | Oracle
The danger of quoting numbers without reading properly
by
Fernando Racca
Oh, maybe if you actually go to the paper he's quoting, on the Disruptor, you can actually see that they are actually trying to increment a counter.... 500 million times!
careful when quoting papers out of context.
Fernando





Hello stranger!
You need to Register an InfoQ account or Login to post comments. But there's so much more behind being registered.Get the most out of the InfoQ experience.
Tell us what you think