Max Bowie: A ‘Search Party’ to Find Missing Alpha in Financial Data
The market data industry is no stranger to high volumes of data, as rising message rates driven by a combination of higher-frequency trading, market volatility, decimalization and other market forces threaten to overwhelm the data and trading infrastructures of trading venues and market participants alike. While many efforts have focused on bolstering the capacity of their infrastructures, an equal amount of effort has been spent on analytical tools to process and filter these increased volumes of data to derive useful insight—i.e., the more data you have, the more tools you need to make it useful. Or, mo’ data, mo’ problems.
To get the most out of structured data, firms are employing new database technologies to process, store, correlate and retrieve Big Data faster than traditional databases. Meanwhile, non-price data volumes are also increasing as firms try to derive value from semi-structured and unstructured data, and look for ways to leverage data hidden within their enterprise, and harness public information available on the internet.
For these functions, a new breed of search tools is emerging to provide broader information search and discovery. For example, Epam’s InfoNgen business developed an appliance for internal content discovery and aggregation in 2009 to capture data held on internal servers, in email messages, broker research and other documents, or the internet, which could then be combined with other data. Only a few years ago, complex-event processing engines emerged as a lightweight way to monitor multiple data streams to identify optimal trading circumstances. But now, the influx of new data sources that firms believe will deliver a trading edge is prompting interest in more heavyweight data-processing solutions, such as IBM’s Watson supercomputer, which can be used to process vast volumes of data for investment analysis or to gain a better view of risk associated with clients, for example. But Watson also features natural-language processing capabilities that enable it to understand unstructured data, while the platform is also self-learning, so the more data you give it, the better results it generates. Or, mo’ data, mo’ money.
Natural-language processing serves dual purposes: On one hand, it allows computers to understand unstructured data—such as text content like news, research, blogs or social media posts—rather than merely numerical values, thus providing context and nuances to figures that may not tell the whole story. On the other hand, it can also allow traders to query today’s vast amounts of data using plain English, rather than having to remember combinations of codes or shortcuts. For example, Thomson Reuters designed its Eikon terminal with this in mind: that tomorrow’s traders would be more familiar with web searches than with the clunky function keys of olde. Its latest iteration, version 3.0, incorporates natural-language search for querying the terminal’s data and analytics. So if you type “Apple Samsung 2001 to 2012 market cap and macd” into Eikon, the system will display moving average convergence/divergence charts for both symbols on a single graph.
Thomson Reuters isn’t alone. Wolfram Research released its Wolfram Alpha online “computational knowledge engine” in 2009, while Austin, Texas-based financial search startup 9W Search enables financial advisers, analysts and researchers to search and compare company financial data from public sources filings, and other data sourced from Edgar Online. Another newcomer to financial search is Quandl, which started 2013 having indexed 2 million freely-available financial and economic time-series datasets, statistics and indicators from exchanges, clearinghouses, trade organizations, media outlets, central banks, regulators and government bodies—and recently doubled its data coverage—and provides for free what other vendors charge to deliver, making it both appealing and disruptive.
The influx of new data sources that firms believe will deliver a trading edge is prompting interest in more heavyweight data-processing solutions.
Now imagine if these services were all made available within the app store of a web-based terminal and tied together with a unified search mechanism that links and cross-references their data. Because that’s where I believe the financial data desktops of the future are headed, with search as a central component.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Printing this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Copying this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
More on Data Management
Hub to lay off 20% of staff, sources say
Hub’s CEO says this is simply a case of a startup trying to stay nimble and efficient; others say it points to deeper issues.
TS Imagine integrates LTX’s pre-trade analytics tool
Users of the fixed-income EMS will now have access to LTX’s Liquidity Cloud tool, which provides a pre-trade score for the likelihood of trading success.
After contentious Opra upgrades, vendors brace for a faster future
Upgrades to the datafeed widely used to gauge the current market price for options contracts went into effect in February after three separate delays, which market participants say were caused by persistent bandwidth issues at some important recipients.
The IMD Wrap: No more turf wars, or why CDOs should heed the Voice of the CTO
Max reviews how our recent Voice of the CTO series has implications for those beyond a firm’s technology function, and how communication and collaboration between tech, data, and leadership will deliver better results.
Dark horse: Deutsche Börse building dark pool
New functionality allowing exchange members to execute sweep trades comes hot on the heels of European rival Euronext launching its own dark pool.
Man Group’s proprietary data platform is a timesaver for quants
The investment firm’s head of data delves into its alt data strategy and use of AI tools to boost quant efficiency.
Waters Wrap: The tough climb for startups
Anthony speaks with two seasoned technologists to better understand why startups have such a tough time getting banks and asset managers to sign on the dotted line.
As crypto ETFs become reality, benchmark providers take center stage
The SEC’s approval of the first spot bitcoin ETFs will expose a growing number of traditional market participants to the maturing world of crypto data, a moment that some—such as CF Benchmarks, BlackRock’s benchmark provider—have been eagerly awaiting.
Most read
- Women in Technology & Data Awards 2024: All the winners and why they won
- Witad Awards 2024: Above and beyond award (vendor)—Susan Bennett, Tradeweb
- Fighting FAIRR: Inside the bill aiming to keep AI and algos honest