Plumbing the Depths of Unstructured Data
Turning to organizing measures like collaboration, ‘microdata’ and application of standards can help manage a deep source of information.
Can collaboration and sharing of data, within the context of adhering to a standard when devising data governance plans, help solve issues with handling unstructured data? This question arises when hearing how firms try to build data foundations to produce higher quality data analytics.
Data governance and analytics can be improved by building mechanisms to share data, says Leif Hanlen, a business development executive at Data61, a data requirements organization that is part of CSIRO, a digital development agency backed by the federal and state governments of Australia.
Yet, however advanced a data sharing system is, the rules that data vendors and exchanges have about their data make it challenging to join such disparate sets together, says John Denheen of Tyler Capital in London. “One of the big issues with getting good reference data is that you need to be able to tack it on to other data sets,” he says.
Before compatible standards can be achieved, firms have to identify the business practices that differ, says Sydney Hassal, a director at Scotiabank. Along with this, standards can vary among jurisdictions, observes Allie Harris of Bank of Montreal.
The US Office of Financial Research (OFR) points to “microdata,” which OFR chief data officer Cornelius Crowley defines as granular, targeted and specific information about entities, instruments, transactions or products. He advises that breaking down standards efforts to individual data elements like those he calls microdata can increase accuracy. In this context, one wonders whether unstructured data can be organized with a “microdata” approach—and what that can mean for following standards.
Harnessing unstructured data could be most useful to support consistent application of data standards.
Analytics Goldmine
Unstructured data is emerging as a “goldmine” for the application of data analytics, CSIRO’s Hanlen says, although it is nothing new—it is akin to “50 million Word documents saved over the last 10 years and put in a box.”
Firms should now understand the two types of unstructured data, says Hanlen. “Unstructured data sitting inside the enterprise—in the customer relationship-management system, in fields called ‘other’—is like a hole in the ground that’s yet to become a goldmine,” he says. External unstructured data from sources such as social media and market surveillance is already being tapped for its golden value, he says.
Analytics can come into play for the former type of unstructured data. “The task for analytics of unstructured data is not to build a brand new goldmine, but to extract elements of information from that unstructured data,” he says.
CSIRO and Data61 have worked on analyzing payments, documents predicting market outcomes and price signals based on the likelihood of future events. The challenge Hanlen finds in working with such unstructured data of a predictive—rather than measuring—nature is placing that data in a credible spectrum, which can be used to anticipate the future or a likely outcome.
Unstructured data may be a goldmine, but it is one that industry experts are just figuring out how to tap, for a variety of purposes. In March, ISITC executive Jeff Zoller pointed to unstructured data about investment behavior and patterns, as well as industry analysts’ commentary, and social and economic behavior, potentially supporting the disruption of data-management technology. In May, MUFG Canada Branch chief information and operations officer Ron Lee, speaking about how his firm is consolidating systems, noted this effort would increase the capability to work with unstructured databases.
Before any of these more aspirational purposes, however, harnessing unstructured data could be most useful to support the consistent application of data standards. The legal entity identifier (LEI) is ripe for this, as Karla McKenna, head of standards at the Global Legal Entity Identifier Foundation, observed in June, saying entity legal form information—a data element in the LEI repository—remains in “unstructured form.”
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Printing this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Copying this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
More on Trading Tech
WatersTechnology latest edition
Check out our latest edition, plus more than 10 years of our best content.
Getting aggressive: Overbond uses AI to assess dealer axes
The fixed-income analytics specialist has developed a new tool to help buy-side firms decide if they’re getting a good price from their dealers.
TS Imagine integrates LTX’s pre-trade analytics tool
Users of the fixed-income EMS will now have access to LTX’s Liquidity Cloud tool, which provides a pre-trade score for the likelihood of trading success.
European exchanges turn to dark trading in battle for flow
The EU’s two biggest exchanges are launching dark pools this year. The apparent change in their stances on dark trading reflects a profound shift in equities markets.
After contentious Opra upgrades, vendors brace for a faster future
Upgrades to the datafeed widely used to gauge the current market price for options contracts went into effect in February after three separate delays, which market participants say were caused by persistent bandwidth issues at some important recipients.
The IMD Wrap: No more turf wars, or why CDOs should heed the Voice of the CTO
Max reviews how our recent Voice of the CTO series has implications for those beyond a firm’s technology function, and how communication and collaboration between tech, data, and leadership will deliver better results.
Dark horse: Deutsche Börse building dark pool
New functionality allowing exchange members to execute sweep trades comes hot on the heels of European rival Euronext launching its own dark pool.
Waters Wrap: The tough climb for startups
Anthony speaks with two seasoned technologists to better understand why startups have such a tough time getting banks and asset managers to sign on the dotted line.
Most read
- Women in Technology & Data Awards 2024: All the winners and why they won
- Witad Awards 2024: Above and beyond award (vendor)—Susan Bennett, Tradeweb
- Fighting FAIRR: Inside the bill aiming to keep AI and algos honest