Measurement Deficit Disorder: Which Data to Measure and How to Measure It
A plot point in the latest season of the HBO comedy series Silicon Valley has the founders and backers of startup tech company Pied Piper glorying in the high numbers of downloads of their app after its launch. They are slow to realize that the more relevant measurement of their success is the number of daily active users.
This story arc from Silicon Valley illustrates a point that Ron Lee, chief information and operations officer at MUFG Canada Branch, made at the Toronto Financial Information and Technology Summit last month.
Lee cited a statistic from recent research conducted by McKinsey and the Harvard Business School that 60 to 90 percent of strategies fail to execute. “Executives want to understand why projects that were so cut and dried at the beginning get so delayed, get canceled, or get beaten by their competitors,” he said. “If you use traditional methods such as scorecards and APIs, they usually point to the same handful of culprits: budget, people, systems and culture. But the underlying cause is that the strategy and planning never considered these things in the first place.”
And, as Lee’s colleague, Tarun Dhot, director of advanced analytics at CIBC, also pointed out in the conference, “actions without metrics are even more useless.” The Silicon Valley characters were not using the right metrics to measure their performance.
The importance of using the right metric is also becoming apparent with the assignment of legal entity identifiers (LEIs), within the context of supporting compliance with Europe’s Markets in Financial Information Regulation (Mifir). Chris Johnson, head of product management, market data services at HSBC—who is a leader in LEI adoption efforts—stated in Inside Reference Data’s recent Mifir webcast that the 450,000 LEIs now registered are not enough to ensure Mifir compliance.
The inability to produce the right data is similar to consulting the wrong metric or measurement.
This might indeed be the right metric to watch, although there may be others that should have also been monitored and considered at the same time. In the same webcast, David Nowell of the London Stock Exchange Group pointed to the ISIN securities identifier. It appears that working with both LEIs and ISINs will be essential for data management and getting the greatest accuracy and quality possible for Mifir compliance reporting when that data is being gathered from multiple sources.
Choosing More Wisely
A similar issue concerning tracking and managing data necessary for compliance surfaced recently, this time with Solvency II, the European directive for capital adequacy in the insurance industry that took effect in January this year, with data reporting begun in April. As is likely the case with many other major firms, Henderson Global Investors, with £92 billion ($123 billion) under management, disclosed that it was still working on adjustments to improve the accuracy of data that goes into its Solvency II compliance templates.
The answer for these compliance issues—both for Solvency II and Mifir—may have been out there since at least the end of last year. In December, Stephan Malrait of ING, spoke about getting value for compliance with multiple regulations from firms’ overall data stores—also addressing BCBS 239, Basel III and Emir. At the same time, Gareth Mee, of consultancy EY, said the changes that Solvency II would drive may create pitfalls for asset managers that cannot provide “look-throughs” on data in a timely way.
The inability to produce the right data is similar to consulting the wrong metric or measurement. Either way, you don’t have the right data or you aren’t working with the correct information.
In Silicon Valley, the company’s founder barges in on a focus group to ask users what they don’t like about his platform, ending up with more information—that might help raise that important daily active users number. In data management, firms probably already have the information they need for compliance. However, choosing and using the right measures of data—and the right measures for the performance of data governance plans—proves to be more challenging.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Printing this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Copying this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
More on Regulation
Consolidated tape hopefuls gear up for uncertain tender process
The bond tapes in the UK and EU are on track to be authorized in 2025. Prospective bidders for the role of provider must choose where to focus their efforts in anticipation of more regulatory clarity on the tender process.
Fighting FAIRR: Inside the bill aiming to keep AI and algos honest
The Financial Artificial Intelligence Risk Reduction Act seeks to fix a market abuse loophole by declaring that AI algorithms do not have brains.
Waters Wrap: The rise of AI washing… and regulation washing?
The SEC recently levied fines against two investment advisors over “AI washing”. Anthony takes issue with the announcement.
Prepare now for the inevitable: T+1 isn’t just a US challenge
The DTCC’s Val Wotton believes that firms around the globe should view North America’s move to T+1 as an opportunity—because it’s inevitable.
European firms prime for lopsided settlement in North America and at home
With T+1 imminent in North America and increasingly likely to traverse the Atlantic, operations and trading professionals in Europe are fighting on two fronts.
As crypto ETFs become reality, benchmark providers take center stage
The SEC’s approval of the first spot bitcoin ETFs will expose a growing number of traditional market participants to the maturing world of crypto data, a moment that some—such as CF Benchmarks, BlackRock’s benchmark provider—have been eagerly awaiting.
Waters Wavelength Podcast: Looking into the EU regulatory landscape
Eflow’s Ben Parker joins the podcast to discuss EU regulations.
FCA declines to directly regulate market data prices
A year-long investigation by the UK regulator to determine whether competition is hindered in the wholesale data markets has concluded with its decision not to directly regulate much-maligned data pricing and licensing structures.
Most read
- Women in Technology & Data Awards 2024: All the winners and why they won
- Witad Awards 2024: Above and beyond award (vendor)—Susan Bennett, Tradeweb
- Fighting FAIRR: Inside the bill aiming to keep AI and algos honest