Measurement Deficit Disorder: Which Data to Measure and How to Measure It

A plot point in the latest season of the HBO comedy series Silicon Valley has the founders and backers of startup tech company Pied Piper glorying in the high numbers of downloads of their app after its launch. They are slow to realize that the more relevant measurement of their success is the number of daily active users.
This story arc from Silicon Valley illustrates a point that Ron Lee, chief information and operations officer at MUFG Canada Branch, made at the Toronto Financial Information and Technology Summit last month.
Lee cited a statistic from recent research conducted by McKinsey and the Harvard Business School that 60 to 90 percent of strategies fail to execute. “Executives want to understand why projects that were so cut and dried at the beginning get so delayed, get canceled, or get beaten by their competitors,” he said. “If you use traditional methods such as scorecards and APIs, they usually point to the same handful of culprits: budget, people, systems and culture. But the underlying cause is that the strategy and planning never considered these things in the first place.”
And, as Lee’s colleague, Tarun Dhot, director of advanced analytics at CIBC, also pointed out in the conference, “actions without metrics are even more useless.” The Silicon Valley characters were not using the right metrics to measure their performance.
The importance of using the right metric is also becoming apparent with the assignment of legal entity identifiers (LEIs), within the context of supporting compliance with Europe’s Markets in Financial Information Regulation (Mifir). Chris Johnson, head of product management, market data services at HSBC—who is a leader in LEI adoption efforts—stated in Inside Reference Data’s recent Mifir webcast that the 450,000 LEIs now registered are not enough to ensure Mifir compliance.
The inability to produce the right data is similar to consulting the wrong metric or measurement.
This might indeed be the right metric to watch, although there may be others that should have also been monitored and considered at the same time. In the same webcast, David Nowell of the London Stock Exchange Group pointed to the ISIN securities identifier. It appears that working with both LEIs and ISINs will be essential for data management and getting the greatest accuracy and quality possible for Mifir compliance reporting when that data is being gathered from multiple sources.
Choosing More Wisely
A similar issue concerning tracking and managing data necessary for compliance surfaced recently, this time with Solvency II, the European directive for capital adequacy in the insurance industry that took effect in January this year, with data reporting begun in April. As is likely the case with many other major firms, Henderson Global Investors, with £92 billion ($123 billion) under management, disclosed that it was still working on adjustments to improve the accuracy of data that goes into its Solvency II compliance templates.
The answer for these compliance issues—both for Solvency II and Mifir—may have been out there since at least the end of last year. In December, Stephan Malrait of ING, spoke about getting value for compliance with multiple regulations from firms’ overall data stores—also addressing BCBS 239, Basel III and Emir. At the same time, Gareth Mee, of consultancy EY, said the changes that Solvency II would drive may create pitfalls for asset managers that cannot provide “look-throughs” on data in a timely way.
The inability to produce the right data is similar to consulting the wrong metric or measurement. Either way, you don’t have the right data or you aren’t working with the correct information.
In Silicon Valley, the company’s founder barges in on a focus group to ask users what they don’t like about his platform, ending up with more information—that might help raise that important daily active users number. In data management, firms probably already have the information they need for compliance. However, choosing and using the right measures of data—and the right measures for the performance of data governance plans—proves to be more challenging.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: https://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Regulation
Asic probe piles pressure on ASX to deliver Chess replacement
But market insiders think late intervention by regulators could even slow down implementation.
Stakes raised for UK bond, EU derivatives tapes after Ediphy clinches win
The pressure is on for TransFICC, Etrading, Finbourne, and Propellant Digital, who are still vying to provide the UK’s fixed income consolidated tape after Esma awarded the EU’s tape to Ediphy and its partners.
Doing a deal? Prioritize info security early
Engaging information security teams early in licensing deals can deliver better results and catch potential issues. Neglecting them can cause delays and disruption, writes Devexperts’ Heetesh Rawal in this op-ed.
SEC pulls rulemaking proposals in bid for course correction
The regulator withdrew 14 Gensler-era proposals, including the controversial predictive data analytics proposal.
Trading venues seen as easiest targets for Esma supervision
Platforms do not pose systemic risks for member states and are already subject to consistent rules.
The Consolidated Audit Trail faces an uncertain fate—yet again
Waters Wrap: The CAT is up and running, but with a conservative SEC in place and renewed pressure from politicians and exchanges, Anthony says the controversial database faces a death by a thousand cuts.
Exchanges plead with SEC to trim CAT reporting requirements
Letters from Cboe, Nasdaq and NYSE ask that the new Atkins administration reduce the amount of data required for the Consolidated Audit Trail, and scrap options data collection entirely.
EU banks want the cloud closer to home amid tariff wars
Fears over US executive orders have prompted new approaches to critical third-party risk management.