Measurement Deficit Disorder: Which Data to Measure and How to Measure It

A plot point in the latest season of the HBO comedy series Silicon Valley has the founders and backers of startup tech company Pied Piper glorying in the high numbers of downloads of their app after its launch. They are slow to realize that the more relevant measurement of their success is the number of daily active users.
This story arc from Silicon Valley illustrates a point that Ron Lee, chief information and operations officer at MUFG Canada Branch, made at the Toronto Financial Information and Technology Summit last month.
Lee cited a statistic from recent research conducted by McKinsey and the Harvard Business School that 60 to 90 percent of strategies fail to execute. “Executives want to understand why projects that were so cut and dried at the beginning get so delayed, get canceled, or get beaten by their competitors,” he said. “If you use traditional methods such as scorecards and APIs, they usually point to the same handful of culprits: budget, people, systems and culture. But the underlying cause is that the strategy and planning never considered these things in the first place.”
And, as Lee’s colleague, Tarun Dhot, director of advanced analytics at CIBC, also pointed out in the conference, “actions without metrics are even more useless.” The Silicon Valley characters were not using the right metrics to measure their performance.
The importance of using the right metric is also becoming apparent with the assignment of legal entity identifiers (LEIs), within the context of supporting compliance with Europe’s Markets in Financial Information Regulation (Mifir). Chris Johnson, head of product management, market data services at HSBC—who is a leader in LEI adoption efforts—stated in Inside Reference Data’s recent Mifir webcast that the 450,000 LEIs now registered are not enough to ensure Mifir compliance.
The inability to produce the right data is similar to consulting the wrong metric or measurement.
This might indeed be the right metric to watch, although there may be others that should have also been monitored and considered at the same time. In the same webcast, David Nowell of the London Stock Exchange Group pointed to the ISIN securities identifier. It appears that working with both LEIs and ISINs will be essential for data management and getting the greatest accuracy and quality possible for Mifir compliance reporting when that data is being gathered from multiple sources.
Choosing More Wisely
A similar issue concerning tracking and managing data necessary for compliance surfaced recently, this time with Solvency II, the European directive for capital adequacy in the insurance industry that took effect in January this year, with data reporting begun in April. As is likely the case with many other major firms, Henderson Global Investors, with £92 billion ($123 billion) under management, disclosed that it was still working on adjustments to improve the accuracy of data that goes into its Solvency II compliance templates.
The answer for these compliance issues—both for Solvency II and Mifir—may have been out there since at least the end of last year. In December, Stephan Malrait of ING, spoke about getting value for compliance with multiple regulations from firms’ overall data stores—also addressing BCBS 239, Basel III and Emir. At the same time, Gareth Mee, of consultancy EY, said the changes that Solvency II would drive may create pitfalls for asset managers that cannot provide “look-throughs” on data in a timely way.
The inability to produce the right data is similar to consulting the wrong metric or measurement. Either way, you don’t have the right data or you aren’t working with the correct information.
In Silicon Valley, the company’s founder barges in on a focus group to ask users what they don’t like about his platform, ending up with more information—that might help raise that important daily active users number. In data management, firms probably already have the information they need for compliance. However, choosing and using the right measures of data—and the right measures for the performance of data governance plans—proves to be more challenging.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: https://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Regulation
Citi gears up for EU T+1 climb
The bank has a dedicated team examining what it needs to do to ensure a successful transition to T+1 in Europe.
The great disappearing internet—and what it could mean for your LLM
AI-generated content, bots, disinfo, ads, and censorship are killing the internet. As more of life continues to happen online, we might consider whether we’re building castles atop a rotting foundation.
AI’s next gig: The rising cost of off-channel communications compliance
As the cost of analyzing communications increases, what tools can firms deploy to save time and money while avoiding penalties?
CAT on life support after appeals court ruling
Ahead of a comprehensive review promised by the SEC, lawyers believe that the recent overturn of the Consolidated Audit Trail’s funding order could herald its demise.
Euroclear readies upgrade to settlement efficiency platform
Euroclear, Taskize, and Meritsoft are working together to deliver real-time insights and resolution capabilities to users settling with any of Euroclear’s CSDs.
Messaging’s chameleon: The changing faces and use cases of ISO 20022
The standard is being enhanced beyond its core payments messaging function to be adopted for new business needs.
TT partners Thoma Bravo, Fitch launches GenAI solution, AI infrastructure woes, and more
The Waters Cooler: EquiLend acquires Trading Apps, Ultumus and BMLL partner for ETF data and analytics, and more in this week’s roundup.
CAT funding plan struck down by US appeals court
The 11th Circuit court ruled that the SEC had not established a sufficient precedent to pass the costs of the Consolidated Audit Trail on to broker-dealers.