50% of firms are using AI or ML to spot data quality issues
How does your firm stack up?
About half of firms are using AI or machine learning-based techniques to spot data quality issues.
Of 10 major banks and asset managers surveyed for our ongoing 2025 Automation in Data Management Benchmark, 50% have used AI or machine learning to identify data quality issues in the past year.
An additional 30% of firms are working to do the same. And the firms who successfully spotted data quality issues using AI or ML remediated less than 25% of issues using the same techniques, meaning at least three-quarters of issues were remediated manually.
There’s a long way to go before banks and asset managers fully automate their data functions.
If you’re interested in how your firm compares, our benchmark is still open. Reach out to me at emmahilary.gould@infopro-digital.com to receive a link.
Only firms who complete the survey will receive the full results.
The statistic is small but significant. Our research shows that data management offices vary widely in their means of automating, but almost all agree they are under high pressure from executives and their boards to automate more.
Still, “tremendous” progress has been made automating core data governance, says Junaid Farooq, the founder of Pegasus 19 Consulting, which is currently working with a large bank’s data and AI office.
Data quality, one of the “pillars” of core data governance, is used by industry groups like the EDM Association to measure and standardize data management. Quality assesses the accuracy, completeness, consistency, timeliness, validity, and uniqueness of datasets.
The bank Farooq is working with has programmed data quality agents to perform profiling (an exercise that evaluates the accuracy of data), write data quality rules, and detect anomalies in datasets, such as missing fields, fat-finger errors, or abbreviations where there should be full words or phrases.
“AI is very good at searching a large set of data, analyzing it, and summarizing it. When you can do that, identifying anomalies in your data from a data governance perspective is reliable, low-hanging fruit,” Farooq says.
Benchmarking is a new initiative on WatersTechnology to bring our readership trusted, independent information.
We will run more benchmarks next year covering how technology and data are used in financial markets.
If you are not a data professional but have ideas for future benchmarks, reach out at emmahilary.gould@infopro-digital.com.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: https://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Data Management
FCA files to lift UK bond tape suspension, says legal claims ‘without merit’
After losing the bid for the UK’s bond CT, Ediphy sued the UK regulator, halting the tape’s implementation. Now, the FCA is asking the UK’s High Court to end the suspension and allow it to fight Ediphy’s claims in parallel.
Waters Wavelength Ep. 339: Northern Trust Asset Management’s Jan Rohof
This week, Jan Rohof from Northern Trust Asset Management joins to discuss how asset managers and quants get more context from data.
Tokenization & Private Markets: Where mixed data finds a needed partner?
Waters Wrap: Reading the tea leaves, Anthony predicts BlackRock’s Preqin deal, Securitize’s IPO, and numerous public comments from industry leaders are just the tip of the iceberg.
Plaintiffs propose to represent all non-database Cusip licensees in last 7 years
If granted, the recent motion for class certification in the ongoing case against Cusip Global Services would allow end-user firms and third-party data vendors alike to join the lawsuit.
New horizons: What the Nordic Cap-BMLL tie-up hints at for market data’s future
The IMD Wrap: Reb looks at Nordic Capital’s announcement last week of it purchasing BMLL to read some tea leaves.
Former Neudata employee sues for discrimination
The former head of ESG and macro data has claimed unlawful discrimination in violation of New York laws, while Neudata “strongly” disputes the allegations.
MayStreet founder says LSEG abandoned integration in new court filing
In response to LSEG’s motion to dismiss a lawsuit filed by the founder of one of its acquired companies, lawyers for Patrick Flannery have offered more details around communications between MayStreet and the exchange group.
S&P shutters NMRF solution amid audit questions
Vendors face adverse economics due to a low number of IMA banks and prospects of regulatory easing.