AI in Finance

AI in Finance: Data Infrastructure is the Real Bottleneck

Turns out, that shiny AI promise in finance isn't about magic algorithms. It's about dusty old data, buried under layers of legacy tech.

Abstract representation of interconnected data nodes and AI algorithms within a financial context.

Key Takeaways

  • High-quality data infrastructure is essential for financial services to realize the value of AI strategies.
  • Legacy technology and siloed data systems are major obstacles for AI adoption in finance.
  • Consolidating data into a unified source, like a data lake, is a key strategy for enabling AI transformation.

83% of senior business leaders think AI adoption would speed up if they just had better data infrastructure. Let that sink in. Eighty-three percent. That’s not a typo. It’s a full-blown siren song from the trenches of corporate America, wailing about the fundamental, unsexy bedrock of artificial intelligence: data infrastructure.

We’ve been chasing AI unicorns in finance for years, right? Every conference, every press release, it’s all about the dazzling algorithms, the predictive models, the stuff that sounds like the future. But here’s the thing the shiny brochures don’t always scream: none of it matters if your data looks like a Jackson Pollock painting after a bar fight. According to folks at the Microsoft AI Tour in London, and specifically LSEG – yes, the London Stock Exchange Group, not some scrappy startup – this is the absolute, non-negotiable prerequisite.

And it’s not just some abstract notion. LSEG, bless their organized hearts, have been on a data transformation journey themselves. They’re out there saying, look, we’re hitting Level Three maturity on “responsible AI” (which, frankly, is a buzzword bingo card all on its own), but that doesn’t magically translate to actual, you know, money being made. Because if your data’s garbage, your AI spits out garbage. And then you’ve got financial risks, compliance nightmares, and a whole lot of very expensive humans trying to fix what the machine broke.

Poor data quality produces inaccurate AI results, creating financial, compliance and operational risks, and demanding greater human oversight to correct errors.

Who’s actually making money here? Well, eventually, the guys selling the data infrastructure tools. Microsoft’s in this picture, of course, and companies like Snowflake and Databricks. They’re the ones enabling this “unified source of truth” fantasy. LSEG is moving its data into Microsoft’s ecosystem – Foundry for AI, Defender for security, Purview for governance, and OneLake. It’s all about consolidating those messy “segregated data sets sitting in garden sheds and under floorboards,” as LSEG’s Emily Prince so colorfully put it, into one big, tidy data lake.

And the payoff? According to Prince, it’s “exponential.” They’re talking about unlocking access to over 33 petabytes of “AI-ready” financial content. Thirty-three petabytes. That’s a lot of cat videos… I mean, crucial financial data. The idea is that if you make this high-quality data accessible to everyone, not just the elite data scientists locked in their ivory towers, innovation and productivity supposedly go through the roof.

Is this a new concept? No. It’s like telling a chef they can’t cook a Michelin-star meal without fresh ingredients. But in the hyper-hyped world of AI finance, we’ve spent so much time talking about the ovens and the knives that we forgot to check if the pantry was stocked with anything edible. LSEG’s confession is a breath of fresh air, or at least, a less polluted one. They’re admitting the messy reality.

The Data Swamp: Why It’s So Hard to Fix

So, why is this data swamp so persistent? It’s legacy tech, plain and simple. For decades, financial institutions have been patching and building, adding new systems, duplicating databases, and generally creating a tangled mess of sprawling data stacks. Interoperability? Forget about it. Each new vendor adds another layer of complexity. It’s the digital equivalent of trying to navigate a city built on top of another city, which was then built on top of an ancient ruin. You’re bound to trip over something.

And the promise of a “single, organization-wide data lake” sounds great on paper. Who doesn’t want a unified source of truth? But the reality of consolidating decades of disparate, often dirty, data is a colossal undertaking. It’s not just about moving files; it’s about cleaning, standardizing, and ensuring quality and permissions are consistent everywhere. It’s a massive data plumbing job, and frankly, it’s not sexy. It’s not going to get you featured on the cover of Wired (unless it’s a very, very slow news week).

But here’s the kicker: without this plumbing, the AI magic stays locked away. Imagine having all the historical data from every financial crisis, every market crash, right there. That’s gold for stress testing and scenario analysis. Imagine AI that can sift through news, pricing data, and reference information in real-time to make sharper decisions. The potential is there, but it’s buried under layers of digital dust and disorganization.

Who’s Really Profiting from the AI Data Push?

Let’s cut through the fluff. Who stands to gain the most? Clearly, the cloud providers and the data platform vendors. Microsoft, with its comprehensive suite, is perfectly positioned. Companies like Snowflake and Databricks, who have built their empires on managing and processing vast datasets, are also cashing in. They offer the solutions that financial institutions desperately need to untangle their data messes.

For the financial firms themselves, the promise is twofold: cost savings through efficiency and new revenue streams through better insights and product development. LSEG’s move is about positioning itself for the future, ensuring it can offer clients access to AI-powered insights derived from its vast data reserves. It’s a strategic play, but one that requires significant upfront investment in that unglamorous data infrastructure.

The PR narrative is all about the AI transformation, the innovation, the future. But the underlying reality is a massive, expensive, and ongoing effort to fix the foundational plumbing. And if your company is still struggling to get a clear picture of its own customer data, let alone use it for advanced AI, take note. The AI revolution isn’t coming; it’s stalled, waiting for you to clean up your room.


🧬 Related Insights

Frequently Asked Questions

What is LSEG’s data infrastructure strategy? LSEG is consolidating its fragmented data repositories into a single, organization-wide data lake, partnering with Microsoft to build an AI-capable ecosystem and embed data rights throughout its solutions. They aim to provide access to 33 petabytes of licensed, AI-ready financial content.

Why is data infrastructure so important for AI in finance? High-quality and accessible data is fundamental for AI to deliver accurate results. Poor data quality leads to financial, compliance, and operational risks, requiring significant human oversight to correct AI errors. Strong data infrastructure accelerates AI adoption and enhances its effectiveness.

Will AI replace jobs in finance due to better data infrastructure? While improved data infrastructure can lead to greater automation and efficiency, potentially impacting certain roles, it’s more likely to transform job functions. The focus will shift towards roles that manage, interpret, and use AI insights, requiring new skills rather than outright job elimination across the board.

Written by
Fintech Rundown Editorial Team

Curated insights, explainers, and analysis from the editorial team.

Frequently asked questions

What is LSEG's data infrastructure strategy?
LSEG is consolidating its fragmented data repositories into a single, organization-wide data lake, partnering with Microsoft to build an AI-capable ecosystem and embed data rights throughout its solutions. They aim to provide access to 33 petabytes of licensed, AI-ready financial content.
Why is data infrastructure so important for <a href="/tag/ai-in-finance/">AI in finance</a>?
High-quality and accessible data is fundamental for AI to deliver accurate results. Poor data quality leads to financial, compliance, and operational risks, requiring significant human oversight to correct AI errors. Strong data infrastructure accelerates AI adoption and enhances its effectiveness.
Will AI replace jobs in finance due to better data infrastructure?
While improved data infrastructure can lead to greater automation and efficiency, potentially impacting certain roles, it's more likely to transform job functions. The focus will shift towards roles that manage, interpret, and use AI insights, requiring new skills rather than outright job elimination across the board.

Worth sharing?

Get the best Finance stories of the week in your inbox — no noise, no spam.

Originally reported by Fintech Global

Stay in the loop

The week's most important stories from Fintech Rundown, delivered once a week.