The AI reckoning every CIO saw coming (and still wasn’t ready for)

Earlier this year, the National Bureau of Economic Research released survey results from over 6,000 U.S. leaders showing that while AI adoption is widespread at 69%, we’re seeing little to no impact on productivity. Anecdotally, we’ve seen leaders from top companies echo that refrain.

It’s the reckoning many CIOs, CTOs and COOs are navigating as we enter the last half of the year. The most humbling part is knowing it’s a management problem we created by treating AI like it was exempt from the rules we apply to every other enterprise tool.

Part of this has to do with how AI entered the market. The tools that sparked its mainstream adoption arrived as consumer products before enterprises had governance frameworks to absorb them. Enterprises were left playing catch-up as they grappled with IP and data security concerns, inadvertently fueling shadow AI as employees leveraged these tools to get ahead and eventually, keep pace, at work. What this created was a sense of entitlement that is challenging to unravel.

Like the internet writ large, employees have grown to expect unlimited access, and organizations played along. But this idea warrants a pause. When did we last roll out Salesforce to everyone who asked without a use case? AI got a pass because it felt different. In truth, it isn’t. It’s another tool that enterprises need to manage.

Three levels every information and technology leader has to solve

It’s helpful to look at this as a three-level evolution framework.

Level one is adoption — are people actually using it well? Level two is budget control — what are we spending and on what? Level three is justification — can we demonstrate the return?

Most companies are still at level one. Deloitte reported in their 2026 State of AI in the Enterprise report that only 25% of respondents have moved 40% or more of their AI experiments into production to date. The minority that have moved pilots to production are grappling with the budget and trying to figure out how to justify the costs and quantify the gains.

The problem is, you can’t prove what you didn’t have to hire because of AI. There is no parallel universe where you can walk into the CEO’s office and say I need five more people in finance, but in this universe, with AI, I didn’t.

The organizations that wait for a clean ROI model before making any decisions will spend themselves into the trough of disillusionment before they find one. The smarter move is to start treating it as a discipline you build.

What managing AI like a tool actually looks like

To some, governance sounds like restriction. But the discipline is more about matching the right tool to the right use case, and making the sanctioned path easier than the workaround.

Take shadow AI. The instinct is to lock things down. But when employees start building internal apps with company data and hosting them on free public platforms, the answer isn’t another policy. By the time the policy is written, the data is already public. Instead, you need to build an internal alternative that does the same thing without the exposure. Give people a path. If you don’t, they build their own, and you won’t know about it until something goes wrong.

The same principle holds for conflicting data. Two departments pulling AI-generated recommendations from the same underlying data and arriving at different conclusions isn’t an AI problem. It’s a data and definitions problem. AI just made it impossible to ignore. Say marketing claims they brought $50 million in the pipeline, and sales claim they brought $50 million as well.But the company actually has $75 million in pipeline. Someone is counting the same deals twice under different definitions. The CIO’s job is to enforce one source of truth. If your dashboard doesn’t match the authoritative one, your dashboard is wrong. That’s the only way the organization can function.

And it applies to cost, too. Not every workflow needs the most expensive model. Not every employee needs full AI access. If someone is using a top-tier model to summarize email because nobody told them there was a cheaper option that does the job, that’s a gap that CIOs need to address. The CIO’s job is to build the layer that makes the right choice the obvious one, and to provide sanctioned alternatives so employees aren’t left building their own.

That’s what actually reduces shadow AI, conflicting data and runaway spend: Alternatives, visibility and a single source of truth.

The CIOs getting real value from AI right now aren’t the ones who said yes to everything. They’re the ones who asked the same questions they’d ask about any other enterprise investment: What does it do, who actually needs it and what are we getting back?

AI is a remarkable tool. It’s also just a tool. It doesn’t exempt you from the management discipline you apply to every other system in your stack. We didn’t roll out Salesforce to everyone who asked without a use case. We shouldn’t have done it with AI either, and the organizations that did are now living with the consequences:  Six-figure token bills, shadow apps on public URLs, dashboards that contradict each other and a CEO asking what exactly he got for the investment.

The answer to that question is available. But only if you built the infrastructure to find it.