How agentic AI will self-assemble the enterprise stack

For more than a decade, application modernization has been viewed as a blueprint challenge or roadmap discipline. Organizations mapped their assets, created transformation frameworks, developed cost models and pushed execution through human-led programs. With external uncertainties, changing regulatory demands and competitive trends, CIOs’ strategic priorities have shifted between enterprise architectures, cloud and hybrid cloud models, automation, cybersecurity, compliance and now AI/GenAI. The agenda is straightforward and unchanged, continuous modernization for operational efficiency, model resilience and value creation.

Despite years of investments in cloud, Kubernetes, DevOps and platform engineering, many CIOs realize that the modernization acceleration largely remained static, planned by committees, executed as projects and governed by constrained, project-centric roadmaps. A BCG 2025 study reveals that only 5% of companies have achieved AI value at scale, while 60% report no material returns despite substantial investment. Even with an average GenAI spend of $1.9 million in 2024, fewer than 30% of AI leaders say their CEOs are satisfied with the AI investment returns.

The underlying application modernization pattern is now at a straining point as enterprise IT has entered a structural transition. With the advent of agentic AI, application modernization will see autonomy extend at the automation layer across the decision to execution journey. These systems bring self-assembling abilities that can organize, sequence and reconfigure modernization workflows across broad architectural layers and granular operating models. Yet the risk is structural, not technical. Gartner signals that over 40% of agentic AI initiatives will be discontinued by 2027 due to weak governance, unclear ROI, cost overruns and role–skill mismatch. The real crux lies in whether modernization success will stand on technology access and maturity, or how enterprises calibrate cultural and organizational readiness, governance mechanisms and the trust models to let autonomy actually work responsibly.

Organizations are now recognizing that modernization speed is no longer limited by strategic goals, access to technology or execution models. It is the human ability to understand and redesign a complex, interdependent stack faster than it evolves. Cloud reveals this issue. It simplified the infrastructure but increased the number of fragmented components. It raised abstraction but also expanded integration points. It streamlined deployment but increased architectural choices. Complexity spread faster than simplification. McKinsey’s State of AI 2025 global survey shows that while nearly nine in ten organizations now use AI regularly, only about one-third have scaled beyond pilots and experimentation.

Companies that once refreshed their systems every few years now feel quarterly pressure from cloud costs, customer experience expectations and shifting regulations. Application estates have become too large and heterogeneous for human-led modernization to keep pace. Modern enterprises are already churning the improvement levers, expanding cloud adoption, refactoring monoliths, enabling APIs, automating test and deployment pipelines and decomposing operational backlogs. Agile sped up delivery. DevOps automated pipelines. FinOps controlled cloud spending. Cloud gave flexibility and optionality. Yet the modernization gap persists between the pace of modernization and the rate of change. By the time modernization starts materializing, the business context has already shifted. With AI, this pattern is no different. Accenture’s survey of 2,000 companies finds that only about 8% have scaled AI at an enterprise level and embedded it into core business strategy.

Application modernization today is emerging beyond the unvarying roadmap-led, plan-and-control model. Modern estates are telemetry-rich, policy-driven and increasingly capable of autonomous reasoning and decision-making, which can be broadly classified as Agentic AI. The point is not that AI takes over modernization. It means the system becomes self-aware enough to refactor dependencies, adjust routing or optimize placement with bare human intervention or authorization chains. Here, the application stack self-examines its performance and makes adjustments based on cost, compliance, latency or demand.

Modernization becomes continuous, autonomous and dynamic, not periodic, human-managed and project-based. This shift is rather misconceived as technical optimism, but interestingly, its deeper implications are cultural and psychological. Technology tends to move faster than culture adapts and agentic models challenge long-standing assumptions about authorship, control and accountability in enterprise IT. For decades, architects have authored plans, developers have built them, committees have validated them and change management protects the timelines. Leaders held sovereignty through sign-off. Agentic autonomy breaks this equilibrium. Architects become policy stewards, setting constraints rather than planning detailed blueprints. Developers become validators rather than makers. Change management loses time as a control mechanism.

This raises a new leadership conundrum; when AI-driven systems reconfigure itself then who will own the outcomes? The real debate is not new versus old technology, nor the outdated autonomy versus human control narrative. It is about how enterprises pair autonomous technology with the cultural, organizational, governance and trust conditions required for autonomy to work. The accountability shift caused by autonomy aggravates the leadership readiness tension. McKinsey finds that employees are more prepared for AI than their leaders imagine, while a Gartner survey reports that only 15% of IT leaders are piloting fully autonomous agents and just 13% believe their governance structures are adequate to manage them.

Foundry’s State of the CIO research shows that as 82% of CIOs now define their role around digital and innovation leadership and 75% collaborate closely with business units on AI initiatives, modernization increasingly hinges on cross-functional governance and shared accountability. CIOs can argue the efficiency benefits of autonomy and boards can argue its competitive advantage, but the accountability structure changes in ways that are more fundamental.

Unlike the conventional model, where architects led execution and owned the outcomes, the autonomous model distributes ownership across humans, policies and machine agents. BCG reports that agentic architectures can deliver 20–30% faster workflow cycles and reduce tedious manual burden by up to 40%, but only when autonomy operates within governed, interoperable and policy-driven enterprise platforms. Autonomy does not override governance; it recalibrates it. Governance shifts from command-led to outcome-led, from plan sign-off to policy sign-off and from architectural authorship to architectural stewardship. The control surface also changes. The system becomes self-observing and self-correcting based on feedback loops rather than human foresight.

The shift to autonomous modernization flips the traditional question. CIOs once asked, ‘What is the business case to modernize?’ In today’s scenario of self-optimizing estate, the more relevant question becomes, ‘What is the business case to stop?’ When modernization becomes continuous, pausing it becomes the anomaly. Competitive advantage no longer lies in how quickly workloads move to cloud, but in how effectively the organization governs autonomous change. In that scenario, the modernization stack itself becomes a strategic differentiator.

For CIOs, this shift also forces a change in mental models. The prevailing logic has been plan-and-control: design, approve, execute and then measure. The agentic model works on sense-and-respond: observe continuously, decide autonomously, adjust incrementally and govern through policy. One depends on upfront completeness; the other depends on ongoing feedback. An empirical BCG study reinforces this shift, showing that nearly 70% of AI failures stem from people and process issues, with just 20% attributed to technology and 10% to algorithms, emphasizing why governance design must evolve in step with autonomous ambition. The organizational challenge is not only technical readiness but also cultural readiness to operate in an environment where modernization no longer pauses for meetings.

In earlier AI waves, the constraint was technical capability. Today, technical competency is largely a matter of accessibility and continued investment, but the real barrier is governance, culture and trust. These institutional disciplines require new organizational skills, new accountability structures and policy frameworks that define how autonomy is monitored, constrained and escalated. The problem is no longer whether systems can modernize; it is whether leadership can tolerate modernization that does not stop.

The question ahead for CIOs is not how to modernize faster, but how to govern autonomy at scale and close the cultural readiness gap before unlocking the efficiency, scale and responsiveness agentic modernization enables.