Reading Settings

Text size Normal
Zen Mode Full focus on text
SAP ERP Intermediate

SAP and NVIDIA's AI Shift: Agents Take Control of Your Core ERP Execution

Executive Briefing
  • 01 80% of Fortune 500 companies are already using AI agents, yet only 47% have dedicated GenAI security controls — Microsoft Cyber Pulse.
  • 02 SAP's Joule Studio reached general availability on March 15, 2026, enabling AI agent orchestration across SAP and non-SAP systems — SAP Help Portal.
  • 03 Microsoft reported 160% YoY growth in paid Copilot seats and disclosed more than 500,000 agents created across customers — Microsoft Blog.
Rodolfo Oshiro

SAP & AI Strategist

March 20, 2026
9 min
SAP and NVIDIA's AI Shift: Agents Take Control of Your Core ERP Execution

The Agentic Tipping Point: From Assistance to Autonomous Execution

The race to embed autonomous AI agents is outpacing the enterprise's ability to govern them. While Microsoft reports that 80% of Fortune 500 companies are already using AI agents, less than half have established the dedicated security controls necessary to manage this new execution layer. This gap isn't just a technical oversight; it signals a fundamental shift where AI is moving from an assistive tool to an autonomous operator within core business systems.

The contradiction lies in the nature of adoption. Employees are driving usage from the bottom up—29% report using unsanctioned agents for work tasks—while strategic oversight lags. This creates a governance vacuum where autonomous actions are taken without a corresponding framework for accountability, audit, or value measurement. The technology is evolving faster than the operating models built to contain it.

The Adoption vs. Governance Gap

80%

Fortune 500 using AI agents

47%

With dedicated GenAI security controls

18%

Tracking AI ROI

This disparity reveals the tipping point. We are transitioning from AI that suggests an action to agentic AI that executes it. When embedded directly into ERP or service management platforms, these agents don't just recommend a purchase order or a ticket resolution; they autonomously create, approve, and route them based on learned or programmed logic. The control plane of business process execution is quietly shifting from human-driven workflows to AI-driven agents.

ℹ️

Agentic AI

AI systems that can autonomously execute multi-step tasks, make decisions within defined parameters, and interact with other software systems to achieve a goal, moving beyond simple question-answering.

The business implication is profound. As Thomson Reuters notes, organization-wide AI use in professional services nearly doubled to 40% in 2026, yet only 18% track its ROI. This means investments are scaling without a clear understanding of return, embedding automation where its impact—positive or negative—is largely unmeasured. The strategic risk is no longer adoption speed, but the loss of visibility and control over automated business logic.

The central question for leaders is no longer if agents will be used, but where the authority to act should be delegated.

TL;DR — Executive Summary

The recent wave of strategic partnerships, most notably between SAP and NVIDIA, signals a fundamental architectural shift in enterprise software. This is not a simple feature upgrade; it is a deliberate move to embed autonomous AI agents as the primary execution layer within core business platforms like ERP and CRM. The control of critical business logic is transitioning from human-operated workflows to automated, agentic systems.

This shift creates a strategic inflection point for technology leaders. The promise of unprecedented efficiency and responsiveness is real, but it arrives with a significant and immediate governance deficit. The industry is moving faster than our collective ability to manage the risks.

TL;DR — 3 Strategic Implications for Leaders

  • AI agents are being embedded as a core execution layer in ERP and workflow platforms, shifting control from human-led processes to automated systems governed by IT.
  • The governance deficit compounds with each new deployment — organizations adopting without controls are building AI technical debt that becomes harder to audit as their agent footprint scales.
  • Vendor strategies (e.g., Microsoft's Frontier Suite, SAP's Joule) are designed to bundle AI agents deeply into their ecosystems, accelerating platform dependency and centralizing buying decisions.

The vendor bundling strategy is a critical accelerant. By embedding agents directly into platforms like SAP S/4HANA or Microsoft Dynamics, vendors are not just selling a tool—they are architecting a new, more locked-in control plane for enterprise operations. Your next major platform decision will inherently be a decision about your AI operating model. To navigate this, leaders must look beyond the AI features and examine the underlying mechanics of control.

How SAP and NVIDIA Are Redefining the ERP Control Plane

SAP Joule’s recent General Availability is not a feature update; it is a simultaneous activation across core modules like Integrated Business Planning, S/4HANA Cloud, and Analytics Cloud. This platform-wide deployment signals a fundamental shift: AI is no longer a peripheral tool but the new execution layer for business processes. The target audience—business and IT decision-makers, enterprise architects—confirms this is an architectural change, not a departmental pilot.

This move, powered by NVIDIA's infrastructure, redefines the ERP control plane. The control plane is where operational decisions about resource allocation, process flow, and exception handling are made. For decades, this has been governed by human-defined workflows and rule engines. Joule Studio’s ability to orchestrate actions across SAP and non-SAP systems means AI agents are now being embedded to make and execute those decisions autonomously, from supply chain adjustments to financial reconciliations.

The implications are profound. When an AI agent within your ERP can autonomously execute a process—like re-routing shipments based on real-time logistics data or generating and posting journal entries—the locus of control shifts from human-operated procedures to the agent's reasoning and the data it accesses. This creates immense efficiency potential but also centralizes operational risk within the AI's decision-making logic, which is often opaque and non-deterministic.

Key Platform Launches — Q1 2026

2026-03-15

SAP Joule GA

Multiple core SAP modules gain embedded AI agent capabilities.

2026-03-09

Microsoft Frontier Suite

Bundles Agent 365 with M365 E7 and Copilot for $99/user.

2026-02-26

ServiceNow Autonomous Workforce

Launches role-based AI agents for IT, HR, and security ops.

2026-03-17

Alibaba Wukong Beta

Enterprise AI agent platform launch via DingTalk's 20M+ users.

SAP’s launch is not an isolated event but part of a concentrated industry pivot in Q1 2026, as shown by concurrent releases from Microsoft, ServiceNow, and Alibaba. This convergence validates the architectural shift but also creates a vendor-driven acceleration that can outpace an organization's ability to establish governance. The strategic question is no longer if AI will execute core processes, but how to govern systems where it does.

ℹ️

ERP Control Plane

The core set of logic and systems that governs how business processes are executed, including workflow routing, decision rules, exception handling, and system orchestration. It is the "brain" of operational execution.

The integration with NVIDIA is particularly strategic, providing the computational scale for real-time, complex agentic reasoning across massive datasets. This turns the ERP from a system of record into a system of action, but one whose actions are increasingly dictated by embedded AI. The resulting efficiency gains are real, yet they come with a new form of vendor lock-in and a critical, unanswered question: who controls the controller? This governance vacuum is where the most significant operational risks are now accumulating.

Why Leaders Should Worry About the Agent Governance Gap

The promise of embedded AI agents is a managed, centralized automation layer. Yet the speed of deployment is creating a dangerous asymmetry where autonomous systems act on business data without corresponding frameworks for security, approval gates, or performance measurement. According to the Microsoft Cyber Pulse report, these agents can become 'invisible threats' if they are not observed and controlled, directly linking technical deployment to unmanaged business risk. This isn't a future concern; a Thomson Reuters study found less than one-third of professionals know if their firm is using AI on client matters, highlighting a profound visibility gap.

The core tension for leadership is not whether to adopt agentic automation, but how to govern it. The market momentum is toward decentralized, business-led experimentation, with 29% of employees already using unsanctioned AI agents. This creates a fundamental dilemma: pursue the opportunity of a governed platform or accept the risks of unmanaged proliferation.

The unchecked adoption path leads to an unsustainable end-state: invisible automation with no accountability. The critical failure is not technical but strategic—without governance, you cannot measure value or manage risk. This gap turns a potential efficiency engine into a liability, where automation amplifies existing chaos rather than creating new control. The governance question, therefore, defines where you can safely start.

Where to Not Start with Embedded AI Agents

Pursuing embedded AI agents as a universal solution is the highest-risk strategy for organizations lacking foundational control. The allure of autonomous execution obscures a critical prerequisite: agentic automation amplifies existing organizational weaknesses into systemic failures. Starting without the right groundwork guarantees wasted investment and introduces severe operational and compliance risks.

The data reveals a readiness chasm. According to Thomson Reuters, only 18% of firms track ROI for AI, and less than one-third have visibility into whether AI is used on client matters. This isn't a technology gap—it's a governance black hole. Deploying agents into such an environment is like automating a factory where no one knows the location of the emergency stop button or the bill of materials.

Anti-Portfolio Criteria — When to Say 'Not Yet'

  • Processes are not documented or standardized: If you cannot map the human workflow step-by-step, you cannot instruct an agent to execute it reliably.
  • Core data sources are fragmented or of poor quality: Agents acting on inconsistent or siloed data will produce flawed, unpredictable outputs.
  • No foundational IT governance exists: If you lack basic controls for system access, change management, and auditing, adding autonomous agents introduces unmanageable risk.
  • Business ownership and success metrics are unclear: Without a clear process owner and defined KPIs (beyond cost reduction), measuring agent ROI and value is impossible.

These criteria form a vital litmus test. The first two points address process and data integrity—the fuel and map for any agent. The latter two address organizational readiness: you cannot govern what you do not control or measure. An agent executing a poorly defined procurement process doesn't create efficiency; it institutionalizes error at machine speed.

⚠️

The Amplification Effect

Embedded agents do not fix broken processes; they automate and scale their flaws. A human might spot an anomaly in a chaotic workflow. An agent will diligently execute the chaos.

The strategic imperative is to resist vendor-led pilots in these high-risk areas. The pressure to "start somewhere" must be met with a disciplined, criteria-based exclusion list. This prevents the disillusionment that stems from predictable failures in complex, undocumented domains like custom client reporting or cross-departmental reconciliation.

The real starting point is not a technology selection, but a clear-eyed assessment of where your organization is definitively not ready.

What Leaders Need to Decide Now

The window for a passive 'wait-and-see' approach has closed. With major vendors like Microsoft bundling agent suites and SAP enabling cross-system orchestration, the future enterprise architecture is being actively shaped by these platform integrations. Your organization's foundational posture must now be chosen, as this decision will dictate your agility, risk profile, and cost structure for the next decade.

The core strategic choice is between committing to a primary vendor's integrated ecosystem or building a multi-vendor orchestrated layer. This is not merely a technical preference but a fundamental business strategy that defines your operational control and vendor leverage.

Strategic Posture: Platform Standardization vs. Best-of-Breed Agility

Commit to a Primary AI Platform Vendor Pursue a Multi-Vendor, Orchestrated Approach

✓ Pros

  • + Leverage deep, native integration with existing ERP/workflow systems (e.g., Joule in SAP, Agent 365 in Microsoft 365).
  • + Gain bundled pricing and simplified governance through a single vendor's security and compliance framework.
  • + Accelerate deployment by using pre-built agent templates and connectors for common processes.

✗ Cons

  • Accelerates deep dependency (lock-in) on a single vendor's ecosystem for identity, data, workflows, and AI capabilities.
  • Limits ability to adopt best-in-class specialized agents from other vendors due to integration and management overhead.
  • Consolidates buying power, potentially reducing negotiation leverage on future pricing.

✓ Pros

  • + Preserves flexibility to choose specialized agents for specific functions (e.g., ServiceNow for IT ops, standalone finance agents).
  • + Avoids over-reliance on one vendor's roadmap and pricing power.
  • + Can foster internal innovation by treating the agent layer as a composable architecture.

✗ Cons

  • Introduces massive integration, security, and governance complexity, requiring mature internal platform engineering.
  • Likely higher total cost of ownership due to integration efforts and managing multiple vendor relationships.
  • Slows time-to-value as orchestration layers and unified controls must be built and maintained in-house.

Standardization offers speed and simplicity but at the cost of strategic flexibility. The bundled pricing of suites like Microsoft's Frontier Suite creates immediate financial appeal, yet it subtly transfers long-term control. Conversely, a multi-vendor approach demands significant internal platform maturity to manage the orchestration complexity that tools like SAP Joule are beginning to abstract away.

💡

The Vendor Bundling Clock is Ticking

Vendor-led bundling, like Microsoft's $15/user Agent 365 suite, creates powerful economic and integration incentives that make delaying a platform choice increasingly costly. Indecision itself becomes a path to de facto lock-in.

Your decision must be grounded in an honest assessment of organizational readiness. Do you have the engineering maturity to build and govern an orchestration layer, or is consolidating risk under one vendor's framework the more prudent path? The next quarter requires moving from observation to concrete allocation of budget and authority for this new control plane.

Next Steps

The strategic window for shaping how AI agents will operate inside your enterprise is not a multi-year horizon—it is the next fiscal quarter. Waiting for clearer standards or a dominant vendor to emerge is a decision in itself, one that cedes control to shadow IT initiatives and locks you into reactive, tactical responses. The convergence of platform releases and the documented governance gap create a tangible urgency that demands immediate, structured action.

The objective for the next 90 days is to move from awareness to controlled experimentation, establishing the foundational governance and strategic clarity needed to engage with vendors from a position of strength. This is not about a full-scale rollout, but about creating the internal capability and evidence base to make informed, deliberate choices.

Next Steps — A 90-Day Action Plan

  • Conduct a 30-day discovery and inventory: Task IT security and compliance teams to identify all sanctioned and unsanctioned AI agent use (shadow AI) across the organization, using the 29% benchmark as a risk indicator.
  • Launch a 60-day governance pilot: Select one well-defined, medium-complexity process (e.g., IT ticket routing, purchase order approval) and implement a controlled agent pilot with clear metrics, approval gates, and an audit trail, directly addressing the ROI tracking gap.
  • Make a deliberate platform decision: Based on pilot learnings and existing vendor relationships, convene a cross-functional leadership meeting to decide on the strategic posture (platform commitment vs. multi-vendor orchestration) before the next vendor contract or renewal cycle.

The inventory phase is a critical risk-mitigation exercise, transforming the abstract "shadow AI" concern into a concrete asset register. The subsequent pilot must be treated as a governance prototype, not a proof-of-concept for the technology itself. Its primary deliverable is a validated framework for oversight, accountability, and value measurement that can be scaled.

Start with Control, Not Complexity

The ideal pilot process is not your most valuable workflow, but one that is well-documented, has clear decision rules, and operates in a contained data environment. Success is measured by governance efficacy first, efficiency gains second.

This disciplined, three-phase approach ensures that when platform vendors arrive with their embedded agent roadmaps, your organization is not evaluating them based on feature lists alone, but through the lens of your own established operating model and control requirements. The goal is to ensure the agent serves the enterprise, not the other way around.

Found this useful?

Share it.

Next

Public AI Adoption Hits 83%, But Legal Rulings Force IT Leaders to Restrict Access

Enterprise AI adoption has reached mass scale, but recent legal rulings expose critical confidentiality gaps. Leaders must shift from enabling access to governi

Read next
Public AI Adoption Hits 83%, But Legal Rulings Force IT Leaders to Restrict Access
Keep Reading

Related Articles

Direct Line

Working through a SAP or AI decision? Let's think through it.

Strategy questions, implementation challenges, or a different perspective on what you're navigating — a conversation costs nothing.