ARTIFICIAL INTELLIGENCE
AI agent deployments surge telemetry expenses and network complexity
New Cisco Splunk research shows AI agents generate up to five times more telemetry data than standard apps, leading to massive unexpected billing spikes.
- Read time
- 5 min read
- Word count
- 1,198 words
- Date
- Oct 20, 2026
- Key Takeaways:
- Enterprises report that AI agents emit four to five times more telemetry data than traditional production applications.
- The Cisco Splunk State of Observability 2026 report found that 57 percent of organizations spend more on monitoring than on the infrastructure itself.
- Exactly 38 percent of companies have reduced their data retention or coverage specifically to manage spiraling telemetry costs.
- A significant 60 percent of surveyed professionals state that unexpected billing spikes cause more operational strain than high base costs.
🌟 Non-members read here
AI agents are significantly increasing telemetry expenses and making network oversight more difficult as companies struggle to monitor new technologies. A recent study reveals that these automated systems produce massive amounts of data, leading to budget overruns and visibility gaps. Executives now face the challenge of balancing innovation with rising operational costs.
Excessive Data Volume and Financial Impact
The rapid adoption of AI agents has introduced a significant financial burden for modern enterprises. According to the State of Observability 2026 report, over half of the surveyed organizations now pay more for monitoring tools than for the actual infrastructure they watch. This shift suggests that the data generated by these systems has become more expensive to manage than the servers running them.
Cisco Splunk researchers found that a single production agent produces roughly four to five times the amount of telemetry data compared to traditional software. This happens because agents do not just execute code; they perform complex workflows and constant model interactions. They also handle tool calls and retrieved context, each of which leaves a digital trail.
When multiple agents interact within a single session, the volume of data grows at an exponential rate. These systems act as both creators and users of machine information, which creates a compounding effect on storage and processing needs. IT leaders find it increasingly difficult to predict monthly expenses because of these fluctuations.
The study indicates that 60 percent of businesses experience more stress from sudden billing spikes than from high fixed costs. These unpredictable surges force engineering teams to pivot from development tasks to budget management. Consequently, 55 percent of organizations admit they lack the necessary tools to accurately track or limit their spending on AI-related monitoring.
The Origin of High Monitoring Costs
While AI is a growing factor, it is not the only culprit behind rising budgets. Only 6 percent of IT professionals blame AI hardware as their primary expense driver. Instead, traditional issues like noisy logs and high-cardinality metrics continue to dominate the spending landscape.
Noisy logs account for 31 percent of the primary cost drivers identified by respondents. High-cardinality metrics follow closely behind, representing 27 percent of the financial pressure. These existing problems combine with the new data streams from AI agents to create a perfect storm of operational overhead.
Sacrifice of Historical Data
To combat these rising prices, many organizations are taking drastic measures that could harm long-term stability. About 38 percent of companies have started cutting back on how much data they collect or how long they keep it. While this reduces the bill, it creates dangerous blind spots for network administrators.
Shortened retention periods mean that teams cannot perform deep historical investigations when something goes wrong. If a network issue is intermittent or happened weeks ago, the evidence may have already been deleted. This trade-off saves money today but increases the risk of unresolved system failures in the future.
Challenges in Managing Autonomous Systems
Monitoring AI agents requires a different approach than watching traditional applications. Organizations must ensure these agents stay within their programmed boundaries and provide accurate information. However, the study shows that most companies are not prepared for this level of detailed oversight.
A significant 87 percent of IT professionals agree that monitoring these workloads is a top priority for their department. Despite this consensus, the actual execution remains a struggle for nearly half of the market. Technical limitations and a lack of clear internal policies continue to hinder progress.
One major hurdle is the inability to measure the quality of outputs. Fifty-six percent of organizations cannot track metrics like the accuracy or relevance of responses from large language models. Without these insights, companies may be deploying agents that provide incorrect information to customers or employees without anyone knowing.
Furthermore, 49 percent of respondents feel their current software lacks the specific features needed for AI oversight. Standard tools are often designed for simple pass-fail metrics, not for the nuanced behavior of autonomous agents. This gap leaves engineers guessing about the health of their AI deployments.
Confusion Over Internal Responsibility
The survey highlights a significant organizational problem regarding who owns the monitoring process. Thirty-eight percent of respondents say their companies have not yet decided which team is responsible for AI oversight. This lack of clarity often leads to critical tasks being ignored.
When responsibility is not defined, security vulnerabilities can go unnoticed. Network teams might assume the AI developers are watching the traffic, while developers assume the operations team has it covered. This ambiguity creates a vacuum where errors and security threats can thrive.
Collaboration Between Departments
On a positive note, the complexity of AI is forcing different departments to work together more closely. Eighty-one percent of professionals report increased cooperation between security and observability teams. This shift is necessary because the line between a functioning agent and a security threat is often thin.
An AI agent that makes repeated API calls might look exactly like a distributed denial-of-service attack to an automated security system. Only by sharing data can these teams distinguish between a busy agent and a malicious hacker. This integration of workflows is becoming a standard requirement for modern IT departments.
Strategic Solutions for Network Visibility
Managing the influx of data requires a shift in how companies process their telemetry. Rather than simply collecting every byte of information, teams must become more selective about what they store. Technology experts suggest using vendor-neutral tools to gain better control over the data pipeline.
One recommended approach is the use of the OpenTelemetry Collector. This tool acts as a middleman that can process and filter data before it reaches an expensive storage platform. By using this technology, companies can tag the sources of their traffic and identify exactly which agents are generating the most noise.
This strategy allows network teams to manage their budgets without losing the ability to troubleshoot. They can choose to keep high-priority logs while discarding redundant information. It also provides a clear view of how much infrastructure each agent consumes, making it easier to charge costs back to the correct department.
Redefining Quality and Performance
The definition of a successful network is changing as AI agents become more prevalent. It is no longer enough to measure simple uptime or latency. Hathi suggests that organizations must reach an agreement on what quality looks like for each specific use case.
Tools cannot decide if an AI response is “good” without human-defined parameters. Companies must invest in the skills necessary to turn abstract quality goals into measurable technical evaluations. This requires a mix of data science knowledge and traditional network engineering.
Navigating the Future of Observability
The long-term success of AI in the enterprise depends on solving the telemetry cost crisis. If monitoring expenses continue to outpace infrastructure costs, the financial viability of these projects will come into question. Network teams are now at the center of this transition.
They must find the balance between having enough data to fix problems and keeping the bill at a reasonable level. This task involves moving away from the “collect everything” mindset toward a more tactical approach to data management. Those who master this balance will be able to scale their AI initiatives safely and affordably.
References
- Attribution: Valentin Podkamennyi, VP Insights
- Citations: AI agents drive up telemetry costs, complicate network observability, Network World
- Mentions: Artificial intelligence, OpenTelemetry
- About: Cisco Systems, Splunk