---
title: "LLM and Agentic Observability: review, setup & limitations · Undominated.ai"
canonical: https://undominated.ai/skills/elastic-observability-llm-obs/
description: "Answers LLM latency, token, cost and call-chain questions from telemetry already in Elastic, and says so when cost is not instrumented."
---

# LLM and Agentic Observability: review, setup & limitations · Undominated.ai

> Answers LLM latency, token, cost and call-chain questions from telemetry already in Elastic, and says so when cost is not instrumented.

[← Explore all skills](/skills/)

OBSERVABILITY / Elastic

# LLM and Agentic Observability

Answers LLM latency, token, cost and call-chain questions from telemetry already in Elastic, and says so when cost is not instrumented.

 [See setup guidance ↓](#setup)[Original source ↗](https://github.com/elastic/agent-skills/tree/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs)

SOURCE REVIEW

 Reviewed 2026-10-13
 Evidence 5 linked sources
 Publisher Elastic
 Licence [Apache-2.0 ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/LICENSE)
 Revision baa511126ba2
 [Read what was—and wasn’t—checked ↓](#review)

“Answer questions about LLM and agentic-application behavior from data already ingested into Elastic: latency and error rate, token and cost utilization, response quality and guardrail events, and agentic call-chain orchestration. Use when the user asks about LLM monitoring, GenAI observability, token spend or AI cost, model latency, prompt or guardrail failures, or how an agent's tool-call chain executed.”

 [Elastic · upstream description ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs/SKILL.md) Our analysis follows below.

01 / THE REASONING

## Why this made the selection.

 - If no cost field exists, the file says to report that cost is not instrumented and never multiply token counts by a guessed per-token price.
- Zero rows means data is missing or not collected, never that the condition is healthy, and ingestion paths and GenAI field names are discovered rather than assumed.

### A good fit for

 - Reporting LLM token use and latency by model or service from Elastic data
- Reconstructing an agent's tool-call chain from traces

### Weigh up before choosing

 - The time-series path needs Elasticsearch Stack 9.4 or Serverless; below that the file falls back to FROM with BUCKET, with a base floor of 8.11.
- Queries run through the elastic CLI (>= 0.2) and the file says not to call the HTTP API directly. The three reference files were not opened.
- The README marks the repository as Technical Preview. The plugin and installer commands do not pin this revision.
- When no cost field exists, the source requires reporting cost as uninstrumented; token counts must not be multiplied by an assumed price to invent a cost figure.

02 / THE REVIEW RECORD

## What we actually inspected.

Source review has boundaries. A clear record is more useful than a “safe” badge.

### Material inspected

 - skills/observability/llm-obs/SKILL.md (compatibility, environment, output discipline, data locations, discovery process, cost questions, operations table)
- README.md (skill table, security considerations, getting started)
- LICENSE Apache-2.0, copyright 2026 Elasticsearch BV

### Our findings

 - Only traces can rebuild a call chain; with integration metrics alone the file says to state that the chain cannot be reconstructed.
- The file notes that cost is not part of the OpenTelemetry GenAI specification.

### Not established by this review

 - The installer was not run, and the skill was not executed against a project or service. No query was run and no deployment was contacted.
- references/esql-recipes.md, genai-fields.md and integrations.md were not opened.
- Not executed: it was not installed or run.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

## Add a skill to your workflow.

[Upstream setup instructions ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/README.md)

DOCUMENTED COMMAND

 claude plugin marketplace add https://github.com/elastic/agent-skills Copy command ↗

Copying does not execute this command. It may retrieve a newer version than the reviewed source.

 - The README then installs the observability group with claude plugin install elastic-observability@elastic-agent-skills, and advises installing only the skills you need.
- Neither command pins revision baa511126ba2dc37b52e273b52734f8e4e0d323c. Compare the installed SKILL.md and references with that revision.
- The README advises minimum-privilege API keys with read-only access as the default.

### Before you start

 - Claude Code for the plugin path
- The elastic CLI (>= 0.2) configured for a deployment holding LLM telemetry

### Compatibility

Agent Skills-compatible hosts · Claude Code · Cursor · GitHub Copilot · Windsurf · Gemini CLI · Elasticsearch 8.11+ or Serverless

### Elastic CLI read queries against a deployment

 - Runs GET discovery calls and POST /_query ES|QL queries through the elastic CLI.
- Reads trace, metrics and logs data streams, which can contain prompts and responses.

### Cost model

Source is Apache-2.0. Elastic Cloud or self-managed clusters can incur charges. Those charges were not measured.

04 / FOLLOW THE EVIDENCE

## The source trail.

Our notes are separate from the original resource. Check upstream before adopting a new version.

 - [Skill definition ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs/SKILL.md) Checked 2026-10-13 https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs/SKILL.md Supports: summary, upstreamDescription, whySelected, limitations, access, review
- [Install instructions and skill index ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/README.md) Checked 2026-10-13 https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/README.md Supports: install, compatibility
- [Repository licence ↗](https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/LICENSE) Checked 2026-10-13 https://github.com/elastic/agent-skills/blob/baa511126ba2dc37b52e273b52734f8e4e0d323c/LICENSE Supports: license
- [2026-10-15 C2-W39 source re-review at the existing pin ↗](https://raw.githubusercontent.com/elastic/agent-skills/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs/SKILL.md) Checked 2026-10-15 https://raw.githubusercontent.com/elastic/agent-skills/baa511126ba2dc37b52e273b52734f8e4e0d323c/skills/observability/llm-obs/SKILL.md Supports: upstreamDescription, review.notTested, limitations
- [2026-10-15 C2-W39 source re-review at the existing pin ↗](https://raw.githubusercontent.com/elastic/agent-skills/baa511126ba2dc37b52e273b52734f8e4e0d323c/README.md) Checked 2026-10-15 https://raw.githubusercontent.com/elastic/agent-skills/baa511126ba2dc37b52e273b52734f8e4e0d323c/README.md Supports: install.command

KEEP COMPARING

## Other approaches to consider.

Related by category or shared topics. These are alternatives to inspect, not a measured quality order.

 [### Elasticsearch ES|QL ↗ Pins Elastic's ES|QL skill, which routes queries through the elastic CLI and refuses to treat a Serverless build number as a feature gate.](/skills/elastic-esql/)[### Arize Instrumentation Health ↗ Read-only audit of exported Arize spans for nine instrumentation defects, including missing token counts behind empty cost dashboards.](/skills/arize-ai-arize-instrumentation-health/)[### Elasticsearch Cluster Health ↗ Triage unassigned Elasticsearch shards through allocation evidence.](/skills/elastic-elasticsearch-cluster-health/)

 [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)[Workflows ↗](/workflows/)

## Continue your investigation

 - [Choose a toolkit](/tools/)
- [Inspect execution hosts](/agents/)
- [Check tool access](/mcp-servers/)
- [Check project dependencies](/check-repo/)
