--- title: "Datadog LLM Observability Instrumentation: review, setup & limitations · Undominated.ai" canonical: https://undominated.ai/skills/datadog-labs-dd-instrument-llmo/ description: "Instruments a Python or Node.js/Next.js backend with Datadog LLM Observability, auditing session-ID plumbing and persisting the dependency before reporting." --- # Datadog LLM Observability Instrumentation: review, setup & limitations · Undominated.ai > Instruments a Python or Node.js/Next.js backend with Datadog LLM Observability, auditing session-ID plumbing and persisting the dependency before reporting. [← Explore all skills](/skills/) AI APPLICATION DEVELOPMENT / Datadog Labs # Datadog LLM Observability Instrumentation Instruments a Python or Node.js/Next.js backend with Datadog LLM Observability, auditing session-ID plumbing and persisting the dependency before reporting. [See setup guidance ↓](#setup)[Original source ↗](https://github.com/datadog-labs/agent-skills/tree/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo) SOURCE REVIEW Reviewed 2026-10-15 Evidence 8 linked sources Publisher Datadog Labs Licence [MIT ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/LICENSE) Revision 9f3a8b065be6 [Read what was—and wasn’t—checked ↓](#review) “Instrument the current project with Datadog LLM Observability for Python or Node.js/Next.js backends that call LLMs or run AI agents. Detects the runtime and LLM framework, provisions credentials, adds SDK init (ddtrace/dd-trace) with the correct kwargs, persists the dependency into the deploy manifest, and audits session-ID plumbing for gaps — fixing them when found. …” [Datadog Labs · upstream description ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md) Our analysis follows below. 01 / THE REASONING ## Why this made the selection. - Runs detection before editing: runtime, LLM framework, app framework, existing instrumentation, and the manifest to persist into are all identified in Phase 1. - Audits session-ID plumbing for gaps and fixes them, with separate Python and Node.js references plus shared credential and verification-report references. ### A good fit for - Adding trace-level cost and quality visibility to an app that calls LLMs - Checking or repairing an existing LLM Observability setup ### Weigh up before choosing - Edits source and dependency manifests, so every change needs review and a test run before it ships. - Covers Python and Node.js/Next.js backends only; other runtimes fall outside its routing table. 02 / THE REVIEW RECORD ## What we actually inspected. Source review has boundaries. A clear record is more useful than a “safe” badge. ### Material inspected - dd-instrument-llmo/SKILL.md - dd-instrument-llmo/references/llmobs-python.md - dd-instrument-llmo/references/llmobs-nodejs.md - LICENSE ### Our findings - Ground rules scope the work to the detected backend before any file is written. - The routing table separates analysis, instrumentation, and verification with per-runtime references. ### Not established by this review - No backend was instrumented and no Datadog credentials were provisioned. - Span emission, session linkage, and dashboard behavior were not observed. - Not executed: it was not installed or run. The review applies to the material and revision named here. A newer upstream release can change its behavior. 03 / PUT IT TO WORK ## Add a skill to your workflow. [Upstream setup instructions ↗](https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/README.md) DOCUMENTED COMMAND npx skills add datadog-labs/agent-skills/dd-instrument-llmo --skill dd-instrument-llmo Copy command ↗ Run in your terminal to choose your AI tools, project or global scope, and installation method. This short command follows the current upstream version; the review covers the revision shown above. Optional: install the reviewed revision Keeps the original source and installer version where recorded, while leaving your AI tools and installation scope for you to choose. npx skills add https://github.com/datadog-labs/agent-skills/tree/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo --skill dd-instrument-llmo Copy reviewed-revision command ↗ - Install the complete skill directory with its references; a copied SKILL.md alone is incomplete. - Choose your AI tools and project or global scope in the installer, then review its permissions before using the skill. ### Before you start - Node.js/npm for this installer - An agent that supports the Agent Skills format - A Datadog account with API credentials and permission to edit the backend and its manifest ### Compatibility Agent Skills-compatible coding agents · Python (ddtrace) and Node.js/Next.js (dd-trace) backends calling LLMs ### Backend code and Datadog credentials - Read backend source, manifests, and existing instrumentation - Edit SDK init code and dependency manifests when authorized - Provisioning credentials and emitting spans touches billable observability usage ### Cost model The skill text is MIT-licensed; Datadog usage, LLM calls, and agent calls have their own costs. 04 / FOLLOW THE EVIDENCE ## The source trail. Our notes are separate from the original resource. Check upstream before adopting a new version. - [Skill definition at reviewed revision ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md) Checked 2026-10-13 https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md Supports: summary, upstreamDescription, whySelected, bestFor, limitations, review, compatibility, access - [Reviewed reference: references/llmobs-python.md ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-python.md) Checked 2026-10-07 https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-python.md Supports: review, compatibility - [Reviewed reference: references/llmobs-nodejs.md ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-nodejs.md) Checked 2026-10-07 https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-nodejs.md Supports: review, compatibility - [Upstream license ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/LICENSE) Checked 2026-10-07 https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/LICENSE Supports: license - [Publisher installation documentation ↗](https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/README.md) Checked 2026-10-07 https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/README.md Supports: install, compatibility, access - [Skills installer source formats and selective installation ↗](https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/README.md) Checked 2026-10-07 https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/README.md Supports: install - [Installer implementation: full commit SHA fallback ↗](https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/src/git.ts) Checked 2026-10-07 https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/src/git.ts Supports: install - [2026-10-15 C2-W04 source re-review at the existing pin ↗](https://raw.githubusercontent.com/datadog-labs/agent-skills/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md) Checked 2026-10-15 https://raw.githubusercontent.com/datadog-labs/agent-skills/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md Supports: upstreamDescription, review.notTested, review.reviewedAt KEEP COMPARING ## Other approaches to consider. Related by category or shared topics. These are alternatives to inspect, not a measured quality order. [### Agent Platform GenAI Inference ↗ Calls Gemini and third-party OpenMaaS models on Google Cloud Agent Platform, asking for model, project and region instead of defaulting.](/skills/google-agent-platform-inference/)[### Amazon Bedrock ↗ Bedrock model invocation, Knowledge Bases, Guardrails and AgentCore guidance, with quota, prompt-caching and cost-tracking workflows.](/skills/aws-amazon-bedrock/)[### Anthropic Claude API ↗ Routes Claude API work to language-specific SDK guidance and distinguishes self-hosted tool loops from managed agent execution.](/skills/anthropics-claude-api/) [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)[Workflows ↗](/workflows/) ## Continue your investigation - [Choose a toolkit](/tools/) - [Inspect execution hosts](/agents/) - [Check tool access](/mcp-servers/) - [Check project dependencies](/check-repo/)