AI APPLICATION DEVELOPMENT / Datadog Labs
Datadog LLM Observability Instrumentation
Instruments a Python or Node.js/Next.js backend with Datadog LLM Observability, auditing session-ID plumbing and persisting the dependency before reporting.
“Instrument the current project with Datadog LLM Observability for Python or Node.js/Next.js backends that call LLMs or run AI agents. Detects the runtime and LLM framework, provisions credentials, adds SDK init (ddtrace/dd-trace) with the correct kwargs, persists the dependency into the deploy manifest, and audits session-ID plumbing for gaps — fixing them when found. …”
01 / THE REASONING
Why this made the selection.
- Runs detection before editing: runtime, LLM framework, app framework, existing instrumentation, and the manifest to persist into are all identified in Phase 1.
- Audits session-ID plumbing for gaps and fixes them, with separate Python and Node.js references plus shared credential and verification-report references.
02 / THE REVIEW RECORD
What we actually inspected.
Source review has boundaries.
A clear record is more useful than a “safe” badge.
Material inspected
- dd-instrument-llmo/SKILL.md
- dd-instrument-llmo/references/llmobs-python.md
- dd-instrument-llmo/references/llmobs-nodejs.md
- LICENSE
Our findings
- Ground rules scope the work to the detected backend before any file is written.
- The routing table separates analysis, instrumentation, and verification with per-runtime references.
Not established by this review
- No backend was instrumented and no Datadog credentials were provisioned.
- Span emission, session linkage, and dashboard behavior were not observed.
- Not executed: it was not installed or run.
The review applies to the material and revision named here. A newer upstream release can change its behavior.
03 / PUT IT TO WORK
Add a skill to your workflow.
DOCUMENTED COMMAND
npx skills add datadog-labs/agent-skills/dd-instrument-llmo --skill dd-instrument-llmoRun in your terminal to choose your AI tools, project or global scope, and installation method. This short command follows the current upstream version; the review covers the revision shown above.
Optional: install the reviewed revision
Keeps the original source and installer version where recorded, while leaving your AI tools and installation scope for you to choose.
npx skills add https://github.com/datadog-labs/agent-skills/tree/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo --skill dd-instrument-llmo- Install the complete skill directory with its references; a copied SKILL.md alone is incomplete.
- Choose your AI tools and project or global scope in the installer, then review its permissions before using the skill.
Before you start
- Node.js/npm for this installer
- An agent that supports the Agent Skills format
- A Datadog account with API credentials and permission to edit the backend and its manifest
04 / FOLLOW THE EVIDENCE
The source trail.
Our notes are separate from the original resource.
Check upstream before adopting a new version.
https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md
Supports: summary, upstreamDescription, whySelected, bestFor, limitations, review, compatibility, access
https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-python.md
Supports: review, compatibility
https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/references/llmobs-nodejs.md
Supports: review, compatibility
- Upstream license ↗Checked
https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/LICENSE
Supports: license
https://github.com/datadog-labs/agent-skills/blob/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/README.md
Supports: install, compatibility, access
https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/README.md
Supports: install
https://github.com/vercel-labs/skills/blob/48dc9e8eb8aa19040e91cb90ba0b642c9cbad57e/src/git.ts
Supports: install
https://raw.githubusercontent.com/datadog-labs/agent-skills/9f3a8b065be670e70bb9b66999aae0b786a0bb7d/dd-instrument-llmo/SKILL.md
Supports: upstreamDescription, review.notTested, review.reviewedAt