← Explore all skills

DATA PIPELINES / Confluent

Developing Kafka Python client

Confluent skill that scaffolds a confluent-kafka-python producer, consumer or both, or adds Schema Registry to existing Python code, for Confluent Cloud, local Docker or WarpStream, after a confirmation step its instructions require.

“Use when the user wants to build a Python Kafka producer or consumer, add Schema Registry to existing Python code, migrate from raw JSON to schema-backed serialization, or scaffold a confluent-kafka-python project for Confluent Cloud, local Docker, or WarpStream. Also use when user wants to optimize Python Kafka client configuration for WarpStream.”

01 / THE REASONING

Why this made the selection.

  • SKILL.md tells the agent that Schema Registry is non-negotiable in every project, to register schemas in an explicit register_schema() step, and to configure serializers with auto.register.schemas=False and use.latest.version=True.
  • SKILL.md tells the agent not to generate code or modify any file until it has asked whether the app exists, the target environment, and producer, consumer or both, and to send a recap and wait for the user to confirm it.
  • For WarpStream it reads references/warpstream-optimization.md and applies its librdkafka overrides, and it switches to Avro or Protobuf when WarpStream's built-in Schema Registry is in use.

02 / THE REVIEW RECORD

What we actually inspected.

Source review has boundaries.
A clear record is more useful than a “safe” badge.

Material inspected

  • skills/developing-kafka-python-client/SKILL.md at f3d95b7e6855b690b7670ecee033404e082ab169
  • README.md at f3d95b7e6855b690b7670ecee033404e082ab169
  • .claude-plugin/plugin.json at f3d95b7e6855b690b7670ecee033404e082ab169
  • skills/developing-kafka-python-client/references/docker-compose.yml at f3d95b7e6855b690b7670ecee033404e082ab169
  • skills/developing-kafka-python-client/references/common.py at f3d95b7e6855b690b7670ecee033404e082ab169
  • skills/developing-kafka-python-client/references/producer.py and skills/developing-kafka-python-client/references/producer_sync.py at f3d95b7e6855b690b7670ecee033404e082ab169: main() and its register_schema() call
  • skills/developing-kafka-python-client/references/readme-template.md at f3d95b7e6855b690b7670ecee033404e082ab169: the Schema item
  • LICENSE at f3d95b7e6855b690b7670ecee033404e082ab169
  • Repository tree at f3d95b7e6855b690b7670ecee033404e082ab169: 17 SKILL.md files, six of them under skills/confluent-skill-reviewer/evals/mock-skills/

Our findings

  • Explicit registration is required: SKILL.md line 60 says auto.register.schemas is always False and calls explicit registration a core principle, and line 139 registers schemas before the serializer is created.
  • SKILL.md tells the agent to write the project files, modify existing code inline on the migration path, and run `pytest tests/` until the generated tests pass.
  • Generated common.py loads credentials with load_dotenv(), checks the broker with AdminClient.list_topics(timeout=10) and calls GET {sr_url}/subjects on Schema Registry.
  • README.md's skill table names Confluent Cloud and local Docker for this skill and lists Avro, JSON Schema or Protobuf; SKILL.md also covers WarpStream and uses JSON Schema unless WarpStream's built-in registry is in use.

Not established by this review

  • Not executed: it was not installed or run.
  • No project was generated, no test was run and no broker or Schema Registry was contacted.
  • evals/evals.json and the reference templates other than docker-compose.yml, common.py, producer.py, producer_sync.py and readme-template.md were not read in full.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

Add a skill to your workflow.

Upstream setup instructions ↗
  1. For Claude, README.md prints `/plugin marketplace add confluentinc/agent-skills` and `/plugin install streaming-skills-plugin@confluent-agent-skills`. The plugin manifest sets "skills": "./skills/", so the plugin installs the whole skills/ directory, not this skill alone.
  2. README.md also prints `npx skills add confluentinc/agent-skills` and says this route lets you pick specific skills to install. As printed, the line names no skill, so the choice of developing-kafka-python-client is made in the installer.
  3. For IBM Bob, README.md says to copy the skill into the ~/.bob/skills folder.

Before you start

  • Python and the generated requirements.txt, installed with `pip install -r requirements.txt` as SKILL.md's guidance says
  • A Kafka target and a Schema Registry: Confluent Cloud credentials, Docker for the local path, or a WarpStream deployment

04 / FOLLOW THE EVIDENCE

The source trail.

Our notes are separate from the original resource.
Check upstream before adopting a new version.

  1. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/SKILL.md

    Supports: upstreamDescription, whySelected, bestFor, limitations, access, install.prerequisites, review.findings

  2. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/README.md

    Supports: install, compatibility, limitations, review.findings

  3. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/.claude-plugin/plugin.json

    Supports: install, limitations

  4. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/docker-compose.yml

    Supports: limitations

  5. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/common.py

    Supports: access, review.findings

  6. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer.py

    Supports: access

  7. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer_sync.py

    Supports: access

  8. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/readme-template.md

    Supports: access

  9. https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/LICENSE

    Supports: license, limitations

Evidence & Ask