---
title: "Developing Kafka Python client: review, setup & limitations · Undominated.ai"
canonical: https://undominated.ai/skills/confluent-developing-kafka-python-client/
description: "Confluent skill that scaffolds a confluent-kafka-python producer, consumer or both, or adds Schema Registry to existing Python code, for Confluent Cloud, local Docker or WarpStream, after a confirmation step its instructions require."
---

# Developing Kafka Python client: review, setup & limitations · Undominated.ai

> Confluent skill that scaffolds a confluent-kafka-python producer, consumer or both, or adds Schema Registry to existing Python code, for Confluent Cloud, local Docker or WarpStream, after a confirmation step its instructions require.

[← Explore all skills](/skills/)

DATA PIPELINES / Confluent

# Developing Kafka Python client

Confluent skill that scaffolds a confluent-kafka-python producer, consumer or both, or adds Schema Registry to existing Python code, for Confluent Cloud, local Docker or WarpStream, after a confirmation step its instructions require.

 [See setup guidance ↓](#setup)[Original source ↗](https://github.com/confluentinc/agent-skills)

SOURCE REVIEW

 Reviewed 2026-10-21
 Evidence 9 linked sources
 Publisher Confluent
 Licence [Apache-2.0 ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/LICENSE)
 Revision f3d95b7e6855
 [Read what was—and wasn’t—checked ↓](#review)

“Use when the user wants to build a Python Kafka producer or consumer, add Schema Registry to existing Python code, migrate from raw JSON to schema-backed serialization, or scaffold a confluent-kafka-python project for Confluent Cloud, local Docker, or WarpStream. Also use when user wants to optimize Python Kafka client configuration for WarpStream.”

 [Confluent · upstream description ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/SKILL.md) Our analysis follows below.

01 / THE REASONING

## Why this made the selection.

 - SKILL.md tells the agent that Schema Registry is non-negotiable in every project, to register schemas in an explicit register_schema() step, and to configure serializers with auto.register.schemas=False and use.latest.version=True.
- SKILL.md tells the agent not to generate code or modify any file until it has asked whether the app exists, the target environment, and producer, consumer or both, and to send a recap and wait for the user to confirm it.
- For WarpStream it reads references/warpstream-optimization.md and applies its librdkafka overrides, and it switches to Avro or Protobuf when WarpStream's built-in Schema Registry is in use.

### A good fit for

 - Scaffold a Python producer, consumer or both with JSON Schema serialization for Confluent Cloud or a local Docker broker
- Add Schema Registry to an existing Python producer and replace raw producer.produce() calls with serializer-backed calls
- Configure a Python client for WarpStream with the skill's librdkafka overrides
- Generate unit tests that mock Kafka and Schema Registry so they run without a live cluster

### Weigh up before choosing

 - The skill directory skills/developing-kafka-python-client last changed in a commit dated 2026-08-24; the pinned revision is dated 2026-10-06. SKILL.md metadata says version 1.0.0.
- SKILL.md tells the agent to wait for answers to three questions and a confirmed recap before writing any file, even when the prompt already answers them.
- The .env rule is an instruction to the agent, not an enforced control: SKILL.md says never to read, open or display .env files and to ask the user to verify their own values when debugging.
- The local Docker template uses confluentinc/confluent-local:latest and confluentinc/cp-schema-registry:latest, image tags that are not pinned to a version.
- README.md says skill performance may vary with the underlying language model and that all outputs and code modifications should be carefully reviewed and tested by developers.
- The Claude plugin route installs the whole skills/ directory, which holds 11 skill directories at this revision (17 SKILL.md files counting six evaluation mock skills). The printed npx line names no skill; README.md says that route lets you pick specific skills to install.
- LICENSE is the Apache License 2.0 text with its appendix placeholder Copyright [yyyy] [name of copyright owner] unfilled; README.md also says Apache License 2.0.

02 / THE REVIEW RECORD

## What we actually inspected.

Source review has boundaries. A clear record is more useful than a “safe” badge.

### Material inspected

 - skills/developing-kafka-python-client/SKILL.md at f3d95b7e6855b690b7670ecee033404e082ab169
- README.md at f3d95b7e6855b690b7670ecee033404e082ab169
- .claude-plugin/plugin.json at f3d95b7e6855b690b7670ecee033404e082ab169
- skills/developing-kafka-python-client/references/docker-compose.yml at f3d95b7e6855b690b7670ecee033404e082ab169
- skills/developing-kafka-python-client/references/common.py at f3d95b7e6855b690b7670ecee033404e082ab169
- skills/developing-kafka-python-client/references/producer.py and skills/developing-kafka-python-client/references/producer_sync.py at f3d95b7e6855b690b7670ecee033404e082ab169: main() and its register_schema() call
- skills/developing-kafka-python-client/references/readme-template.md at f3d95b7e6855b690b7670ecee033404e082ab169: the Schema item
- LICENSE at f3d95b7e6855b690b7670ecee033404e082ab169
- Repository tree at f3d95b7e6855b690b7670ecee033404e082ab169: 17 SKILL.md files, six of them under skills/confluent-skill-reviewer/evals/mock-skills/

### Our findings

 - Explicit registration is required: SKILL.md line 60 says auto.register.schemas is always False and calls explicit registration a core principle, and line 139 registers schemas before the serializer is created.
- SKILL.md tells the agent to write the project files, modify existing code inline on the migration path, and run `pytest tests/` until the generated tests pass.
- Generated common.py loads credentials with load_dotenv(), checks the broker with AdminClient.list_topics(timeout=10) and calls GET {sr_url}/subjects on Schema Registry.
- README.md's skill table names Confluent Cloud and local Docker for this skill and lists Avro, JSON Schema or Protobuf; SKILL.md also covers WarpStream and uses JSON Schema unless WarpStream's built-in registry is in use.

### Not established by this review

 - Not executed: it was not installed or run.
- No project was generated, no test was run and no broker or Schema Registry was contacted.
- evals/evals.json and the reference templates other than docker-compose.yml, common.py, producer.py, producer_sync.py and readme-template.md were not read in full.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

## Add a skill to your workflow.

[Upstream setup instructions ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/README.md)
 - For Claude, README.md prints `/plugin marketplace add confluentinc/agent-skills` and `/plugin install streaming-skills-plugin@confluent-agent-skills`. The plugin manifest sets "skills": "./skills/", so the plugin installs the whole skills/ directory, not this skill alone.
- README.md also prints `npx skills add confluentinc/agent-skills` and says this route lets you pick specific skills to install. As printed, the line names no skill, so the choice of developing-kafka-python-client is made in the installer.
- For IBM Bob, README.md says to copy the skill into the ~/.bob/skills folder.

### Before you start

 - Python and the generated requirements.txt, installed with `pip install -r requirements.txt` as SKILL.md's guidance says
- A Kafka target and a Schema Registry: Confluent Cloud credentials, Docker for the local path, or a WarpStream deployment

### Compatibility

Claude · Cursor · IBM Bob

### Implementation

Python

### Writes a Python Kafka project and runs its tests

 - Creates common.py, a schema file under schemas/, tests/test_project.py, .env.example, requirements.txt and README.md in the user's chosen directory, plus producer.py and consumer.py when requested and docker-compose.yml on the local Docker path.
- On the existing-application path, modifies the user's existing producer code inline and generates only the missing files.
- Runs `pytest tests/` after generating the files and fixes the generated code until the tests pass; the tests mock all external dependencies.
- Is told never to read, open or display .env files; the generated code loads API_KEY, API_SECRET, SR_API_KEY and SR_API_SECRET from .env when the user runs it.
- Generated code calls the configured Kafka broker and GET {SCHEMA_REGISTRY_URL}/subjects, and the producer templates call register_schema() in main(), so the schema is registered with Schema Registry each time the generated producer starts (readme-template.md: "on startup").

### Cost model

Apache-2.0 skill text. The files read do not state a fee for the skill, Confluent Cloud, WarpStream or the Docker images.

04 / FOLLOW THE EVIDENCE

## The source trail.

Our notes are separate from the original resource. Check upstream before adopting a new version.

 - [developing-kafka-python-client SKILL.md at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/SKILL.md) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/SKILL.md Supports: upstreamDescription, whySelected, bestFor, limitations, access, install.prerequisites, review.findings
- [Repository README at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/README.md) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/README.md Supports: install, compatibility, limitations, review.findings
- [Claude plugin manifest at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/.claude-plugin/plugin.json) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/.claude-plugin/plugin.json Supports: install, limitations
- [Local Docker template at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/docker-compose.yml) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/docker-compose.yml Supports: limitations
- [common.py template at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/common.py) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/common.py Supports: access, review.findings
- [producer.py template at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer.py) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer.py Supports: access
- [producer_sync.py template at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer_sync.py) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/producer_sync.py Supports: access
- [readme-template.md at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/readme-template.md) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/skills/developing-kafka-python-client/references/readme-template.md Supports: access
- [Apache-2.0 LICENSE at f3d95b7e ↗](https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/LICENSE) Checked 2026-10-21 https://github.com/confluentinc/agent-skills/blob/f3d95b7e6855b690b7670ecee033404e082ab169/LICENSE Supports: license, limitations

KEEP COMPARING

## Other approaches to consider.

Related by category or shared topics. These are alternatives to inspect, not a measured quality order.

 [### Redpanda streaming ↗ Redpanda reference skill for using the broker through its Kafka-compatible API: rpk topic and record commands, producer and consumer settings, transactions, client compatibility, tiered storage and licensed enterprise topic features.](/skills/redpanda-streaming/)[### Elasticsearch File Ingest ↗ Load CSV or JSON into Elasticsearch with explicit mapping and bulk-result checks.](/skills/elastic-elasticsearch-ingest/)[### Elasticsearch Reindex Planning ↗ Prepare destination mappings and verify asynchronous local or remote reindex operations.](/skills/elastic-elasticsearch-reindex/)

 [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)[Workflows ↗](/workflows/)

## Continue your investigation

 - [Choose a toolkit](/tools/)
- [Inspect execution hosts](/agents/)
- [Check tool access](/mcp-servers/)
- [Check project dependencies](/check-repo/)
