Like what you see? ⭐ Star the repo ⭐ to support the project and keep it in the spotlight. See the stargazers →

Kafscale Roadmap

This roadmap tracks completed work and open gaps. It is intentionally high level; detailed specs live in kafscale-spec.md.

Milestones (Completed)

  • Core protocol parsing and metadata support
  • Produce and fetch paths with S3-backed durability
  • Consumer group coordination with offset and group persistence
  • DescribeGroups/ListGroups ops visibility
  • OffsetForLeaderEpoch consumer recovery
  • DescribeConfigs/AlterConfigs ops tuning
  • CreatePartitions/DeleteGroups ops APIs
  • etcd topic/partition management
  • Observability (structured logging, Grafana dashboard templates, expanded Prometheus metrics)
  • Kubernetes operator with managed etcd + snapshot backups
  • End-to-end tests for broker durability and operator resilience
  • Admin ops API e2e coverage
  • Security review (TLS/auth)
  • End-to-end tests multi-segment restart durability
  • Authentication / ACL and security hardening
  • Kafka client mTLS at the proxy with authenticated principal forwarding to broker ACLs (PR #214, merged 27 October 2026)