Job Description

Urgent Position with Out Client-

Position- Kafka Engineer

Location - Tempe, AZ

Position Type- Contract

Responsibilities -

• Kafka Messaging Troubleshooting
• Analyze broker, producer, and consumer logs. Debug consumer lag, broker failures, and message delivery issues. Tune performance (throughput, latency, etc.)
• System Monitoring & Metrics
• Monitor Kafka using tools like Prometheus, Grafana, Confluent Control Center, etc. Track consumer lag, broker health, and other system-level metrics.
• Kafka Architecture & Configuration
• Set up and maintain Kafka clusters (brokers, topics, partitions, replication). Design and configure Kafka topics and consumer groups for reliability and performance.
• Distributed System Expertise
• Handle issues involving fault tolerance, leader elections, and data replication. Optimize systems for high availability and scalability.
• Programming & Debugging
• Use Java or Scala to write or debug producers/consumers. Possibly support or extend Kafka Streams or Kafka Connect pipelines.
• Security and Network Troubleshooting
• Configure and troubleshoot SSL, SASL, ACLs, and other Kafka security layers. Investigate network issues between Kafka clients and brokers.

Required Skills

• A Kafka Developer or Engineer who:
• Has production-level experience with Kafka, especially Confluent Kafka.
• Can design and implement streaming data pipelines.
• Understands distributed system principles.
• Can diagnose and resolve complex issues (e.g., consumer lag, broker downtime, message loss).
• Has coding expertise in Java/Scala to work with Kafka clients or stream processing apps.
• Knows how to monitor, secure, and scale Kafka infrastructure.

Job Tags

Similar Jobs