Job Description
Design, develop, and maintain scalable Kafka-based data pipelines and event-driven applications (producers/consumers).
Implement and manage Kafka Connectors (JDBC, S3, etc.) for data integration.
Work with Kafka Streams, topics, schemas, and partitions.
Integrate Kafka with other systems (databases, cloud services, Spark).
Write code in Java, Scala, or Python for data processing.
Collaborate with Data Engineers, DevOps, and Software Engineers.
Develop monitoring/alerting for Kafka infrastructure.
Troubleshoot and resolve critical, complex Kafka issues (L3/Tier 3).
Perform deep analysis for service failures and recurring incidents.
Utilize tools like Client, Grafana, JMX for system health and observability.
Deploy, configure, and maintain highly available Kafka clusters.
Implement security best practices (SSL, Kerberos, Ranger).
#J-18808-LjbffrReady to Apply?
Take the next step in your AI career. Submit your application to Pyramid Consulting, Inc today.
Submit Application