Job Description

Required Skills & Qualifications:

  • Proven experience in developing Kafka producers and consumers for real-time data

ingestion pipelines.

  • Strong hands-on expertise in Apache Kafka, Kafka Connect, Kafka Streams, and

Schema Registry.

  • Proficiency in Apache Spark (Structured Streaming) for real-time data transformation

and enrichment.

  • Solid understanding of IPFIX, NetFlow, and network flow data formats; experience

integrating with nProbe Cento is a plus.

  • Experience with Avro, JSON, or Protobuf for message serialization and schema

evolution.

  • Familiarity with Cloudera Data Platform components such as HDFS, Hive, YARN, and

Knox.

  • Experience integrating Kafka pipelines with data lakes or warehouses using Parquet or

Delta formats.

  • Strong programming skills in Scala, Java, or Python for stream processing and data

Ready to Apply?

Take the next step in your AI career. Submit your application to Mobile Programming today.

Submit Application