Data Engineer

Job Title: Data Engineer - Spark & Real-Time Data Processing Location: Richmond, VA Duration: 6 Months Role Overview We are seeking an experienced Data Engineer with strong expertise in Apache Spark-based ETL pipelines and real-time data processing. The ideal candidate will design, build, and optimize scalable data platforms that support batch and streaming workloads, enabling analytics, reporting, and data-driven decision-making across the organization. Key Responsibilities Data Engineering & ETL Development Design, develop, and maintain Spark-based ETL pipelines for large-scale batch data processing. Build reusable, fault-tolerant data frameworks for ingesting, transforming, and loading structured and semi-structured data. Optimize Spark jobs for performance, scalability, and cost efficiency. Real-Time & Streaming Data Processing: Develop real-time and near real-time data pipelines using technologies such as Spark Structured Streaming, Kafka, or Kinesis. Process high-volume event str...