Job Description
We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Databricks and AWS to design, develop, and optimize scalable data pipelines and modern data platforms. The ideal candidate will have deep experience with big data ecosystems, cloud-based data solutions (AWS), and ETL/ELT frameworks using Python, PySpark, and SQL.
Key Responsibilities
Design, build, and maintain data pipelines and ETL workflows using Databricks (PySpark, Spark SQL) and AWS services (S3, EMR, Glue, Lambda, RDS, DynamoDB).
Implement data lakehouse architectures integrating Delta Lake, Snowflake, and AWS storage layers.
Develop and deploy automated and scalable data ingestion frameworks to process structured and unstructured data.
Build and optimize data models (Star/Snowflake schemas) for analytical and reporting use cases.
Orchestrate workflows using Airflow or similar scheduling tools; manage job dependencies and mon...
Key Responsibilities
Design, build, and maintain data pipelines and ETL workflows using Databricks (PySpark, Spark SQL) and AWS services (S3, EMR, Glue, Lambda, RDS, DynamoDB).
Implement data lakehouse architectures integrating Delta Lake, Snowflake, and AWS storage layers.
Develop and deploy automated and scalable data ingestion frameworks to process structured and unstructured data.
Build and optimize data models (Star/Snowflake schemas) for analytical and reporting use cases.
Orchestrate workflows using Airflow or similar scheduling tools; manage job dependencies and mon...
Ready to Apply?
Take the next step in your AI career. Submit your application to Virtusa today.
Submit Application