Data Engineer

Role: Data Engineer
Any Visa is okay

Location: Malvern, PA (Hybrid- days a week onsite & must be willing to relocate and be onsite on day
Must be willing to take onsite interview at Malvern, PA- so Local/ Tristate candidates only



Responsibilities



Qualifications

. Proficiency in Python programming

. Strong expertise in SQL, Presto, HIVE, and Spark

. Knowledge of trading and investment data

. Experience in big data technologies such as Spark and developing distributed computing applications using PySpark

. Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy

. Understanding of data pipelines, ETL processes, and data warehousing concepts

. Strong experience in building and orchestrating data pipelines

. Experience in building APIs Write, maintain, and execute automated unit tests using Python

. Follow Test-Driven Develop...