REMOTE Data Engineer in MN

Job Description

Insight Global is seeking 2 Sr. Data Engineers to join a Personal Campaign Operations team. This is a very known, visible and well-funded team bringing in millions of $s for the company. This team supports the entire enterprise (care delivery and health plan marketing), and works in a collaborative, cross-functional environment with both developers and campaign owners. This person must be flexible as they will be working with different people on different campaigns at one time, and have to pivot according to changing priorities.
This person will overall be responsible to:
• Design, develop, and implement end-to-end data solutions using Azure Databricks.
• Convert current SQL to Python code in Databricks.
• Modify and maintain data pipelines.
○ Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.
○ Update or maintain existing data pipelines in a production setting.
•...