Sr. Data Engineer 6+ Years

Job Description

We are seeking a Sr. Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation. You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and implementing fixes with a focus on process automation, data lineage (DataHub), and platform reliability. Key Responsibilities: Execute large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis. Work closely with the Finance Controllers. Perform RCA, issue triaging and resolve anomaliesBuild and monitor data quality, lineage, and SLA adherence across systemsEnable observability through monitoring dashbo...