Job Description
- 4+ years of relevant IT experience in the BI/DW domain with minimum 2 years of hands-on experience on Azure modern data platform that includes Data Factory, Databricks, Synapse (Azure SQL DW) and Azure Data Lake Meaningful experience of data analysis and transformation using Python/R/Scala on Azure Databricks or Apache Spark Well versed NoSQL data store concepts
- Good knowledge in Distributed Processing using Databricks (preferred) or Apache Spark
- Ability to debug using tools like Ganglia UI, expertise in Optimizing Spark Jobs The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets Expert in creating data structures optimized for storage and various query patterns for e.g, Parquet and Delta Lake
- Meaningful experience in at least one database technology in each segment such as:o Traditional RDBMS (MS SQL Server, Oracle)o MPP (Teradata, Netezza)o NoSQL (MongoDB...
Ready to Apply?
Take the next step in your AI career. Submit your application to IDESLABS today.
Submit Application