Junior Data Engineer

As a Junior Data Engineer at Media Meter, you will play a crucial role in our data collection team. Your primary responsibilities will include developing and maintaining an advanced data scraping system. You will be instrumental in building robust data processing frameworks, such as ETL and RAG pipelines, and implementing microservices using publisher/subscriber models to ensure scalable data flow and system scalability.

What are your responsibilities?

• Algorithm Development & Data Processing: Develop and optimize algorithms for effective data extraction and integrate scalable ETL pipelines for efficient data manipulation.
• Database Management Systems: Manage complex data storage and retrieval tasks using MongoDB or Redis while ensuring data integrity.
• Microservices Architecture: Design and implement scalable microservices with pub/sub models, enhancing our data collection and processing capabilities.
• Software Development Best Practices: C...