Job Description
About the role:
- You are pioneering and innovative and want to be part of the cutting-edge and disruptive crypto-currency world
- You are eager to learn new knowledge in both financial and technical fields
- You thrive in a non-hierarchical organization with a casual working environment
- You enjoy solving complex distributed systems challenges and optimizing streaming data pipelines
- You value comprehensive documentation and collaborative problem-solving
As a Data Engineer you will:
- Build real-time data pipelines using Apache Flink (PyFlink) to process high-volume logs through EC2 Vector MSK PyFlink S3 ClickHouse architecture
- Design stream processing systems with watermark strategies, window operations, exactly-once semantics, and state management for critical data
- Deploy and manage AWS infrastructure including Managed Flink...
Ready to Apply?
Take the next step in your AI career. Submit your application to IO TECH SOLUTIONS LIMITED today.
Submit Application