Golang Software Engineer – Infrastructure & Scraping Systems Team

The Role

We are seeking a Software Engineer with a strong background in infrastructure and a passion for building robust backend systems. In this role, you will play a pivotal part in managing and evolving our core infrastructure, which is responsible for handling massive, high-load web scraping operations and integrating complex scraping systems.

Scale of Data & Ingestion: Because our platform simultaneously powers operations for thousands of large-scale B2B enterprise clients , our infrastructure processes, transforms, and stores millions of data points and permanent web posts every single day. You will directly manage the high-concurrency ingestion pipelines required to scale these massive data ecosystems.

You will focus heavily on optimizing performance and cost efficiency, particularly by migrating machine learning and data extraction models from CPUs to high-performance GPU environments using Kubernetes.

Resp...