Data Engineer

Data Engineers coordinate with researchers to ensure efficient processing of large-scale data.

Responsibilities
● Creating automated data pipeline and monitoring/maintaining it
● Preprocessing and cleansing of semi-structured or unstructured data
● Integrating multiple data sources and databases into one system

Qualifications
● Excellent design, debugging and problem solving skills
● Strong experience with data processing using Python: pandas, numpy, etc..
● In-depth knowledge of the Python ecosystem and best practices
● Knowledge of UNIX operating systems (we use Linux), system/processor performance, and network communication
● Scripting skills in UNIX environment: shell
● Experience with databases, at least SQL ones
● Experience with file transfer protocol
● Strong communication skills – this is key for working closely with cross-functional teams

Bonus
● Web development experience with Django, Reactjs
● Web scraping exper...