Data Engineer
Published on Nov 20, 2020
DataRoot Labs
A Product
company founded in
2016 with offices in Kyiv, Ukraine.
Project:
ETL
Python
Kubernetes
Apache Airflow
Data Engineering
Overview Project & team DataRoot Labs is looking for a Data Engineer! In this role, you will be working in the team of the top Israeli Data Startup of 2019. It is a cutting-edge Data Engineering platform that orchestrates ML creation and data processing within organizations and provides visibility to data scientists and engineers involved in the process. The platform streamlines the integration, productization, and testing of ML pipelines, thus enabling the different stakeholders to work together on ML projects in an efficient and frictionless way.
What You Will Do Responsibilities
- Building complex pipelines aimed to process Large data sets using a variety of orchestration tools (such as Airflow, Luigi, Azkaban and etc’). Load and extract data from a variety of data sources such as S3, API, snowflake, Redshift, Presto, and etc’.
- Oversee the design, building, and launching of new data science models and data pipelines in production.
- Collaborate with internal and external stakeholders in order to understand their data engineering needs, implement it in your pipeline, and convey it to the engineering teams.
- Own Databand's internal pipelines, demo environments, and staging environments pipelines and data quality.
What You Should Bring Must-have
- 3+ years of experience in designing database models and working with SQL and NoSQL databases such as Redshift, Snowflake, Elastichsearch, Presto, Spark.
- 3+ of writing ETLs in OOP languages such as Python or Java.
- Good knowledge in at least one orchestration platform such as Luigi, Airflow, Azkaban, Oozie, or others.
- Mastering SQL including complex queries.
- Solid knowledge of container orchestration tools Kubernetes, Docker, and cloud platforms.
- Ability to rapidly learn new technologies and use them in production.
- Getting things done - solve problems in a creative way with a startup mentality to empower fellow engineers.
- English - Upper-Intermediate (both verbal and written).
What You Will Get Benefits
- Startup culture, a strong product-oriented team that consists of Tech Leads and Senior specialists.
- Opportunity to be part of the big story that shapes the future and is already changing the present.
- Office on the 25th floor with access to the terrace in Kyiv downtown.
- Working in a multi-cloud environment.
- Advanced-Data Engineering technologies.
- Business travels to visit the Israel team (Post Covid).
- Office on the 25th floor with access to the terrace in Kyiv downtown.
- Working with the newest technical equipment.
- 20 working days of annual vacation leave.
- Premium medical insurance covered by the company.
Location Mykoly Vasylenka Street, 7, Kyiv, Ukraine
Similar Jobs in Data Engineering