Middle/Senior Data Engineer in Onseo

September 7, 2024

Middle/Senior Data Engineer

Kyiv, Vinnytsia, remotely

We are looking for an experienced Data Engineer , which will help improve our US partner's product. For several years, this product has successfully provided customers with the ability to plan a variety of events, sports activities and leisure time with the help of a specialized technology platform.

Requirements:

• 3+ years experience in data engineering and building < b> data storage ;
• Experience gathering large, complex data sets that meet functional / non-functional business requirements;
• Experience in supporting the optimal architecture of the data pipeline;
• Excellent programming skills in Python ;
• Deep experience with SQL queries ;
• Experience in designing and optimizing databases;
• Practical experience with big data technologies (for example, Spark, Hadoop );
• Experience with PySpark for processing big data;
• Experience in analyzing, transforming and storing data in the specified formats in big data environments;
• Understanding the basics of distributed computing;
• Experience with AWS data services and infrastructure management;
• Experience with AWS Lambda, Glue, RedShift, S3 ;
• English at a level not lower than Upper Intermediate (conversation is mandatory).

Will be an advantage:

• Experience with PowerBI;
• Experience with Apache Airflow/MWAA , creation of workflow DAGs and scheduling jobs.

Key Responsibilities:

• Implementation and maintenance of data warehouse;
• Implementation of ETL pipelines for filling the warehouse with data from different warehouses/APIs with a guarantee of data consistency;
• Implementation of tools for standardized internal and external data requests in different formats and locations;
• Breakdown of complex tasks into achievable tasks;
• Monitoring systems performance, ensuring that data consistency and latency meet product requirements.

We offer:

• Friendly and highly professional team, democratic management;
• Professional growth and training;
• Career planning and regular performance reviews;
• Competitive salary;
• Medical insurance and paid sick leave;
• Long-term employment with 24 calendar days of paid leave;
• Sports compensation and English lessons;
• Work on interesting projects using advanced technologies.

EN

We are looking for a Middle/Senior Data Engineer who will join the development team to help improve the product of our American client. For last years, this product has been successfully providing customers with a service for planning various events, sports and leisure activities using a specialized platform.

Requirements:

• 3+ years of experience in  data engineering and building data warehouses;
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Maintain optimal data pipeline architecture;
• Proficiency in  Python programming;
• Strong SQL querying skills;
• Experience with database design and optimization;
• Hands-on experience with big data technologies (e.g. Spark, Hadoop) ;
• Experience with PySpark for big data processing;
• Experience in parsing, transforming, and storing data in these formats within big data environments;
• Understanding of distributed computing principles;
• Experience with AWS data services and infrastructure management;
• Proficiency in  AWS Lambda, Glue, RedShift, S3;
• Upper Intermediate English level.

Will be a plus:

• Experience with PowerBI;
• Experience with Apache Airflow/MWAA , building workflow DAGs and scheduling jobs.

Role Responsibilities:

• Implement and support data warehouse;
• Implement ETL pipelines to fill the data warehouse with data from different storages/APIs with guarantee data consistency;
• Implement tools for standardized internal and external querying of the data in various formats and places;
• Break down complex problems into executable tasks;
• Monitor the performance of the system, make sure the data consistency and update latency meet the product requirements.

We offer:

• Friendly and highly professional team;
• Democratic management;
• Professional growth and training;
• Career planning and regular performance reviews;
• Competitive salary;
• Medical issuance and paid sick days;
• Long-term employment with 24 calendar days of paid vacation;
• Sports compensation and English lessons;
• Work on interesting projects using cutting-edge technologies.

Надсилаючи своє резюме, Ви тим самим даєте згоду на обробку своїх особистих персональних даних відповідно до Закону України «Про захист персональних даних» від 01.06.2010 р. № 2297-VІ з метою потенційної подальшої співпраці.