Big Data Engineer in Yalantis

Big Data Engineer

Київ, Львів, Дніпро, Ларнака (Кіпр), Варшава (Польща), віддалено

We are looking for an experienced Big Data Engineer to join our team. We are distinguished by our professionalism at all stages of product creation, from analysing a client’s idea to promoting a product on the market.

The project involves developing an application for smart control of multiple devices and home appliances. The end customers will use it as an iOS and Android application to make their lives cooler, easier, and more fun.

Responsibilities:

• Build and maintain scalable data processing pipelines using Kafka and Flink in a cloud environment.
• Implement ETL processes with Spark/Flink for high-volume data.
• Utilise AWS or other cloud providers to manage data workflows.
• Ensure scalability and performance of cloud-based pipelines.
• Integrate and manage message queue systems (e.g., Kafka, RabbitMQ) for real-time data processing.
• Continuously monitor and optimise data pipelines.
• Resolve issues to ensure robust data workflows.
• Work with data scientists and analysts to meet data requirements.
• Use Docker for consistent deployment across environments.

Requirements:

• An ideal candidate — the last 2 years spent developing solutions using Kafka Flink in a cloud environment.

• Experience in using ETL tools for processing high-volume data like Spark/Flink.
• 2+ years of commercial experience in Java.
• Familiar with using any MQ system and Kafka.
• Knowledge of AWS or other Cloud Providers.
• Practical knowledge of Docker.
• Experience with software development process (version control, code review, pair programming).
• Experience working SCRUM / Kanban will pair program (no experience with pair-programming needed).
• Understanding of clean code principles and design patterns.
• Upper-intermediate or higher level of English.

Nice to have:

• Experience with CloudFoundry.
• Knowledge of Terraform.
• Experience with Python.

Our benefits:

GROWTH & EDUCATION

• Individual development plan.
• Mentoring program.
• Evaluation process.
• Professional education.
• Covering the cost of professional certifications.
• Corporate library.
• English classes.

COMMUNITY

• Technological community.
• Volunteering & Charity.
• Yalantis events.
• Yalantis Education.
• Project Teambuilding activities.
• Workation in Larnaca.

WELLBEING

• Medical insurance, health check-ups, and sports activities compensation are up to you.
• Vacation & Day Offs.
• Mental health support program.
• Public holidays.
• Financial and legal support for private entrepreneurs.

WORK ENVIRONMENT

• Cozy offices (Dnipro, Kyiv, Lviv, Warsaw, Larnaca).
• Corporate Top-notch equipment and quality tools.
• Flexible format of work.
• Eco & Pet-friendly space.
• Fun activities in offices.
• Y-bucks & Yalantis store.

Before sending us your CV, you may read our Privacy Notice.