Data Engineer in Maklai

August 29, 2024

Data Engineer

Kyiv

Maklai is a Ukrainian IT product company that has been developing products for over 15 years the western market in the field of travel. One of our big projects is booked.net, a worldwide hotel booking site (7m+ monthly customers from 37 countries 29+ languages).

In connection with the expansion, we are looking for a Data Engineer to create and maintain Data Products using the OLAP database and Data Lakehouse architecture.

Main tasks:

• Development of data products and a change in emphasis from software developers to data engineers.
• Improving the quality of data storage architecture for optimal performance and scalability.
• Providing quick and effective access to analytical data in the required format.
• Active participation in the development and implementation of architectural solutions, with further transition to strategic planning and leadership in the field of data architecture.

Requirements:

• Experience working with databases: Deep understanding and experience working with databases data from Clickhouse, MySQL.
• Experience with messaging and streaming systems: Experience with various messaging and streaming platforms, including but not limited to Kafka (distributed streaming platform) and Redis (used in the company for messaging).
• Big Data Processing: Proven experience managing and processing large-scale data (thousands of tables, billions of records).
• Programming skills: Ability to work with Python and SQL.
• Knowledge of open table formats: Familiarity with open table formats (Delta Lake, Apache Iceberg, Apache Hudi) and hands-on experience.
• Experience with CDC: Experience with Change Data Capture tools like Debezium, Flink, Airbyte.
• Understanding of ELT pipelines: Experience with ELT pipelines including Airflow, dbt, Airbyte.
• Data Architecture Knowledge and Skills: Understanding of the fundamental principles of data architecture design and management, including data modeling, integration processes, and data governance. Desire to develop into a Data Architect role.

Will be a plus:

• Various experience with databases: Experience with other OLAP databases data, data warehouses and data lakehouses.
• Experience with queue services: Logstash
• Java programming skills: Knowledge of Java.
• Knowledge of containerization: Familiarity with containerization technologies (Kubernetes).
• Knowledge of data directories: Understanding and experience with data directories (open-metadata, DataHub, etc.)
• Experience with Schema Registry: < /b> Hands-on experience using Schema Registry to manage data schema versions, ensure compatibility, and integrate schemas into data flows. Knowledge of the principles of operation and optimal use of Schema Registry in the context of streaming data processing systems (for example, Apache Kafka).

Soft Skills:

• Openness to new technologies and desire to develop: Readiness to learn new technologies and desire for professional development.
• Ability to work both independently and in a team.
• Initiative in solving problems.
• Flexibility.

Development prospects:

• Professional growth to Data Architect: Ability to manage the data architecture design process and in the future, by the engineering team. Support for training and development in this direction.

We offer:

• A large amount of data and computing power.
• Requirements in the form of near realtime processing of these data.
• Absence of bureaucracy and the possibility of remote work.
• Friendly and cohesive team.
• Paid holidays, sick leave, medical insurance.
• Compensation for attending conferences, meetups, specialized training.
• Flexible work schedule.
• Comfortable office not far from Holosiivska metro station (can work remotely).