Middle Big Data Engineer in MODUS X

July 10, 2024

Middle Big Data Engineer

Kyiv

Become part of a team that creates digital reality!

MODUS X is a Ukrainian IT company, a team of 600+ experienced specialists - we expand the horizons of business opportunities, revealing the potential of people, ideas and technologies. We started and continue to support the digital transformation of DTEK and have been designing, developing and implementing business applications, comprehensive IT and cyber security solutions, and data-driven products for the past 18 years. We have now spun off into a separate company to share our experience and expertise, while remaining an IT support for those who bring light and contribute to the country's recovery.

ModusX has unique experience in the development and implementation of analytical solutions based on BigData technologies, industrial IoT, AI/ML and cloud computing platforms.

The list of projects and clients is expanding. In this regard, we are recruiting data engineers - specialists in the field of developing software solutions for data with hands-on experience with Microsoft FABRIK, Azure Synapse SQL Analytics, Azure Data Factory, Azure Power BI Embedded, Azure Data Lake, One Lake Hadoop, Spark , NoSQL, Data Warehouse, etc. We need passionate engineers to implement and implement multi-tier data processing containers that also include analytical models.

The system development process is based on the Scrum methodology, focused on the use of iterative development, dynamic requirements formation and constant communication of working groups with business representatives to ensure maximum efficiency.

What we expect from you:

• Development of data pipelines with the purpose of providing collection, multi-level processing and structuring data for further analysis and use in the system
• Development of optimal data storage and transfer structure
• Interaction with data analysts and the product owner to determine requirements for data download, conversion and presentation
• li>
• Interaction with the data architect to ensure the quality of the technical data processing solutions being developed
• Participation in all development cycles - design, programming, testing and release
• Conducting code reviews ( code review) with the aim of ensuring the quality of development
• Application of the concept of continuous integration and delivery (CI/CD)
• Optimization of data pipelines and improvement of the architecture from the point of view of the effectiveness of the functioning of both individual elements and systems in general

Necessary professional experience and requirements:

• Experience in the role of a data engineer at least 2- x years
• Practical skills in the design and implementation of Microsoft Fabrik data collection and processing systems, Azure Synapse Analytics
• Understanding of the main stages of data processing and analysis, tools and methods used in this field < /li>
• Understanding of distributed computing principles
• Ability to perform data exploration (data exploration) and interact with subject matter experts to achieve business goals
• Knowledge of SQL and NoSQL, experience working with different DBMS (MSSQL / MySQL / PostgreSQL / Cassandra, etc.)
• Practical skills in using Databricks (Apache Spark): Core, SQL, Stream and Batch Processing
• Experience working with Delta Lake
• Practical skills in using cloud services:
• Azure Synapse Analytics, Azure Data Factory, Microsoft Fabrik, Azure Power BI Embedded, Azure Data Lake, One Lake (Serverless Execution, Streaming, Databases, etc.).
• Python 3.x

We offer:

• Official employment
• Competitive conditions and bonus program
• Corporate equipment
• Corporate health insurance program
• Employee psychological support program
• Remote or hybrid work format in Innovation Park Unit City
• Learning opportunities and professional development (online courses, classroom trainings, master classes, professional communities)

We value those who accepts calls. Among us, everyone can show off their talents and feel a direct impact on our joint success. We invest in everyone's development, make it possible to gain new knowledge and achieve professional goals. More information about the company and our experience on the official MODUS X LinkedIn page.