Middle Data Engineer in Koordinaciyniy gumanitarniy centr, BO

Objective:Filling a vacant position Middle Data Engineer to design, implement and maintain a unified, scalable data architecture of the organization. The key task is to lead the full cycle of data migration from disparate sources (Google Sheets, existing PostgreSQL databases) to the new CRM system, ensuring its cleanliness, integrity and easy future support.

Requirements:

• Higher education;
• Ability to quickly analyze the data schema of your old database and the data schema of the new database CRM;
• Proficiency in SQL in general and PostgreSQL in particular at a high level. Ability to write complex but readable queries for data transformation;
• High skills and experience with Google Sheets, Google App Script or other (Python, JS, etc.) scripting programming languages ​​for data collection and processing. Understanding of ways to clean and validate data;
• Understanding and skills in working with APIs (Google Sheets API, etc.) and frameworks for cleaning and normalizing data;
• Experience in creating pipelines for further data processing. The ability to work with Docker will be an advantage;
• Willingness to mentor and train people to work with an organized infrastructure and certain rules for working with data;
• Proficiency in the Ukrainian language;
• Organizational and communication skills;
• Self-organization and discipline.

Responsibilities:

• Communication with the operational teams of the organization to collect existing data registers and build a common architecture;
• Developing a target data model and schema that would ensure scalability and integrity;
• Data Mapping - creating a detailed mapping of fields: from which columns in Google Sheets and tables in the old one database should be moved to specific fields of the new system;
• Development of pipelines (creation, testing, implementation and user training) for data migration;
• Integration with API systems that do not require migration;
• Standardization and validation of data;
• Ensuring full and incremental migration of data from old sources to the new system, ensuring no loss;
• Setting up to automatically run scripts for regular data synchronization (eg new records from Google Sheets that are still in use);
• Create and maintain Docker containers for stable operation and easy support transfer;
• Create and maintain technical documentation on data architecture, pipelines and cleaning rules;
• Attend monthly meetings, training sessions, general coordination meetings, forums.

Working conditions:

• Booking;
• Working in a comfortable office center or remotely;
• The work schedule is flexible, with the need to join meetings with teams between 09:00 and 18:00, Mon-Fri;
• Competitive remuneration taking into account your professional experience;
• Interesting work with the possibility of solving non-standard cases;
• Friendly team and loyal staffequality;
• Transparency of decisions and openness in communications;
• Working in a powerful and ambitious humanitarian organization with growth prospects.