Data Engineer in LeadsMarket.com

Пряме повідомлення учасника, який розмістив вакансію, з LeadsMarket.com Kateryna Onyshko Kateryna Onyshko Recruiter Requirements:- At least Upper-Intermediate English level.- Proven experience as a Data Engineer with a focus on big data.- Hands-on expertise with GCP product offerings and Microsoft Azure cloud platforms and services.- In-depth knowledge of Google big data technologies and Azure Cloud Technology Stacks.- Proficiency in building and optimizing data pipelines.- Strong understanding of data management and transformation.- Experience with GCP services and tools, as well as Azure Data Factory, Databrick and other relevant technologies.- Bachelor's/Master's degree in a relevant field.- Demonstrated success in implementing data solutions in a professional setting. Skills:- Proficiency in SQL, Python and other relevant programming languages.- Experience with data ingestion, integration and processing technologies.- Knowledge of data modeling, data warehousing and database management systems.- Familiarity with data governance, security, and best practices.Strong problem-solving and analytical skills. As a plus:- Adaptability to evolving technologies and a willingness to learn new tools and frameworks.- Excellent communication and collaboration skills to work effectively in a team environment.- Strong attention to detail and a commitment to delivering high-quality solutions.- Ability to manage multiple projects and priorities in a fast-paced environment. Responsibilities:- Design, build, and maintain scalable, automated, and efficient data pipelines to enable Advanced Analytics, Data Science, and AI/ML solutions.- Manage and transform large datasets using cutting-edge technologies, including GCP product offerings and Microsoft Azure cloud platforms and services.- Organize and optimize data storage and retrieval processes, implementing best practices for data management, such as data quality, data governance, data security, data lineage, and data cataloging.- Support critical data pipelines with a scalable distributed architecture, including data ingestion (streaming, events, and batch), data integration (ETL, ELT) and distributed data processing.- Build cloud data solutions using multiple technologies, such as SQL, Python, Data Lake (Databricks Delta Lake/or other), Cloud Data Warehouse (Azure Synapse), RDBMS, and NoSQL databases.- Deploy, automate, maintain, and manage cloud-based production systems to ensure the availability, performance, scalability, and security of production systems.- Work with other engineers and stakeholders to understand business requirements and translate them into data models and architectures that meet performance, scalability, reliability, and security standards.- Ownend-to-end design and development, testing, and the release of critical components using Databricks technology stack and Microsoft Azure cloud platforms and services. We propose: - Opportunity to gain international business experience, working for the leading USA company;- Office in the center of Kyiv, opportunity to work remotely;- Coverage of education and certification (if the project requires);- 27 days off per year: 20 days for vacation and 7 days for sick leave without the need for medical evidence;- Health Insurance;- IT Consulting for Ukrainian Residents (tax payments and accounting services).General information:We are a technology company that operates a platform where buyers and sellers buy and sell leads, calls, and clicks. This platform operates as a marketplace for publishers to find buyers in real time. Currently, our platform helps buyers in the following verticals: personal loans, business loans, auto loans. We believe in a win-win-win-win approach. Show more Show less Посадовий рівень Старший середній рівень Тип зайнятості Повний робочий день Посадові обов’язки Інформаційні технології Галузі Розробка програмного забезпечення