Big Data Engineer (middle) in Kiyivstar

Necessary skills• 2+ years of experience in software development or relevant ETL experience• Strong knowledge of Python (PySpark)• Experience with big data technologies like Hadoop, Spark, and Apache Kafka, Apache Airflow• Proficiency in SQL and experience with NoSQL databases• Experience with Docker and Kubernetes• Experience in process design and developing ETL processes• Knowledge of data warehousing concepts, Data formats knowledge and the differences between them• Understanding of DevOps practices and experience with CI/CD pipelinesWould be a plus• Proficiency in AWS services related to data storage, processing, and analytics such as Amazon S3, Amazon Redshift, Amazon RDS, AWS Glue, AWS Lambda, and Amazon Kinesis• Experience with Azure, GCP• Experience with performance testing and tuningResponsibilities• Developing ETL flows based on Hadoop/BigData stack technology: Apache Nifi, Airflow, Hive, Spark, Kafka• Troubleshooting and performance optimization for data processing flows, data modelsWe offer:• A unique experience of working for the largest and most beloved mobile operator in Ukraine.• Real opportunity to ship digital products to millions of customers.• A competitive salary.• Annual bonus.• Paid sick leave and vacation.• Financial aid in different life situations.• Possibility to work remotely at regular intervals.• Flexible working hours.• Medical and life insurance.• Great possibilities for professional development and career growth.• Friendly & Collaborative Environment.