Data Engineer in ITRex Group

Data Engineer Київ, Варшава (Польща), віддалено About ITRex Weare aglobalIT consulting and development company with aWeCare attitude, striving tocreate momentum inour clients’ digital transformation. Our 230+ team brings together creative and talented cross-functional experts who are hungry for the success ofevery project. Wehave delivered hundreds ofgame-changing solutions toFortune 500giants, mid-market companies and startups and pride ourselves onbeing part ofasuccess story ofglobal leaders such asTASC, Procter &Gamble, Dun &Bradstreet, Turvo, Universal Electronics, Shutterstock, Dollar Shave Club orJibJab. Wevalue initiative, open communication and self-motivated commitment rather than compliance and box-ticking, and are looking for like-minded individuals who share our passion about doing great new things together. Join our friendly team asaData Engineer! Our expectations Required 4+years ofexperience building pipelines for processing large amounts ofdata Proficiency with Python (OOP, working with API, data processing) and SQL Experience with Spark and Spark Structured Streaming (Databricks) Experience with AWS and cloud-based computing (EC2, S3, Athena, Redshift) Experience with CI-CD automation (GitHub Actions, Jenkins orsimilar) Understanding Big Data formats: parquet, avro, delta Understanding datalake architecture Experience with Kafka orRabbitMQ Experience working with cross-functional teams and business customers Astrong sense ofownership and aproactive approach toowning and solving problems Excellent verbal and written English skills towork inaninternational team environment Nice tohave Basic Java dev skills Experience with Airflow (orsimilar orchestration tool) Your responsibilities Develop and maintain scalable data pipelines Gather requirements, scope, architect, develop, build, release, and maintain data-oriented projects for various parts ofthe organization while maintaining performance, stability, and error-free operation Identify and resolve pipeline issues and identify opportunities for improvement Architect scalable and reliable data solutions tomove data across systems from multiple products innearly real-time Help evaluate new tools and technologies tokeep the technology stack onthe cutting edge Help debug critical issues incomplex designs orcoding schemes Monitor existing metrics, analyze data, and partner with other internal teams tosolve difficult problems creating abetter customer experience Create and maintain architectural and system documentation What weoffer Asense ofcommunity and friendship, diversity, and inclusivity Informal working environment with short decision-making chains Flexible work hours and remote work options Established personal development processes Support ofprofessional training and certification Regular company events (ITRexTalks, Q&A sessions with the CEO, Tech Meet-Ups) Social benefits (medical insurance, sports reimbursement, and free English classes)