Data Engineer in Techstack Ltd

Data Engineer Kyiv, Kharkiv, Lviv, Wroclaw (Poland), remotely About the product: Our partner is an American company specializing in the development of innovative artificial intelligence technologies to revolutionize the operational activities of large companies in the field of oil refining. Their innovative product has already attracted the attention of key players in the industry, such as Shell and Chevron. With the help of the implementation of this system, large enterprises modernize and speed up the processing and analysis of statistical data, receive an optimized flow of documents, and effectively manage resources and warehouses. With these improvements, companies can expect to increase efficiency, reduce costs and gain a competitive advantage in the market. Technology stack: Python LangChain Jupyter Notebook Databricks, Iceberg, or similar Azure Microservices, MLOps Your team: You can become a valuable member of the development team. Our team consists of Solutions Architect, Back-End Engineer, Front-End Engineer, and QAEngineer. Working with a team of professionals, you will play a key role in the creation of important business tools. By joining our team, you will not only get into a dynamic environment that promotes innovation, but you will have the opportunity to leave an unforgettable mark on the technological landscape. Culture: We implement high standards in the technology industry—this is the principle of our work. To live up to this principle, Techstack and its members are always moving forward. Each employee has the opportunity to make their own contribution to the product, company, team, industry and personal development. Also, at Techstack, you can choose an interesting development format for you: —metapes, where you can share your knowledge and develop at the same time, spreading your own experience within the company and local technical communities; —the roles of mentor, technical expert or technical lead. Holding one of these positions, you will help junior specialists to share their knowledge and experience; — participation in our technical guilds, we can discuss technical solutions, approaches and industry trends. All this forms our technical culture and expertise of the company. Your responsibilities: use of lakehouse technology (Databricks, Iceberg or similar) for effective data management; deployment and optimization of solutions to the Azure cloud service; implementation of Graph Tuckering by databases for efficient data connections; compliance with engineering practices to optimize data flows; cooperation with DevOps to ensure a reliable and scalable data infrastructure; providing data cleaning and pre-processing for high-quality data sets; research and use of machine learning in data processing processes; using Jupyter Notebooks and Python for data manipulation analysis. About you: you have 4 years of experience working with Data Wrangler or similar tools; you have expertise with lakehouse technologies (Databricks, Iceberg, etc.); you use Azure cloud services for submitted solutions; you have practical experience with Graph databases; familiar with the principles of rapid engineering practices for working with effective data flows; understand DevOps practices in a data-driven environment; you have strong data cleaning and pre-processing skills; byapply machine learning to data processing; you use Jupyter Notebooks and Python for data analysis; you have experience in generative artificial intelligence and LangChain technologies. What we have for you: a stable and long-term position in an experienced team; wide opportunities for professional and career growth — professional challenges that motivate youth, meetups, hackathons, professional communities, etc.; direct communication with stakeholders and the opportunity to influence product development; horizontal connections and the absence of micromanagement instead of a traditional hierarchy—all teammates are available to each other on all issues; hubs in Kharkiv, Kyiv, Lviv and Wroclaw (Poland) or everything necessary for remote work; up to 50% compensation for the cost of educational courses and conferences for professional growth; free English and business English courses; legal bookkeeping support; Appreciation gifts for significant events and occasions. Stages of joining Techstack: 1) preliminary screening by a recruiter; 2) review of your resume by experts; 3) checking the level of the English language; 4) interview by a knowledgeable expert; 5) interview by a knowledgeable partner. About us: Techstack is a technology product engineering company that brings high development standards to the IT industry and supports them. We give each team member the opportunity to influence the development of the product, company and processes. Learn more about Techstack Want to contribute? You are in the right place. Apply for a vacancy!