Lead AI ML Engineer in A-Team Global

29 серпня 2024

Lead AI ML Engineer

віддалено

As a Lead AI ML engineer, you will play a crucial role in designing, developing, and deploying machine learning models and data pipelines. The ideal candidate will take full ownership, from problem definition through to delivering production-grade solutions, requiring strong initiative and self-direction. You will work closely with data engineers, data scientists, and business stakeholders to build scalable solutions that drive impactful business decisions. Your expertise in various data and machine learning tools will be essential in managing our data infrastructure and delivering high-quality AI/ML projects.

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field
• Proficiency in SQL and Python
• Experience with data integration tools like Airbyte
• Strong knowledge of data warehousing concepts and hands-on experience with Snowflake
• Experience with data transformation tools such as dbt
• Proficiency in using Databricks and Apache Spark for big data processing and machine learning
• Familiarity with Delta Lake for data lake management
• Experience with data visualization tools like Tableau
• Experience with relational databases like MySQL and PostgreSQL
• Strong analytical and problem-solving skills
• Excellent communication and teamwork abilities
• Ability to work in a fast-paced and dynamic environment

Preferred Qualifications:

• A strong individual contributor mindset, demonstrating high autonomy
• Knowledge of machine learning libraries and frameworks such as TensorFlow, PyTorch, or Scikit-Learn
• Experience with cloud platforms such as AWS, GCP, or Azure
• Relevant certifications in data engineering, machine learning, or cloud technologies

Responsibilities:

• Design, develop, and deploy machine learning models using Databricks and Apache Spark
• Implement data preprocessing, feature engineering, and model training pipelines
• Utilize dbt (data build tool) to transform and model data in Snowflake to prepare datasets for machine learning
• Use SQL and Python to analyze large datasets, derive meaningful insights, and build training datasets
• Conduct exploratory data analysis to identify trends, patterns, and anomalies
• Develop and maintain ETL pipelines using Airbyte to ingest data from various sources into Snowflake
• Manage and optimize data storage and retrieval using Delta Lake on Databricks to ensure efficient access for ML models
• Create and maintain interactive dashboards and visualizations in Tableau to communicate model results and insights to stakeholders
• Collaborate with data scientists to refine and improve machine learning models
• Monitor and evaluate the performance of deployed models, ensuring they meet accuracy and performance standards
• Work with relational databases such as MySQL and PostgreSQL for data storage and management as needed
• Communicate complex technical concepts and results to non-technical stakeholders effectively