Senior Data Engineer || Big Data Engineer @ DCV Global Recruitment in DCV Global Recruitment

Senior Data Engineer: Experienced in Scala, Python or Java and Unix/Linux environment on-premises Experience with developing RESTful APIs using Java Spring Boot Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL) Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins)Basic shell-scripting knowledge Understanding of big data modelling techniques using relational and non-relational techniques Needs to be a Self-starter, proactive and with a team focused attitude Willingness to learn and quick to adapt to changing requirements Experience and understanding of SDLC (Software Development Lifecycle) Good to have: Create/Update/Maintain shared Jenkins library Understanding or experience of Cloud design patterns Great communication skills Big Data Engineer (Hadoop) Experience in Python, pySpark and Unix/Linux environment on-premises Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Apache Spark, YARN, Hive, SQL) Experience with industry standard version control tools (Git, GitHub) and automated deployment tools (Ansible & Jenkins) Experience optimizing Spark jobs Basic shell-scripting knowledge Understanding of big data modelling techniques using relational and non-relational techniques Needs to be a Self-starter, proactive and with a team focused attitude. Willingness to learn and quick to adapt to changing requirements. Experience and understanding of SDLC (Software Development Lifecycle) Ability to work with business users and the team stakeholders such as project managers and architects. Excellent data analysis skills with experience dealing with large and complex data sets. Good knowledge of Structured Query Language (SQL) Highly analytical with excellent attention to detail. Experienced in analysing business requirements and turning them into effective functional solutions. Excellent communication, both written and spoken (in English). Demonstrable track record of delivery. Strong interpersonal skills and ability to both lead and contribute within a small team. Nice to have: Experience with time-series/analytics db's such as Elasticsearch Experience in Scala Experience with developing RESTful APIs using Java Spring Boot Familiar with Cloud technology components (preferred: GCP) ,[] Requirements: Scala, REST API, Spring Boot, Data pipelines, Spark, Yarn, Hive, SQL, Elasticsearch, Git, GitHub, Ansible, Data modelling, SDLC, Jenkins, Design Patterns, Communication skills, Data analysis, GCP