For one of our clients in the pipeline management industry, we are seeking experienced Infrastructure Programmers . Suitable candidates should have experience in pipeline transformation projects and a technical domain knowledge in data transformation and data migration acquired through years of practice. The programming language is secondary in this regard. Programming Experience: Ability to write data transformation pipelines (ETL pipelines) in any of the following languages: Python, Scala,
For one of our clients in the pipeline management industry, we are seeking experienced Infrastructure Programmers . Suitable candidates should have experience in pipeline transformation projects and a technical domain knowledge in data transformation and data migration acquired through years of practice. The programming language is secondary in this regard. Programming Experience: Ability to write data transformation pipelines (ETL pipelines) in any of the following languages: Python, Scala, or Java (or preferably a mix) Knowledge of DataFrame structures and standard binary file formats (such as Parquet) Knowledge of common data lake patterns Infrastructure Experience: Experience with GCP data and pipeline components such as Big Query, Big Table, Dataflow, Kubernetes DevOPS Experience: Experience with developing in GCP’s CI/CD environment Experience with Git Experience with monitoring one’s own pipelines and components through services such as Google Cloud Monitoring or simila For one of our clients in the pipeline management industry, we are seeking experienced Infrastructure Programmers . Suitable candidates should have experience in pipeline transformation projects and a technical domain knowledge in data transformation and data migration acquired through years of practice. The programming language is secondary in this regard. Requirements: GCP, ETL, Kubernetes, Git, Google Cloud, Datalake, Java, Data Lake, Scala, Python Tools: .