Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9yzwqty29tbwvyy2uvanbnl2jhbm5lci1kzwzhdwx0lwvulmpwzyjdxq

Data Engineer

Location: England Salary: €45 - €50 per hour
Sector: Consultancy Type: Contract
Reference #: CR/081184_1623421584

Data Engineer / Fully remote / 3-6 months / Start ASAP

Responsibilities:

Contractors will be part of the Commercial Analytics squad working in multiple
countries. The main responsibility is to
1. - Help deploy and operate prioritised models to PROD
2. - Educate CoE in DE and MLOps best practices and help draw up internal guidelines
3. - Assist in pipeline foundation development or tailoring to ACA CoE needs together
with the infrastructure department:
a. Data pipelines
b. CI/CD
c. Scheduling
d. Monitoring
All this to ensure the Advanced Commercial Analytics department reaches it
commercial goals in 2021. All tasks will be solved as part of multifunctional
DevOps squads consisting of broad capabilities delivering end to end Data Science
solutions. You will therefore be working closely with experienced Data Scientists
and Machine Learning Operations Engineers as well as the business units who are
consuming the data science services.

Requirements:

We are looking for a Data Engineer with a solid experience from building data
pipelines and working in an agile setup with participation in Sprints.

Required competences:

- Database fundamentals including MSSQL
- Database Performance tuning and Schema design
- Workflow orchestration using AirFlow or similar
- Linux/Bash
- Version control (Git/Bitbucket/DVC)
- Python (pandas, dicts, lists, PySpark)
- Common Data Formats (JSON, CSV, HDFS, Hbase, Parquet)
- ETL tools (E.g. IBM Data Stage or SSIS)
- Understanding Feature Stores (E.g. Hopsworks,Iguaziio/FEAST)