Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9yzwqty29tbwvyy2uvanbnl2jhbm5lci1kzwzhdwx0lwvulmpwzyjdxq

Data Engineer

Location: Lithuania Salary: €45 - €50 per hour
Sector: Consultancy Type: Contract
Reference #: CR/081710_1625043642

Data Engineer / Fully Remote / 6 months / Start ASAP

Responsibilities:

Contractors will be part of the Risk & Compliance department working in multiple countries.

The main responsibility is to:

1. - Educate CoE in DE best practices and help draw up internal guidelines
2. - Assist in data pipeline development tailoring to the Risk & Compliance CoE needs
together with the infrastructure department:
a. Data pipelines
b. Scheduling
c. Monitoring

All this to ensure the Risk & Compliance Advanced Analytics department reaches
its goals in 2021. All tasks will be solved as part of multifunctional DevOps squads
consisting of broad capabilities delivering end to end Data Science solutions. You
will therefore be working closely with experienced Data Scientists and Machine
Learning Operations Engineers as well as the business units who are consuming
the data science services.

Requirements:

We are looking for a Data Engineer with a solid experience from building data
pipelines and working in an agile setup with participation in Sprints.

Required competences:

- Hadoop Ecosystem (Hive, NoSQL, HDFS)
- Database fundamentals including MSSQL
- Database Performance tuning and Schema design
- Workflow orchestration using AirFlow or similar
- Linux/Bash
- Version control (Git/Bitbucket/DVC)
- Python (pandas, dicts, lists, PySpark)
- Common Data Formats (JSON, CSV, HDFS, Hbase, Parquet)