Data Engineer

Location: Sweden Salary: €550 - €575 per hour
Sector: Consultancy Type: Contract
Reference #: CR/079684_1619595791

Data Engineer / Malmo (Remote working during pandemic) / 6 months / Start ASAP


* Broad knowledge of SQL for data processing and analysis
* Broad knowledge of programming languages (e.g. Java, Go, Python, or Scala), including concepts from functional and object-oriented programming paradigms
* Good knowledge of new and emerging tools for extracting, ingesting, and processing of large datasets (Apache Spark,
* Apache Beam, Kafka, or equivalent) "
* Good knowledge of collaborative software engineering practices (Agile, DevOps), in which solutions evolve through theeffort of self-organising cross-functional teams

The main tasks this person will support with are:

* Integrate into an agile scrum team and apply agile ways of working in relation to software development, including rapid prototyping and outcome-based evaluation
* Work with and contribute to a DevOps setup (continuous integration, etc.) for test-driven development on GoogleCloud Platform
* Write demanding SQL queries that Extract, Transform and Load data from storage to an appropriate format, using joins, nesting and similar operations as an integral component of data processing pipelines to facilitate reporting and analytics
* Produce all required design specifications
* Set up monitoring for data quality. Implement data validation checks and data quality dashboards, in order to ensure a high degree of trust in the data residing in the systems, as well as in the decisions supported by insights extracted from it