Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9yzwqty29tbwvyy2uvanbnl2jhbm5lci1kzwzhdwx0lwvulmpwzyjdxq

Data Engineer

Location: Spain Salary: €550 - €600 per day
Sector: Consultancy Type: Contract
Reference #: CR/082375_1627048047

Data Engineer / Remote / 3 months, then 12 month extension / Start ASAP

Responsibilities:

● Create: lead the creation of data processing services and exploration tools. The team you'll join is responsible for the creation of great tools that enable the sharing of data (batch/stream) across marketplaces, data discovery (with catalog and lineage systems) and privacy (GDPR data takeout and delete)
● Protect: improve the reliability and availability of the clients systems by gathering hard data, designing systems and creating or adapting code for increased service reliability and performance
● Improve: identify hidden areas of improvement in any process or system, including changing established rules and procedures
● Observe: Implement monitoring solutions enabling production systems to be monitored 24/7
● Share: Share knowledge and provide expert advice to client engineers as to how to best use the data platform tools as well as providing answers to their engineering needs, fostering a mixed development and operations culture
● Engineer: Design, develop and optimise all sorts of technology solutions

Skills:

● A degree in Computer Science, related branch or equivalent experience
● Strong analytical / problem solving skills
● Experience working with the Cloud (any of AWS, GCP, Azure) and Linux based systems
● A good understanding of the best practices for developing software (version control, CI/CD, automation, peer-programming, documentation, testing, …)
● Experience with Agile methodologies
● Proven ability and experience developing highly structured computer programs (Scala is a strong preference) and interested in learning more
● Experience with batch and streaming data processing tools (Spark, Kafka, Kafka Streams, etc.)
● Experience with "big data" NoSQL databases design and optimisation (S3, Hive, Redshift, etc)
● The desire to be constantly learning and see the coming challenges as a great opportunity to keep growing