Data Engineer

Location: Sweden Salary: 450kr - 500kr per hour
Sector: Consultancy Type: Contract
Reference #: CR/079339_1617975825

Data Engineer / Sweden (Remote) / 12 months / Start ASAP

This is a combination of on-prem + AWS technologies


* Experience working with large scale data systems using Hadoop and its ecosystem.
* Experience working with Scala/Java/Python
* Good knowledge on S3 and creating Data Pipelines
* Good knowledge on Lambda functions and AWS Kinesis/Kafka
* Hands on experience with YARN & Spark with relevant experience is fine tuning & optimizing SPARK applications
* Working experience implementing data ingestion using HDFS, KAFKA, Spark, Scala/Java with Streaming.
* Strong experience in Hadoop technologies like HBASE, HIVE and help build prototypes for new tools/products
* Should have good handle in database queries and Unix background
* Good understanding an experience of real time/stream processing
* Airflow knowledge
* Good understanding of CI/CD with GitHub and git actions.