Senior Data Engineer AWS and Big Data
- Employment type
- Freelance
- Location
- Bern · Remote possible
- First posted
Senior Data Engineer AWS and Big Data #
(m/f/d)
freelance/in temporary permanent employment for a project
Bern
Start date: 09/26
Reference number: 891064/1
Project information ###
• No sub-contracting possible, exclusively personnel leasing via Hays (Schweiz)
Tasks ###
• Development, operation and further development of an AWS-based data platform as well as modern data pipelines
• Ensuring and optimizing Spark ETL processes for efficient and reliable data processing
• Conception, implementation and maintenance of scalable data products within the AWS Big Data Stack
• Analysis of functional and technical requirements as well as their implementation into data solutions
• Close cooperation with data owners, data analysts and business stakeholders to provide high-quality data products
• Support and coaching of data engineers in the areas of automation, DevOps and best practices
• Further development of CI/CD processes and Infrastructure-as-Code approaches
• Optimization of existing AWS services regarding performance, stability and costs
• Support during the migration of existing data solutions to new technologies and platforms
• Cooperation with architecture teams to ensure a future-proof data landscape
Profile ###
• University degree in computer science or comparable professional experience in the field of data engineering
• Sound experience in data processing with Apache Spark, SQL and Python
• Practical experience in the development and operation of data platforms on AWS
• Knowledge of AWS Analytics Services such as Glue, Athena, Lambda, SageMaker or AWS Batch
• Experience in software development with Scala and/or Java is an advantage
• Know-how in CI/CD, DevOps methods and Infrastructure as Code (Terraform)
• Experience with agile working methods and modern development processes
• Strong analytical and conceptual skills
• Strong communication skills as well as enjoyment of working in interdisciplinary teams
• Very good German skills as well as good English skills in spoken and written form
Benefits ###
• Responsible and varied activity in a technically exciting environment
• Access to state-of-the-art technologies and tools
• Remote possibility
Automatically translated from the original.
Posted yesterday