Senior Data Engineer / Architect
A giant in the gaming industry is looking for an expert who can design the architecture as well as build the infrastructure.
Responsibilities
- Develop, construct, test, and maintain the data architecture
- architecting and building the big data stack from scratch
- Ensure that the architecture will support the requirements of the business
- Discover opportunities for data acquisition
- Develop data set processes for data modelling, mining and production
- Implement secure and scalable API endpoints to make available the computed data
- Recommend ways to improve data reliability, efficiency and quality
- Collaborate with data analysts/-scientists and the Business Intelligence Team to implement new ELT pipelines
Qualifications
- Experience in architecting and building the big data stack from scratch with minimal support highly desired
- Understanding of Cloud architecture in the big data and data warehousing space
- Preferred proficiency with Python/Java, shell scripting, system diagnostic and automation tooling
- Expertise in building and maintaining Hadoop clusters in a Hybrid environment
- Extensive experience in Big Data technologies and solutions (Spark, Hadoop, Hive, HDFS)
- Experience in building Data Streaming pipelines (Spark, Flume, Kafka, Kinesis, Flink, etc.)
- Strong experience in designing and implementing highly available high-volume messaging infrastructure with Apache Kafka
- At least 5 years of professional experience in data engineering , data science or another related field with experience in manipulating and processing huge data sets
If you are interested in this position please send an email to katharina.tregub@adaptive-digital.com. Thank you!