Senior Principal/Staff Data Engineer

Senior Principal/Staff Data Engineer

Remote/Telecommute JobREMOTE / Toronto, Ontario, Canada  - Permanent
This job allows you to work remotely 


Job Description

Our client believe that understanding data is a fundamental skill and when leveraged well, it can be used to elevate even the best-designed products. This is why they're thrilled to be adding a Principal/Staff Data Engineer to their Platform team. They're looking for someone to work alongside their architects and project managers to improve and maintain the integrity of their data systems which are responsible for transforming the millions of raw logs they capture each day into actionable insights used by the whole company. These actionable insights are foundational to improving the user experience in their games in a meaningful way. This role is intended for a highly experienced and technically proficient candidate.

You'll be Working on Meaningful Things Like:

● Acquiring a complete understanding of how data moves and is transformed across systems from raw event logs to critical reports consumed by internal teams
● Creating and maintaining optimal data pipelines within architecture
● Building jobs and tools on top of the data pipeline to provide actionable insights into key metrics
● Debugging discrepancy issues that come up in the ETL (e.g. misaligned metrics with 3rd parties, duplicates, failures in the ETL, performance bottlenecks)
● Building tools to automate data verification and ensure the integrity of our reported metrics
● Integrating data from multiple sources across internal and external partners
● Working alongside Architects and Project Managers to strive for greater functionality in our data systems


Must Have Skills:

● Strong SQL skills
● Experience with tools used for large scale data processing: Spark, Hadoop, Kafka
● Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Kinesis, API Gateway, Lambda, Cloudformation
● Experience with object-oriented, functional, and scripting languages: Scala, Python, Java
● Experience with relational SQL and NoSQL databases, including Redshift, Postgres, Redis, and MySQL
● Knowledge of message queuing, stream processing, and highly scalable ‘big data’ technologies
● Understanding of the different federated querying, data warehousing, and BI technologies and how they work together to form a Data Platform


Nice to Have Skills:

● Knowledge of Machine Learning and experience implementing ML applications
● Worked with real-time and streaming analytics
● Experience building tech that operates at scale
● Contributed to an Open Source Project


Details:

Starting: ASAP
Travel: 0%
Dress Code: Casual







Similar jobs in Toronto:

Similar jobs in other locations: