Full Stack Data Engineer

Full Stack Data Engineer

Kitchener/Waterloo, Ontario  - Permanent

Job Description

Our client's ML platforms leverage automotive manufacturing and vehicle data to detect the earliest indicators of and to predict future product failures. They help automakers optimize safety, quality, and reliability throughout the entire product life cycle, from the assembly line to the finish line.

As a Data Engineer, you will work closely with the Data Science, UI and Back-end Engineering departments to create a full machine learning lifecycle and develop tools for 2 different SaaS product lines. The manufacturing product enables automakers to identify anomalies in production data for enhanced testing, rapid root cause analysis, and significantly improved manufacturing output. The in-field data platform enables predictive maintenance of connected and autonomous vehicles based on production, maintenance and on-road data.

Some of your responsibilities would include:
• Building, maintaining, configuring, and deploying ETL systems
• Building CI/CD workflows for deploying production ML models
• Hardening ML models/services for production environments
• Setup infrastructure alerts, monitors, and logging
• Efficiently scaling ML model services

Must Have Skills:

• Minimum of 3 - 5 years of software engineering experience
• Ability to work in a fast paced agile environment
• Experience using Git in a team environment
• Flexibility to adjust to changing priorities, requirements, and schedules
• Experience with database systems: e.g., Postgres
• Experience with authentication systems: e.g., OAuth + JWT tokens
• 2+ years Python experience
• Experience with cloud services/frameworks such as Azure , AWS, Spark
• Experience with cloud orchestration: e.g., docker containers and kubernetes
• ETL Experience with time-series and operations data
• Exposure to tensorflow and sklearn
• Available in office full-time (KW)
• Experience developing parallel algorithms or developing high concurrency systems


Starting: ASAP