Python Data Engineer



Python Data Engineer

Montreal, Quebec  - Permanent


Job Description

Our client is one of the first networks devoted to helping B2B enterprise. Our first-of-its-kind Sales Analytics platform combines a proprietary, self-learning network with applications that is ready to use, data backed, and built on predictive analyses.

We are looking for a Python Data Engineer who will work closely with the data science team to create and enhance software that enables state of the art data processing, data analysis and machine learning.

You will be developing:


Working closely with the data-science team to create and enhance software that enables state of the art data processing, data analysis and machine learning
Developing and deploying data pipelines and machine learning pipelines using tools like Airflow, Spark, SparkML
Performing unit tests and conducting reviews with other team members to make sure the code is rigorously designed, elegantly coded, and effectively tuned for performance
Diagnosing, troubleshooting and resolving production issues


Must Have Skills:

4+ years of software development experience in a production environment
3+ years of experience building robust and scalable data processing pipelines using Python and Spark (PySpark)
2+ years of experience writing SQL and interacting with NoSQL databases (Mongo, Elastic Search)
2+ years of experience with the spark software stack and package distribution
Experience with Agile methodology, using test-driven development
Passion to learn quickly and work independently
Talent to write well designed, fully-documented, testable, efficient code
Understanding of Continuous Integration, Continuous Deployment and Test Automation to enable the rapid delivery of working code utilizing tools like Jenkins, Git, Gitflow
Good understanding of big data architecture, frameworks, and design patterns


Details:

Starting: ASAP
Travel: 10%