Data Engineer - BI & Data Science




Data Engineer - BI & Data Science

Toronto, Ontario  - Permanent


Job Description

Our client is a division of one of the worlds largest mobile commerce platforms which produces over 2 billion transactions a year, the majority of which occur on mobile apps. They pioneered and are the leader of QR based mobile payments in India, with over 300 million customers, they started out by offering mobile recharge and utility bill payments, and today they offer a marketplace to consumers on their mobile apps.

Their scale offers a very unique set of challenges and they are innovation around data/capabilities essential to scale even higher. They work with much longer horizons and accept trial and failure as part of building the right solution. They are about solving problems that have little or no precedent. These challenges require lots of creative thinking based upon a very deep understanding of how software works. You should have a very high degree of comfort in a programming language of your choice.

We offer a flexible work schedule and you get your choice of tools(both hardware and software) and most importantly the opportunity to work on tough problems with the brightest minds around you!

We are seeking a Data Engineer with a focus on BI, for our personalization and marketing automation team. This team has an impact on every pixel in our mobile app and drives customer engagement and growth by showing relevant products, services and messaging to our customers. Candidates should have technical skills to build real-time and batch data pipelines, and strong analytical capabilities to delve into and understand trends and patterns in the data. You will be working closely with world class software engineers, machine learning engineers and business teams, and the work you do will have a direct impact on the roadmap of our product.

Responsibilities:

• Build and maintain batch and real-time data pipelines to power our analytical reports and dashboards.
• Analysis of historical data to identify trends and support decision making, including written and verbal presentation of results and recommendations.
• Set up A/B tests and ensure metrics are reported accurately.
• Identifying data needs and driving data quality improvement projects.
• Evangelizing data driven decision making within the team and to business & product owners.
• Understanding the broad range of Paytm data resources, and knowing the right ones to use for the problems at hand.

Technical Requirements:

• Proficient in at least one programming language like Scala, Java or Python
• Experienced in Apache Spark, or other big data processing frameworks
• Proficient in SQL
• Proficient in software development, and source code management (Git etc)


Must Have Skills:

• BS degree or higher in computer science engineering, statistics, mathematics, econometrics, or a similar quantitative field.
• 3+ years work experience in data engineering, software engineering and/or data analysis.
• Prior success in working with extremely large datasets using big data technologies
• Demonstrated ability to directly partner with business owners to understand product requirements.
• Effective spoken and written communication to senior audiences, including strong data presentation and visualization skills.
• Detail-oriented, with an aptitude for solving unstructured problems


Nice to Have Skills:

• Familiarity with AWS services
• Experience with data streaming technologies like Kafka, Spark Streaming


Details:

Starting: ASAP