Data Engineer - Talend / Pyspark

Data Engineer - Talend / Pyspark

Remote/Telecommute JobREMOTE / Toronto, Ontario, Canada  - Permanent
This job allows you to work remotely 


Job Description

Our client is a custom consulting firm that designs and builds high-performance, enterprise solutions with accentuation on robust architecture, and a perfect user experience.​ They are looking for experienced Data Engineers to add to their growing team of 100 plus people here in Toronto. If being part of a fast-paced agile environment is important to you, then you are in the right place!


Must Have Skills:

-Experience building and optimizing big data pipelines, architectures and data sets
-Build ETL using Talend software.
-Build and deploy data integration and Spark jobs.
-Responsibility includes building reconciliation ,exception handling, error management and other operations as part of development.
-Hands On Experience in Spark - Developing Efficient Pipelines in Cluster Compute Environment
-Hands on experience with Talend Cloud Management Console and Talend Cloud Pipeline Designer
-Build processes supporting data transformation, data structures, metadata, dependency and workload management
-Expertise on all data management aspects - Data Quality, Data Mapping, Data Analysis, Logging, Exception Management.
-Building CICD Pipelines - Experience in Continuous Integration and Deployment practices and tools (Jenkins or equivalent, Maven, Git, developer efficiency tools).
-Experience building data platforms with Hadoop stack (MapReduce, Hive, Hbase)
-Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations.


Tech Stack you can expect to play within:
-Talend Open Studio / Talend Big Data Studio / Talend Data Fabric
-Spark, Scala, Python
-Kafka
-Hive
-Hadoop Ecosystem Tools


Details:

Starting: ASAP







Similar jobs in Toronto:

Similar jobs in other locations: