Senior Data Engineer
Senior Data Engineer
This job allows you to work remotely
•Design and build highly efficient and reliable data pipelines to power our data lake and data warehouse.
•Architect and implement data systems to power high-performance analytics, machine learning, and reporting applications.
•Build a robust and automated testing framework across a wide variety of data stores to enforce data integrity.
•Harden monitoring and overall orchestration of DAG execution in Airflow to achieve improved ETL processing times and system availability.
•Implement access governance of production data systems to ensure compliance with our privacy and security policies.
•Mentor and coach other data engineers.
•Collaborate with our Data Science and Software Engineering teams to build data infrastructure that enables experimentation.
Must Have Skills:
•5+ years of experience designing and building reliable, scalable and maintainable data systems at top-tier software companies.
•Experience building data pipelines and ETL flows using Python and a workflow management system like Airflow or Luigi.
•Lead large technical projects that require collaboration with multiple functions to drive product and business outcomes.
•Experience building and maintaining data warehouses using Snowflake, Redshift or other similar systems.
•Strong product mindset, can advocate for users when collaborating with stakeholders from other areas, but can make trade-offs to account for business priorities.
•Resourceful and have a strong sense of ownership over your work.
•Design and write testable and maintainable code to produce quality systems using software engineering best practices.
Nice to Have Skills:
•Worked with Airflow, Spark, Kafka, AWS (in particular EMR) and/or Terraform.
•Experienced designing data stores to power BI platforms (for example, Looker).
•Built financial, loyalty, or rewards systems.
•Passionate about building the next generation rewards product.
•works in a fast-paced environment; startup experience is a bonus.