About the Role
We are seeking a Data Engineer passionate about data infrastructure, creating and enhancing data pipelines, and thriving in a product-focused environment. This role is crucial for our Data Engineering team, which empowers engineers, analysts, and data scientists with tools for data-driven decision making, analysis, and feature development. This is a 12-month fixed-term contract to backfill a maternity leave.
Responsibilities
- Coordinate with data scientists, data analysts, software engineers, and product managers to design and evolve existing architecture, improving data infrastructure reliability and performance.
- Build, maintain, and scale ETL pipelines to support data science, data products, and analytical needs.
- Design, build, and maintain data infrastructure systems including AWS DMS, HBase, EMR, Redshift, S3, Kafka, and Airflow, ensuring scalability, reliability, and security.
- Write new tools, services, and platforms in Python.
- Research new technologies to address future data infrastructure needs.
- Advocate for the adoption of tools within the data engineering team.
Requirements
- 4+ years of data engineering experience.
- Ability to write high-quality code in Python and PySpark.
- Strong understanding of database fundamentals and software engineering principles.
- Strong understanding of Data Contracts, microservices principles, and treating datasets/platforms as API-driven products.
- Deep understanding of two or more of the following technologies: Spark, Airflow, AWS EMR, AWS Glue, Sagemaker, and Redshift.
- Experience with batch processing and streaming systems.
- Exposure and/or strong interest in Kafka or other queuing technologies.
- Critical thinker with creative problem-solving skills.
- Quantitative skills, analytical thinking, and strong attention to detail.
- Desire to contribute to the broader development community.
Skills
- Python
- PySpark
- Spark
- Airflow
- AWS EMR
- AWS Glue
- Sagemaker
- Redshift
- Kafka
- Data Contracts
- Microservices
- API-driven products
- Batch processing
- Streaming systems
- Queuing technologies
Location
- Toronto
Work Type
- Hybrid
- Fixed-term contract
Experience Level
- 4+ years
Salary/Compensations
- $100,000 - $140,000 a year
About the Company
- Wattpad's vision is to entertain and connect the world through stories.
- Wattpad is a leading global webnovel platform that has democratized storytelling for a new generation of diverse Gen Z writers and their fans.
- Wattpad is part of WEBTOON Entertainment’s IP & Creator Ecosystem, with approximately 155 million monthly active users discovering stories in multiple formats.
- Wattpad is part of the WEBTOON Entertainment family of brands, home to some of the world's largest storytelling platforms.
- Wattpad is comprised of entrepreneurs and do-ers who are visionaries, community builders, passionate problem solvers, storytellers, and culturally diverse.
- The company is obsessed with its users, solving complex problems, maximizing flow, learning constantly, building the next great storytelling product, finding the greatest stories ever told, dogs, cats, coffee, and good snacks.
- Wattpad works autonomously, collaboratively, and respectfully, balancing work, family, and play.
Equal Opportunity
- Wattpad is an equal opportunity employer.
- Wattpad welcomes and encourages applications from people with disabilities.
- Accommodations are available on request for candidates taking part in all aspects of the selection process.
- Wattpad is committed to fostering a global team that reflects the diversity of the Wattpad community.
- Wattpad considers employment applicants without regard to age, race, colour, national origin, citizenship, religion, creed, sex, sexual orientation, veteran status, marital status, disability status or any other protected status.
