About the Role
Join Questrade as a Senior Cloud Data Platform Engineer and be a catalyst for change, using AI to transform and deliver unparalleled customer experiences. Shape a future where AI empowers our teams to do their best work in a diverse, inclusive, and hybrid workplace. This role is at the heart of our real-time data infrastructure, owning the streaming backbone that powers Questrade's market data, event-driven architectures, and operational analytics.
Responsibilities
- Design, build, and operate high-throughput, low-latency Kafka streaming pipelines for market data, transactional events, and operational telemetry
- Architect and implement Change Data Capture (CDC) solutions using Debezium, Kafka Connect, and related tooling to enable real-time data synchronization across operational and analytical systems
- Build, tune, and maintain ClickHouse OLAP clusters — including schema design, materialized views, MergeTree engine family selection, distributed query optimization, and data compression strategies
- Create and maintain optimal data pipeline architecture across streaming and batch workloads
- Design and create new features and automated solutions that meet functional and non-functional business requirements
- Identify, design, and implement internal process improvements: automating manual processes, implementing data governance rules, re-designing infrastructure for greater scalability
- Maintain in-depth understanding of data protection and network security rules on Cloud Infrastructure
- Monitor and manage Kafka cluster health, consumer lag, throughput, schema governance (Schema Registry), and topic lifecycle management
- Expand and increase data platform capabilities to resolve new streaming data problems by identifying, sourcing, and integrating new features and technologies
- Work with stakeholders to support data-related technical issues and data infrastructure needs
- Peer review code and promote DevOps culture within the data teams
- Apply ownership in practice: if you see a problem in the platform, do not wait for it to be assigned — awareness is the first act of responsibility
- Explore AI integrations into the Data Engineering development cycle
- Have a good understanding of data platform best practices to achieve economies of scale, cost reduction, and efficiencies.
Requirements
- Minimum 3+ years of data engineering experience, with at least 2 years focused on streaming and event-driven architectures
- Strong expertise in Apache Kafka: cluster operations, topic design, Kafka Connect, Kafka Streams, Schema Registry (Avro/Protobuf), consumer group management
- Hands-on experience with Change Data Capture (CDC) patterns and tooling — particularly Debezium, Kafka Connect CDC connectors, Datastream and event sourcing principles
- Experience with ClickHouse: MergeTree engine family, materialized views, distributed table design, query optimization, compression codecs, and performance tuning for real-time analytics
- Proficiency in SQL (including ClickHouse SQL dialect) and Python
- Experience with any of the major cloud platforms (GCP preferred; AWS or Azure also considered)
- GCP data platform knowledge is a strong asset: Dataflow, Dataproc, Cloud Pub/Sub, Cloud Composer, BigQuery, CloudSQL
- Strong knowledge of message broker and streaming systems (Kafka, Google Pub/Sub, Kafka MirrorMaker)
- Experience with CI/CD pipeline tooling and development practices
- Experience building Terraform scripts for infrastructure-as-code
- Good knowledge of Airflow operators and DAG configuration
- Good knowledge of popular data standards and formats (JSON, Avro, Protobuf, Parquet, ORC)
- Experience with stream processing frameworks (Apache Flink, Spark Structured Streaming, or GCP Dataflow) is a strong asset
- Data modeling skills with experience in both streaming and batch paradigms
- Experience with OLAP databases beyond ClickHouse (BigQuery, Druid, Redshift) is a plus
- Experience with ML Model Training using Google Vertex AI is an asset
- Experience in the financial services industry is an asset
Skills
- Apache Kafka
- Kafka Connect
- Kafka Streams
- Schema Registry
- Debezium
- ClickHouse
- SQL
- Python
- GCP
- AWS
- Azure
- Dataflow
- Dataproc
- Cloud Pub/Sub
- Cloud Composer
- BigQuery
- CloudSQL
- Kafka MirrorMaker
- CI/CD
- Terraform
- Airflow
- JSON
- Avro
- Protobuf
- Parquet
- ORC
- Apache Flink
- Spark Structured Streaming
- GCP Dataflow
- Data modeling
- Druid
- Redshift
- Google Vertex AI
Location
- Hybrid
Work Type
- Hybrid
- Full-Time Permanent
Experience Level
- Senior
Salary/Compensations
- $130,000 - $150,000
Benefits
- Health & wellbeing resources and programs
- Paid vacation, personal, and sick days
- Competitive compensation and benefits packages
- Competitive incentive (bonus) program
About the Company
- Questrade Financial Group (QFG) provides securities and foreign currency investment, professionally managed investment portfolios, mortgages, real estate services, financial services and more.
- We use cutting-edge technology to help Canadians become much more financially successful and secure.
- At QFG, we combine human-centric collaboration with AI-driven innovation to redefine financial services.
- Questrade exists for one reason: to help Canadians grow and protect their wealth.
- Every system we build, every pipeline we design, every stream we process — it all connects back to that promise.
- The Questrade Enterprise Shared Services (Quest Corp) operates across a hybrid cloud environment spanning our own data centres and Google Cloud Platform, and we move fast by design.
- We are on a mission to not just process transactions and go home.
Equal Opportunity
- At Questrade Financial Group of Companies, with multiple office locations around the world, we are committed to fostering a diverse, inclusive and accessible work environment.
- This is an environment where individuals are treated with dignity and respect.
- Here, the unique skills and experience you bring will be valued.
- You will be supported and motivated, so that you can harness your unlimited potential.
- Our team reflects the diversity of the communities we serve and operate in.
- Having a collaborative and diverse team helps us push boundaries to bring the future of fintech into existence—not only for the benefit of our customers, but for those who build their career with us.
- Questrade Financial Group of companies Applicant Tracking System utilizes artificial intelligence (AI) for application screening.
- The AI system operates on predetermined criteria, with final decisions subject to human review.
- Candidates selected for an interview will be contacted directly.
- If you require accommodation during the recruitment/selection process, please let us know and we will work with you to meet your needs.
