Impress employers and recruiters.
Choose from hundreds of resume examples.
Impress employers and recruiters.
Choose from hundreds of resume examples.
Tailor your resume to this Data Platform Engineer role.
Rezi rewrites your resume against Eigen Development's job description. Free.
Tailor your resume to this Data Platform Engineer role.
Rezi rewrites your resume against Eigen Development's job description. Free.
Don't guess if your resume is good enough.
See how it scores against the Data Platform Engineer posting at Eigen Development — free, in seconds.
Don't guess if your resume is good enough.
See how it scores against the Data Platform Engineer posting at Eigen Development — free, in seconds.
About the Role
Shift4 is seeking a Data Platform Engineer to build, maintain, and optimize data pipelines. This role focuses on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability, ensuring accurate and timely data delivery as the platform grows.
Responsibilities
- Operate, tune, and scale ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake, managing task sizing, autoscaling, consumer concurrency, batching, retries, and dead-letter handling.
- Own pipeline reliability by defining SLOs for freshness and lag, building alerting and dashboards, and leading incident response and root-cause analysis for pipeline failures.
- Build and maintain infrastructure as code, deployment automation, and CI/CD for pipeline services.
- Continuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion.
- Onboard new sources and consumers to the platform in partnership with application, data, and analytics teams.
- Apply data-quality and security controls appropriate for PCI-compliant or payment-handling environments, including encryption, secrets handling, least-privilege access, and audit trails.
- Proactively explore and apply AI tools to improve efficiency across the pipeline lifecycle.
Requirements
- 5+ years in platform, infrastructure, or DevOps roles supporting data-intensive systems in production.
- Deep hands-on AWS experience with ECS/Fargate, SQS, S3, IAM, CloudWatch, and Aurora/RDS.
- Proven track record tuning message-driven workloads, including consumer concurrency, backpressure, retries, idempotency, and throughput versus cost.
- Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring).
- Proficiency with infrastructure as code (Terraform/Ansible), containerization (Docker), and CI/CD pipelines.
- Experience with observability and alerting tools for pipeline health and lag (Prometheus/Grafana, CloudWatch, Datadog, or Elastic Stack).
- Sufficient Python skills to read, debug, and instrument worker code.
- Passion for automation, performance, and clean system design.
Skills
- AWS ECS/Fargate
- AWS SQS
- AWS S3
- AWS IAM
- AWS CloudWatch
- Aurora/RDS
- Snowflake
- Snowpipe/COPY
- Terraform
- Ansible
- Docker
- CI/CD
- Prometheus
- Grafana
- Datadog
- Elastic Stack
- Python
Location
- Remote
Work Type
- Full-time
Experience Level
- 5+ years
About the Company
- Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world.
- As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry.
Equal Opportunity
- We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.