About the Role
Join our team at smartclip as a Software Engineer, Data Platforms. You will design and build the engines that process, transform, and refine terabytes of TV and advertising data every single day. Your goal is to ensure our data platform is scalable, resilient, and cutting-edge.
Responsibilities
- Design and implement technical solutions for Big Data applications in an agile, high-performance environment.
- Continuously develop and refine data aggregation pipelines (TV data, advertising, and forecasting) primarily based on Spark and Scala.
- Host, manage, and scale solutions using Docker and Kubernetes within the AWS cloud.
- Lead the way in test automation – from unit tests to complex integration tests.
- Evaluate new frameworks and tools, share findings with the team, and help stay at the forefront of Big Data technology.
Requirements
- Test Driven Development (TDD) is the only way to build reliable systems.
Skills
- Big Data
- Spark
- Scala
- Docker
- Kubernetes
- AWS
- Test automation
- Unit tests
- Integration tests
- TDD
