About the Role
We are looking for a Senior Software Engineer to join our globally distributed Data Platform team in Europe and play a key role in shaping the future of our data ecosystem. In this high-impact individual contributor role, you'll lead the modernization of our core data platform by migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a scalable, cloud-native Databricks architecture. You'll have the opportunity to drive technical decisions, influence platform architecture, and build the foundation that powers data across the business.
Responsibilities
- Lead the modernization of our data platform by migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern, scalable Databricks ecosystem.
- Re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.
- Leverage AI coding assistants such as Claude and Codex to accelerate migration efforts by guiding AI tools to convert SQL, modernize ETL scripts, untangle dependencies, and generate clean, maintainable code.
- Design, develop, and optimize scalable data workflows using Airflow and Databricks.
- Create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.
- Ensure the accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies.
- Help drive operational excellence by enhancing observability, monitoring, and incident response practices.
- Contribute to service reliability through SLOs/SLAs and participate in a scalable on-call rotation to support production systems.
- Apply understanding of contact center analytics to build platforms that power customer conversation insights, reporting, and business intelligence.
- Embrace a data-driven mindset, designing systems that are measurable, observable, and continuously improving.
Requirements
- 6–8 years of experience building and supporting distributed systems and large-scale data platforms, with a proven ability to own complex technical initiatives from design through production.
- Hands-on experience leading or playing a key role in migrating enterprise data platforms from legacy technologies—such as Hadoop, Spark, Hive, or Impala—to modern cloud-based solutions like Databricks.
- Strong knowledge of the Databricks ecosystem, including Jobs, Delta Lake, cluster configuration and optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL.
- Advanced Python programming skills for ETL development and extensive experience designing, building, debugging, and optimizing production data pipelines and orchestration workflows using Airflow and Databricks.
- Experience working with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with an understanding of containerized, Kubernetes-based (GKE) microservice architectures.
- Strong understanding of distributed data processing architectures and the trade-offs between real-time and batch data processing.
- Hands-on experience with legacy big data technologies, including Hadoop and MapReduce, with the ability to modernize and migrate complex data ecosystems.
- Knowledge of data integration patterns, including APIs, connectors, webhooks, and event-driven architectures.
- Experience building, deploying, and managing cloud-native data platforms, with Google Cloud Platform (GCP) experience preferred.
- Familiarity with containerized environments and running data workloads on Kubernetes.
- A strong focus on building highly reliable, scalable, and observable platforms, with experience implementing monitoring, validation, and data quality controls to ensure successful migrations.
- Experience using AI-powered development tools such as Claude, Codex, or similar coding assistants to accelerate software development, code modernization, and platform migrations.
- Skilled at effectively prompting, reviewing, and validating AI-generated code while ensuring architectural integrity, maintainability, and production readiness.
- Excellent communication and collaboration skills, with experience partnering across engineering teams in multiple time zones.
- Comfortable working in a globally distributed environment with colleagues across the US, Europe, Israel, and India.
- Experience working with conversational AI, contact center platforms, or customer engagement technologies.
- Proficiency in Java or Scala, particularly when analyzing, maintaining, or modernizing legacy codebases during platform migrations.
- Experience designing, implementing, and maintaining CI/CD pipelines to support automated testing, deployment, and reliable software delivery.
Skills
- Databricks
- Delta Lake
- Spark SQL
- Python
- ETL
- Airflow
- Google Cloud Platform (GCP)
- Google Cloud Storage (GCS)
- Kubernetes (GKE)
- Hadoop
- MapReduce
- APIs
- Connectors
- Webhooks
- Event-driven architectures
- Claude
- Codex
- Java
- Scala
- CI/CD
Location
- Berlin, Germany
Work Type
- Fully Remote
Experience Level
- Senior
Benefits
- Additional Pension scheme: deferred pension scheme (LivePerson contributes 20%)
- ESPP
- Annual bonus depending on achievements
- Internet and Mobile reimbursement
- Access to internal professional development resources
- Flexible Paid Time Off (PTO): Personal time off 33 days, vacation (28 days) and care days (5)
- Paid Public Holidays
- Volunteering Days
About the Company
- LivePerson (NASDAQ: LPSN) is a leader in trusted enterprise conversational AI and digital transformation.
- The world's leading brands use our award-winning Conversational Cloud platform to connect with millions of consumers.
- We power nearly a billion conversational interactions every month, providing uniquely rich data analytics and safety tools to unlock the power of conversational AI for better business outcomes.
- Fast Company named LivePerson the #1 Most Innovative AI Company in the world.
- As leaders in enterprise customer conversations, we celebrate diversity, empowering our team to forge impactful conversations globally.
- LivePerson is a place where uniqueness is embraced, growth is constant, and everyone is empowered to create their own success.
- We're very proud to have earned recognition from Fast Company, Newsweek, and BuiltIn for being a top innovative, beloved, and remote-friendly workplace, and recognized by Gartner as a leader in the Conversational AI space.
Equal Opportunity
- We are committed to fostering an inclusive workplace and are proud to be an Equal Opportunity Employer (EOE).
- We believe that diverse perspectives drive innovation.
- All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristics protected by US Federal, State, or Local law.
- LivePerson is dedicated to the accessibility needs of our applicants and employees.
- We provide reasonable accommodations to job applicants with disabilities.
- Applicants who require a reasonable accommodation for any part of the application or hiring process should inform their recruiting contact upon initial connection.
