PySpark / Databricks Developer (Junior to Intermediate) at Electric Mind | CA | Rezi

PySpark / Databricks Developer (Junior to Intermediate) at Electric Mind

PySpark / Databricks Developer (Junior to Intermediate)

Electric Mind · CA

4 days ago

PySpark / Databricks Developer (Junior to Intermediate)

Electric Mind · CA

5 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this PySpark / Databricks Developer (Junior to Intermediate) role.

Rezi rewrites your resume against Electric Mind's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the PySpark / Databricks Developer (Junior to Intermediate) posting at Electric Mind — free, in seconds.

About the Role

We are seeking a developer to build and maintain data pipelines on Databricks for a financial services/wealth management data platform. You will write transform code, fix pipeline issues, and help maintain the development, quality assurance, and user acceptance testing environments.

Responsibilities

  • Write and maintain PySpark transforms for silver and gold layer tables.
  • Work with Lakeflow Declarative Pipelines and Auto CDC / SCD Type 2 patterns.
  • Query and validate data in Unity Catalog across environments using SQL warehouses.
  • Debug failed pipeline runs by reading logs, tracing records, and fixing schema drift or data quality issues.
  • Maintain reference/lookup tables and utility scripts.
  • Write and update unit/integration tests for transform logic.
  • Participate in code reviews using GitLab feature branches and merge requests.
  • Keep documentation current.

Requirements

  • Comfortable writing clean, readable Python code, including functions, modules, and basic OOP.
  • Some exposure to Apache Spark/PySpark, or strong SQL skills with a willingness to learn Spark.
  • Working knowledge of SQL, including joins, aggregations, and window functions.
  • Basic Git workflow knowledge (branches, commits, pull/merge requests).
  • Ability to read other people's code and stack traces, and debug methodically.

Skills

  • Python
  • Apache Spark
  • PySpark
  • SQL
  • Git
  • Databricks
  • Delta Lake
  • Medallion architecture
  • CDC/SCD concepts
  • Azure
  • Kafka
  • CI/CD pipelines
  • GitLab CI
  • Financial services data environments

Location

  • Remote

Work Type

  • Full-time

Experience Level

  • Entry-level
  • Mid-level

About the Company

  • Electric Mind is a fast-growing, AI-native advisory and digital engineering firm.
  • We blend premium strategy expertise with cutting-edge AI-centric engineering to solve complex, meaningful problems for industry-leading clients.
  • We value diverse talent, innovation, and true client partnership.
  • We offer an environment where ideas matter and impact is visible.
  • We are a company scaling its capabilities and global footprint at speed.

Equal Opportunity

  • Electric Mind is committed to diversity in the workplace.
  • We are an inclusive employer and welcome and encourage applications from all qualified candidates.
  • Applicants’ needs will be accommodated during our recruitment and selection process; please advise us if you require accommodation.