Impress employers and recruiters.
Choose from hundreds of resume examples.

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

Allied Consultants, Inc is seeking an experienced Databricks Engineer to play a key role within a high-impact technical services team. This role involves designing, developing, and optimizing scalable data solutions on Databricks.

Responsibilities

• Design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing.
• Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting.
• Develop robust data models and implement data quality, validation, and governance frameworks.
• Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights.
• Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.
• Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives.
• Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system.
• Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements.
• Writes detailed description of user needs, program functions, and steps required to develop or modify computer program.
• Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.

Requirements

• 8 or more years of experience, relies on experience and judgment to plan and accomplish goals, independently performs a variety of complicated tasks, a wide degree of creativity and latitude is expected.
• 8 years of experience in IT, supporting the design, development, deployment, or delivery of technology solutions.
• 8 years of experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.
• 8 years of experience in data warehousing and dimensional data modeling (star/snowflake schemas).
• 8 years of experience implementing data governance, data quality, and data security practices.
• 8 years of experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.
• 8 years of experience with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).
• Excellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.
• 1 year of experience working in public sector or state government environments.
• 1 year of experience with CI/CD practices for data pipelines (DevOps, Git-based workflows).

Skills

• Databricks
• PySpark
• Scala
• SQL
• Python
• Apache Spark
• ETL/ELT
• Data Warehousing
• Dimensional Data Modeling
• Star Schemas
• Snowflake Schemas
• Data Governance
• Data Quality
• Data Security
• Lakeflow Declarative Pipelines (DLT)
• Delta Live Tables (DLT)
• Delta Lake
• Medallion Architecture
• Data Lakehouse Design
• Lakeflow Jobs (Databricks Workflows)
• Databricks Workflows
• Airflow
• Databricks SQL dashboards
• Databricks Apps
• CI/CD
• DevOps
• Git-based workflows

Location

• Austin

Work Type

• Hybrid
• Remote
• Onsite

Experience Level

• 8+ years

Education Level

• Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional)

Benefits

• Medical insurance (with employer cost sharing)
• Life insurance
• A 401(K) plan with company match
• Flexible spending through a cafeteria plan

About the Company

• Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies.

Equal Opportunity

• Allied Consultants is a proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.