Senior Data Engineer at Red River | North Carolina | Rezi

Senior Data Engineer at Red River

Senior Data Engineer

Red River · North Carolina

Yesterday

Senior Data Engineer

Red River · North Carolina

a day ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

This role involves architecting and implementing complex, high-volume data pipelines, administering the Databricks platform, designing AI-driven workflows, operationalizing MLOps, and implementing machine learning models. You will also lead application security initiatives and collaborate with security teams.

Responsibilities

  • Orchestrate pipeline scheduling, dependency management, and automated failure recovery using Apache Airflow.
  • Administer the enterprise Databricks platform by configuring IAM roles, managing credentials, and establishing workspace governance policies.
  • Design and deploy intelligent retrieval architecture and AI-driven workflows using vector-based search methods.
  • Build marketing retrieval and decision-automation applications that integrate multiple data sources and APIs.
  • Operationalize MLOps methodologies using MLflow for experiment tracking and model registry management.
  • Implement automated post-production model performance tracking for predictive accuracy optimization.
  • Implement end-to-end machine learning models and deliver stakeholder-facing analytical outputs.
  • Build Named Entity Recognition (NER) systems using TextBlob, gensim, and fastText.
  • Develop predictive models using XGBoost and Scikit-learn.
  • Construct deep learning architectures using Keras.
  • Design time-series forecasting models for event-based user adoption prediction.
  • Manage CI/CD pipelines using Git and Tekton for reliable code delivery.
  • Build and manage container images using buildah and skopeo, pushing to internal container registries.
  • Lead the deployment and maintenance of containerized data science models and enterprise applications on Red Hat OpenShift (Kubernetes).
  • Manage network routes, TLS termination, and container orchestration for high-availability services.
  • Lead application security initiatives by completing comprehensive enterprise security compliance assessments.
  • Perform static application security testing (SAST) using SonarQube.
  • Execute vulnerability scanning using Qualys and pip-audit.
  • Complete Privacy Impact Assessments (PIA).
  • Conduct STRIDE-based threat modeling.
  • Collaborate with enterprise information security teams to remediate identified vulnerabilities.
  • Navigate compliance audits.
  • Maintain centralized logging and monitoring through Splunk.

Requirements

  • Master's degree (U.S. or foreign equivalent) in Computer Science or related field and three (3) years of experience in the job offered or related role OR Bachelor's degree (U.S. or foreign equivalent) in Computer Science or related field and five (5) years of experience in the job offered or related role.
  • Three (3) years of experience with architecting and implementing high-volume data pipelines between Snowflake and Databricks using PySpark and dbt.
  • Three (3) years of experience developing macro-driven data quality test frameworks and validation logic.
  • Three (3) years of experience orchestrating and scheduling data pipeline workflows using Apache Airflow.
  • Three (3) years of experience configuring IAM roles for secure cloud object storage (Amazon S3) access.
  • Three (3) years of experience managing application secrets through platform vault systems and OpenShift secrets.
  • Three (3) years of experience establishing workspace governance and cluster policies for cross-functional teams.
  • Three (3) years of experience building Named Entity Recognition (NER) systems using TextBlob, gensim, and fastText.
  • Three (3) years of experience developing predictive models using XGBoost and Scikit-learn.
  • Three (3) years of experience constructing deep learning architectures using Keras.
  • Three (3) years of experience designing time-series forecasting models for event-based prediction.
  • Three (3) years of experience delivering full-scale information retrieval systems using Transformer architectures and Transfer Learning methodologies.
  • Three (3) years of experience operationalizing MLOps methodologies using MLflow.
  • Three (3) years of experience implementing automated post-production model monitoring.
  • Three (3) years of experience managing CI/CD pipelines using Git and Tekton.
  • Three (3) years of experience building and publishing container images using buildah and skopeo.
  • Three (3) years of experience deploying containerized applications on Red Hat OpenShift (Kubernetes).
  • Three (3) years of experience managing network routes, TLS termination, and high-availability configurations on OpenShift.
  • Three (3) years of experience leading enterprise security compliance assessments.
  • Three (3) years of experience performing static application security testing (SAST) using SonarQube.
  • Three (3) years of experience executing vulnerability scans using Qualys.
  • Three (3) years of experience completing Privacy Impact Assessments (PIA).
  • Three (3) years of experience conducting STRIDE-based threat modeling.

Skills

  • PySpark
  • dbt
  • Apache Airflow
  • Databricks
  • IAM roles
  • Amazon S3
  • OpenShift secrets
  • Vector-based search
  • MLOps
  • MLflow
  • Lakehouse monitoring
  • Named Entity Recognition (NER)
  • TextBlob
  • gensim
  • fastText
  • XGBoost
  • Scikit-learn
  • Keras
  • Git
  • Tekton
  • buildah
  • skopeo
  • Red Hat OpenShift
  • Kubernetes
  • SonarQube
  • Qualys
  • pip-audit
  • Splunk
  • NIST
  • CIS Controls
  • Transformer architectures
  • Transfer Learning

Location

  • U.S.

Work Type

  • Telecommuting
  • Remote

Experience Level

  • 3 years
  • 5 years

Education Level

  • Master's degree
  • Bachelor's degree

Salary/Compensations

  • $158,309 - $180,000/year

Benefits

  • Bonus
  • Commission
  • Equity

About the Company

  • Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies.
  • Associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role.
  • Red Hatters are encouraged to bring their best ideas, no matter their title or tenure.
  • We're a leader in open source because of our open and inclusive environment.
  • We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Equal Opportunity

  • Red Hat is proud to be an equal opportunity workplace and an affirmative action employer.
  • We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.
  • Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants.