Senior Data Engineer (Customer Data Products) at NBME | PA, US | Rezi

Senior Data Engineer (Customer Data Products) at NBME

Senior Data Engineer (Customer Data Products)

NBME · PA, US

2 weeks ago

Senior Data Engineer (Customer Data Products)

NBME · PA, US

15 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Senior Data Engineer (Customer Data Products) role.

Rezi rewrites your resume against NBME's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior Data Engineer (Customer Data Products) posting at NBME — free, in seconds.

About the Role

NBME is seeking a Data Engineer to enhance its AWS data product for medical doctors. This role involves modernizing and optimizing the data platform by building data lakes, complex data integration pipelines, and scalable data solutions to support analytics, AI/ML, and business decision-making. The position will also apply AI-assisted engineering practices to improve development efficiency and promote best practices across the IT organization.

Responsibilities

  • Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes, feature stores, and vector databases.
  • Partner with data scientists, AI researchers, architects, and stakeholders to identify, extract, clean, and format data for AI/ML model training and feature extraction.
  • Lead evaluation, research, and experimentation with batch and streaming data technologies, LLM data preparation frameworks, and MLOps tools.
  • Act as a technical lead to showcase emerging AI and data technologies, enabling adoption of modern data techniques.
  • Contribute to the definition and refinement of data engineering practice processes and procedures.
  • Educate and develop ETL developers on cloud-based data engineering initiatives.
  • Assure the integrity, accuracy, and security of corporate data.
  • Ensure high data quality for Data Services, Analytics, and Master Data Management.
  • Coordinate technical solutions, taking responsibility for designs, development, testing, and delivery.
  • Build automated, scalable, test-driven data pipelines.
  • Utilize software development practices like version control (Git), CI/CD, and release management to enhance existing CI/CD pipelines in AWS.
  • Collaborate with Data Engineers, DevOps engineers, and architects on DataOps tools and frameworks.

Requirements

  • Bachelor's Degree
  • At least 7 years of experience in application development (Internship experience does not apply)
  • At least 4 years of experience in big data technologies
  • At least 4 years' experience with cloud computing using AWS
  • 4+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years' experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL etc.)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift)
  • 6+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 7+ years of experience with Agile engineering practices
  • 7+ years of experience with SQL optimization
  • 4+ years of experience with PySpark
  • 3+ year of experience with process orchestration including AirFlow, KubeFlow, AWS step functions, or Luigi
  • Proven experience implementing Generative AI, LLM data preparation pipelines, and Vector Databases (e.g., Pinecone, Milvus, pgvector).
  • Strong experience building and maintaining Feature Stores for machine learning models.
  • Experience building highly scalable, secure, and production-ready APIs and Data-as-a-Service (DaaS) platforms.
  • AWS Certified Data Engineer or AWS Certified Machine Learning – Specialty certifications.
  • 3+ year of experience with Machine Learning
  • Experience with building a Data-as-a-service platform
  • Experience with building APIs

Skills

  • Python
  • SQL
  • Scala
  • Java
  • MapReduce
  • Hadoop
  • Hive
  • EMR
  • Kafka
  • Spark
  • MySQL
  • Mongo
  • Cassandra
  • Redshift
  • UNIX/Linux
  • shell scripting
  • PySpark
  • AirFlow
  • KubeFlow
  • AWS step functions
  • Luigi
  • Generative AI
  • LLM data preparation
  • Vector Databases
  • Feature Stores
  • APIs
  • Data-as-a-Service (DaaS)
  • Machine Learning

Location

  • Philadelphia

Work Type

  • Hybrid
  • Remote Friendly Workplace

Experience Level

  • Senior

Education Level

  • Bachelor's Degree

Salary/Compensations

  • $127,337 - $160,000/year

Benefits

  • Healthcare
  • Dental
  • Prescription
  • Vision plans
  • 401(k) w/match
  • Tuition Reimbursement Plan
  • Commuter Benefit: Public Transit or Parking options

About the Company

  • NBME is a not-for-profit organization that specializes in the creation of assessments and learning tools for physicians and health professionals.
  • Our mission is to advance assessment of these professionals to achieve optimal care for all, supporting the development of a highly effective, diverse and compassionate health care workforce.
  • Founded in 1915, NBME develops and manages the United States Medical Licensing Examination® with the Federation of State Medical Boards.
  • We offer a comprehensive portfolio of assessment products for every stage of the medical school journey and provide assessment services to various health profession organizations.
  • We are dedicated to advancing innovative assessment approaches through research, collaboration and contributions to the medical education and assessment communities.
  • In 2024, we expanded our assessment capabilities to include simulation through the acquisition of MedVR Education.
  • NBME believes that a key path to meeting our mission is collaborating with and supporting our communities.
  • Our Community Collaborations and Contributions programs provide resources and recognition to medical educators and researchers advancing the field of assessment throughout their careers.
  • In addition, we invest in fee assistance, scholarships and pathway programs to aid learners and help support increased representation in health care.
  • Headquartered in Philadelphia, NBME also gives to local organizations that advance health equity and access and positively impact social determinants of health.

Equal Opportunity

  • NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.