About the Role
The New York Post is seeking a Data Engineer to join their technology team. This role focuses on infrastructure services, data pipelines, and identity enrichment, while also participating in the product development of data-dependent systems like AI answer services, personalization, machine learning, and audience services. You will build and maintain foundational data services powering analytics and machine learning for newsroom and product teams to deliver cutting-edge digital experiences at scale, working alongside senior engineers, product managers, and data teams.
Responsibilities
- Design, build, and operate cloud-based data pipelines supporting specialized needs of consumer websites, native mobile apps, and information services.
- Work daily with compute services, query services, storage services, and big data services using technologies like Vertex AI, Lambdas, DynamoDB, Cloud Functions, S3, Kubernetes, Glue, and BigQuery within AWS and GCP.
- Develop and maintain data ETL pipelines for real-time and batch processing of large-scale content and event data.
- Write clean, testable, and maintainable code, preferably in Python.
- Collaborate with product, editorial, and data science teams to deliver infrastructure and services meeting business needs.
- Monitor, optimize, and improve the reliability, security, and cost efficiency of cloud-based systems.
- Write and present ideas clearly, documenting functional requirements for both technical and non-technical audiences.
- Participate in code reviews, architecture discussions, and agile sprint ceremonies.
Requirements
- MS or BS in computer science, or related field.
- 2+ years of professional software engineering experience.
- Proficiency in Python, SQL, and PySpark.
- Working knowledge of common AWS and/or GCP services.
- Experience building and deploying data pipelines (e.g., Airflow, Dataflow, Glue, or similar tools).
- Knowledge of data warehouse technologies (BigQuery, Snowflake, Redshift, etc.).
- Firm grasp of the tools of the trade including AI tooling, IDEs, Git, JIRA, and agile methodologies.
- Familiarity with web standards and protocols.
- Comfort with code reviews, writing unit tests, QA and UAT processes, and exposure to end-to-end testing frameworks.
- Strong problem-solving skills, attention to detail, thoroughness, and an eagerness to learn.
- Proactive approach to problem-solving.
- Highly organized with the ability to manage multiple priorities in a fast-paced environment.
- Familiarity with content-management systems, media, news, publishing, video technology, ad technology, or other high-traffic consumer-facing industries.
- Exposure to personalization and recommendation systems.
- Comfortable with the CLI, Linux administration, shell scripting, ssh, crontabs, etc.
- Hands-on experience with generative-AI models, LLM prompting, and/or machine learning.
- Experience with monitoring, logging, dashboard, and alarming tools (e.g., CloudWatch, Datadog, Splunk, etc.).
- Familiarity with REST and GraphQL APIs, authentication/authorization, and API best practices.
- Scaling techniques in cloud environments.
- Troubleshooting and debugging experience with internet services.
- Understanding of CI/CD workflows and containerization (Docker, Kubernetes a plus).
Skills
- Python
- SQL
- PySpark
- AWS
- GCP
- Airflow
- Dataflow
- Glue
- BigQuery
- Snowflake
- Redshift
- AI tooling
- IDEs
- Git
- JIRA
- Agile methodologies
- Web standards
- Web protocols
- Code reviews
- Unit tests
- QA
- UAT
- End-to-end testing frameworks
- Problem-solving
- Attention to detail
- Thoroughness
- Eagerness to learn
- Proactive approach
- Organization
- Priority management
- Content-management systems
- Media
- News
- Publishing
- Video technology
- Ad technology
- Personalization systems
- Recommendation systems
- CLI
- Linux administration
- Shell scripting
- ssh
- crontabs
- Generative AI
- LLM prompting
- Machine learning
- CloudWatch
- Datadog
- Splunk
- REST APIs
- GraphQL APIs
- Authentication
- Authorization
- API best practices
- Cloud scaling
- Troubleshooting
- Debugging
- CI/CD
- Docker
- Kubernetes
Location
- New York
Work Type
- Hybrid
Experience Level
- 2+ years of professional software engineering experience
Education Level
- MS or BS in computer science, or related field
Salary/Compensations
- $100,000 - $115,000
Benefits
- Comprehensive and competitive benefits package covering health, retirement, wellbeing, and more.
- Optional benefits to meet diverse employee needs.
About the Company
- The New York Post is an iconic and recognizable news brand delivering bold headlines, unforgettable scoops, and sharp commentary since 1801.
- With a legacy built on fearless journalism and a distinctly New York attitude, The Post has evolved far beyond its print roots to become a modern media powerhouse.
- The New York Post Digital Network is one of the most influential voices in the industry, reaching over 80 million unique users each month across its expansive portfolio, anchored by NYPost.com, PageSix.com, and Decider.com.
- Digital brands deliver must-read breaking news, sports, entertainment, pop culture, and lifestyle coverage with wit, edge, and energy.
- Innovation is at the core, with a multi-platform ecosystem spanning web, mobile apps, video, audio, social, print, TV, and commerce.
- Engages audiences through viral headlines, exclusive stories, original series, podcasts, and live events, always on the pulse of what's next.
Equal Opportunity
- All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
- EEO/Disabled/Vets
- We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email humanresources@newscorp.com with 'Reasonable Accommodation' in the subject line and a brief description of the assistance needed.
