Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

Tailor your resume to this Senior Machine Learning Engineer, AI-Native Evaluation & Search role.

Rezi rewrites your resume against Atlassian's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Senior Machine Learning Engineer, AI-Native Evaluation & Search posting at Atlassian — free, in seconds.

About the Role

Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian’s AI products.

Responsibilities

Develop and productionize machine learning systems for search, retrieval, ranking, conversational experiences, and AI agents.
Own projects across the ML lifecycle, from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.
Make evaluation a first-class part of AI development.
Define quality, build evaluation datasets and benchmarks, analyze model behavior, and use results to guide product and engineering decisions.
Collaborate with product managers, software engineers, data scientists, research scientists, and platform teams.
Independently solve complex problems, contribute to technical direction, and mentor other engineers.
Build and productionize machine learning models and AI systems for Search & Intelligence products.
Own projects from concept through deployment, monitoring, evaluation, and iteration.
Develop AI-native experiences across search, retrieval, ranking, recommendations, conversational systems, and agentic workflows.
Design evaluation-driven development processes, including quality metrics, test cases, benchmarks, and acceptance criteria.
Build evaluation datasets, regression suites, and pipelines for search, RAG, chat, and agentic systems.
Conduct offline and online evaluations, human assessments, model-based evaluations, and error analysis.
Design scalable architectures that meet requirements for quality, reliability, latency, privacy, and cost.
Apply modern techniques in information retrieval, ranking, embeddings, NLP, deep learning, and large language models.
Communicate technical decisions and results clearly across technical and non-technical audiences.
Mentor engineers and contribute to engineering and ML best practices.

Requirements

A Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent experience.
At least 4 years of experience developing and deploying machine learning or AI systems in production.
Strong Python skills and experience with Java, Kotlin, TypeScript, or another production language.
Experience with SQL and large-scale data processing technologies such as Spark.
Experience building, evaluating, deploying, and scaling models with large datasets.
Experience designing evaluation strategies, analyzing model quality, and using results to guide improvements.
Familiarity with cloud-based ML and data platforms such as AWS or Databricks.
Ability to independently solve ambiguous problems and deliver practical, production-quality solutions.
Strong communication and collaboration skills.
An agile mindset and commitment to continuous improvement.
Experience building AI-native products, RAG systems, conversational assistants, or tool-using agents.
Experience with evaluation-driven development, benchmarks, regression testing, human evaluation, or LLM-as-a-judge.
Experience evaluating agent planning, tool use, task completion, or multi-step reasoning.
Experience with search relevance, ranking, recommendations, personalization, embeddings, or NLP.
Experience fine-tuning, post-training, evaluating, or optimizing large language models.
Experience with ML platforms, model serving, data pipelines, observability, or responsible AI.
Experience mentoring engineers or influencing technical direction within a team.

Skills

Python
Java
Kotlin
TypeScript
SQL
Spark
AWS
Databricks
Information Retrieval
Ranking
Embeddings
NLP
Deep Learning
Large Language Models
RAG systems
Conversational assistants
Tool-using agents
Evaluation-driven development
Benchmarks
Regression testing
Human evaluation
LLM-as-a-judge
Agent planning
Tool use
Multi-step reasoning
Search relevance
Recommendations
Personalization
ML platforms
Model serving
Data pipelines
Observability
Responsible AI

Location

Any country where Atlassian has a legal entity

Work Type

Office
Home
Combination of office and home

Experience Level

Senior
At least 4 years of experience developing and deploying machine learning or AI systems in production

Education Level

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent experience

Salary/Compensations

Zone A: $206,100 - $269,075
Zone B: $185,490 - $242,168
Zone C: $171,063 - $223,332

Benefits

Health and wellbeing resources
Paid volunteer days

About the Company

Atlassian is motivated by a common goal: to unleash the potential of every team.
Our software products help teams all over the planet and our solutions are designed for all types of work.
Team collaboration through our tools makes what may be impossible alone, possible together.
We believe that the unique contributions of all Atlassians create our success.

Equal Opportunity

We never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
All your information will be kept confidential according to EEO guidelines.
We can support with accommodations or adjustments at any stage of the recruitment process.
Identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.