Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

Tailor your resume to this Lead Private AI Architect (w/m/x) - GenAI, LLM & Enterprise AI Platforms role.

Rezi rewrites your resume against NTT DATA Deutschland SE's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Lead Private AI Architect (w/m/x) - GenAI, LLM & Enterprise AI Platforms posting at NTT DATA Deutschland SE — free, in seconds.

About the Role

As a Private AI Architect (w/m/x), you will design the foundation for Enterprise AI, focusing on secure, scalable, and sovereign architectures. You will bridge technological depth with consulting expertise to develop AI solutions with clients, balancing innovation, data protection, and governance.

Responsibilities

Conceive Enterprise Private AI and GenAI platforms, developing high-level and low-level designs, blueprints, and reference architectures for on-premises, private cloud, hybrid, and sovereign AI environments.
Design high-performance LLM, RAG, and Agentic AI architectures using open-source and self-hosted technologies, and create scalable inference architectures for enterprise AI workloads.
Implement AI platforms into production using Kubernetes, containerization, and MLOps/LLMOps, managing the full lifecycle from deployment and evaluation to monitoring and governance.
Advise clients as a trusted advisor on AI strategy, platform modernization, infrastructure readiness, and AI operating models, driving POCs, MVPs, and enterprise AI initiatives.
Integrate AI, infrastructure, cloud, security, and data engineering, taking responsibility for RFPs, proposals, effort estimations, and reusable Private AI frameworks and accelerators.

Requirements

15+ years of IT experience, with at least 5 years in AI/ML architecture.
Proven track record of implementing enterprise AI/GenAI solutions in private cloud, on-premises, or hybrid environments.
Deep expertise in LLMs, RAG, Vector Databases, Prompt Engineering, and Agentic AI.
Familiarity with frameworks like LangChain, LlamaIndex, Haystack, or Semantic Kernel, and open-source models such as Llama, Mistral, DeepSeek, or Qwen.
Proficiency in Kubernetes, Docker/OpenShift, and MLOps/LLMOps.
Knowledge of technologies like MLflow, Kubeflow, KServe, Ray, vLLM, or Ollama.
Understanding of evaluation, tracing, monitoring, drift detection, and production AI operations.
Understanding of GPU and AI infrastructures, including NVIDIA Stack, CUDA, MIG, Model Serving, Quantization, Batching, Autoscaling, Distributed Inference/Training, and Capacity Planning.
Ability to optimize performance, latency, and availability.
Architectural competence combined with a strong understanding of security, privacy, and sovereign AI (Zero Trust, IAM/RBAC, encryption, data residency, regulatory compliance).
Strong stakeholder management and consulting skills.
German language skills at a minimum C1 level.

Skills

AI/ML Architecture
Enterprise AI
GenAI
Private Cloud
On-Premises
Hybrid Environments
LLMs
RAG
Vector Databases
Prompt Engineering
Agentic AI
LangChain
LlamaIndex
Haystack
Semantic Kernel
Kubernetes
Docker
OpenShift
MLOps
LLMOps
MLflow
Kubeflow
KServe
Ray
vLLM
Ollama
GPU Infrastructure
NVIDIA Stack
CUDA
MIG
Model Serving
Quantization
Batching
Autoscaling
Distributed Inference
Distributed Training
Capacity Planning
Security
Privacy
Sovereign AI
Zero Trust
IAM/RBAC
Encryption
Data Residency
Regulatory Compliance
Stakeholder Management
Consulting

Location

Germany
Austria
Switzerland

Work Type

Flexible working hours
Travel time is working time
Home Office possibility
Remote Work
Mobile work within the EU

Experience Level

15+ years IT experience
5+ years AI/ML Architecture experience

Benefits

Flexible working hours with flexitime arrangement
Travel time is considered working time
Home office option with compensation subsidy including work equipment
30 days of vacation
December 24th and 31st are non-working days
Sabbatical up to one year
Remote work and mobile work within the EU
Attractive benefit and remuneration optimization programs
Company pension scheme
JobRad (company bicycle leasing)
Jobticket (public transport ticket)
Exclusive discounts via Corporate Benefits
Extensive health and prevention offers
Extended sick pay
Company doctor support
Accident insurance (including for leisure accidents worldwide)
Family service
Internal and external training opportunities in the NTT DATA Academy
Professional training
Certification offers
Soft skills training
Udemy access
Various communities and initiatives (Diversity, Equity & Inclusion, ESG, etc.)
Team-oriented corporate culture with significant scope for action

About the Company

Part of NTT DATA, a leading provider of enterprise and technology services, AI, and digital infrastructure with over $30 billion in revenue.
Global Top Employer.
Serves 75% of Fortune Global 100 companies.
Develops innovative solutions with experts in over 70 countries.
Has 15 locations in Germany, Austria, and Switzerland in the DACH region.

Equal Opportunity

Diversity is an indispensable part of our success and corporate culture.
We welcome you without prejudice regarding gender, sexual orientation, age, ethnic and social origin, religion, or disability.
People with severe disabilities are preferred if equally qualified.