About the Role
We are looking for a skilled and motivated Consultant to join our team. The ideal candidate combines strong software engineering expertise with hands-on experience in modern AI systems, including agentic AI and generative AI applications. You will support our clients in designing and building intelligent, production-ready systems that leverage LLMs, autonomous agents, and scalable cloud architectures.
Responsibilities
- Design, build, and deploy scalable, production-grade systems on cloud platforms such as AWS, GCP, or Azure.
- Develop and operate agentic AI systems, including multi-step workflows, tool integration, and autonomous decision-making components.
- Lead end-to-end implementation of AI-driven features, from prototyping (PoC) to production deployment.
- Build high-performance APIs and backend services for AI applications using frameworks such as FastAPI, Flask, or Spring Boot.
- Integrate generative AI solutions (LLMs, vector databases, RAG pipelines, orchestration frameworks like LangChain/LangGraph) into enterprise environments.
- Design and implement robust orchestration and retrieval pipelines for scalable AI applications.
- Set up and maintain MLOps / LLMOps pipelines and CI/CD workflows for continuous integration, evaluation, and deployment.
- Ensure software quality through testing, monitoring, observability, and performance optimization.
- Collaborate closely with clients and cross-functional teams to identify requirements and deliver impactful AI solutions.
Requirements
- Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).
- Initial consulting and project management experience.
- Ability to work effectively with others toward common objectives.
- Flexibility in taking on different roles within a team and understanding customer needs.
- Solid programming experience in at least two programming languages such as Python, Java, Rust, or JavaScript.
- Practical experience deploying ML/AI models into production environments (on-premises or cloud).
- Experience with different database technologies, including SQL and NoSQL, with knowledge of database design, data modeling, and data management.
- Experience with large language models (LLMs), prompt engineering, fine-tuning, and integrating generative AI into actual solutions.
- Strong communication skills for explaining technical concepts to both technical and business stakeholders.
- Fluent in English and at least C1-level German.
- Hands-on experience with cloud AI services.
- Understanding of MLOps concepts (model registry, monitoring, CI/CD).
- Knowledge of modern AI/ML frameworks and tools such as PyTorch, TensorFlow, Hugging Face, LangChain, or OpenAI APIs.
- Awareness of software engineering principles (SOLID, testing, version control).
- Familiarity with containerization and orchestration (Docker, Kubernetes).
- Cloud certifications are a plus.
Skills
- Software Engineering
- AI Systems
- Agentic AI
- Generative AI
- LLMs
- Autonomous Agents
- Cloud Architectures
- AWS
- GCP
- Azure
- FastAPI
- Flask
- Spring Boot
- Vector Databases
- RAG Pipelines
- LangChain
- LangGraph
- MLOps
- LLMOps
- CI/CD
- Testing
- Monitoring
- Observability
- Performance Optimization
- Python
- Java
- Rust
- JavaScript
- SQL
- NoSQL
- Prompt Engineering
- Fine-tuning
- PyTorch
- TensorFlow
- Hugging Face
- OpenAI APIs
- SOLID
- Version Control
- Docker
- Kubernetes
Location
- Munich
- Berlin
Work Type
- Flexible working model (client site, Reply office, remote)
Experience Level
- Initial consulting and project management experience
- Practical experience deploying ML/AI models into production environments
- Experience with different database technologies
- Experience with large language models (LLMs)
- Hands-on experience with cloud AI services
- Awareness of software engineering principles
Education Level
- Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).
Benefits
- Work on innovative AI and Software Engineering projects across industries
- Expand your skills in areas such as MLOps, cloud architecture, data engineering, and generative AI
- Collaborate with top technology partners in the cloud, AI, and automation ecosystem
- Access to training, certifications, and interdisciplinary projects
- Join a vibrant community with hackathons, conferences, and knowledge-sharing events
- Award-winning office space in downtown Munich with great transport connections
- Deutschlandticket for public transport
About the Company
- Machine Learning Reply
