AI Architect

About the role

As an AI Architect at SAP, you will define the architecture for enterprise‑grade AI‑enabled applications and platforms. You will embed intelligence into core designs, ensuring solutions are scalable, secure, and compliant.

Key responsibilities

• Design end‑to‑end AI/ML solutions, including model integration, batch and real‑time inference, and feature pipelines.
• Define patterns for vector search, LLM orchestration, agent frameworks, and responsible AI controls.
• Guide engineering teams on scalability, resilience, observability, privacy, and compliance.
• Shape reference architectures, design standards, and reusable technical patterns for AI‑enabled product development.
• Collaborate with data and security teams to ensure trustworthy AI through proper governance and metadata management.

Required profile

• Proven experience designing large‑scale distributed systems and microservice architectures.
• Deep understanding of AI/ML system design, including training pipelines, inference layers, and model lifecycle management.
• Hands‑on experience with generative AI, LLMs, embeddings, vector databases, and RAG patterns.
• Strong background in cloud‑native architecture, containers, Kubernetes, and infrastructure automation.
• Knowledge of data governance, privacy, and compliance for trustworthy AI solutions.

Required skills

• Microservices
• Event‑driven architecture
• APIs and integration layers
• Data platforms
• AI/ML system design
• Training and inference pipelines
• Model lifecycle management
• Generative AI
• Large Language Models (LLMs)
• Embeddings
• Vector databases
• Retrieval‑augmented generation (RAG)
• Orchestration frameworks
• Cloud‑native architecture
• Containers
• Kubernetes
• Infrastructure‑as‑Code
• Observability tools
• Resilience engineering
• Performance engineering
• Reference architecture design
• Data governance
• Metadata management
• Privacy compliance

What we offer

• Continuous learning and skill growth opportunities
• Comprehensive benefits package
• Inclusive culture that supports wellbeing and belonging