LLMs, RAG, embeddings and vector databases, agents and MCP, model serving, evaluation, guardrails, AI security and governance on AWS, GCP and Azure.
AI vs ML vs Deep Learning vs Generative AI: Clear definitions, how the fields relate, which problems each solves, and how an architect chooses between rules, classical ML, deep learning and generative AI.
How Large Language Models Work: Tokens, transformers, attention, context windows, training stages (pre-training, fine-tuning, RLHF), inference parameters, and architect-relevant limits like latency, cost and hallucination.
Prompt Engineering for Production: System prompts, instructions, few-shot examples, structured output, chain-of-thought considerations, prompt templates and versioning, and testing prompts like code.
Retrieval-Augmented Generation (RAG): The RAG pipeline end to end: ingestion, chunking, embeddings, hybrid retrieval, reranking, context assembly, generation with citations, advanced patterns (GraphRAG, agentic RAG) and failure modes.
Embeddings, Vector Databases and Semantic Search: What embeddings are, similarity metrics, ANN indexes (HNSW, IVF), quantization, choosing a vector store, hybrid search and operating vector indexes at scale.
Agentic AI, Multi-Agent Systems and MCP: The agent loop, tools and memory, orchestration patterns, multi-agent designs and when to avoid them, the Model Context Protocol, and safety controls for agents that take actions.
Model Serving and AI Orchestration: Serving options from managed APIs to self-hosted GPUs, inference optimization (batching, quantization, KV cache), LLM gateways, routing, caching and capacity planning.
Model and LLM Application Evaluation: Offline and online evaluation, golden datasets, metrics for classification, retrieval and generation, LLM-as-judge with calibration, A/B tests and evaluation in CI/CD.
Guardrails and AI Security: Input and output guardrails, prompt injection defences, PII protection, tool authorization, content safety services, red teaming and secure AI supply chains.
AI Observability: Tracing LLM calls, retrieval and tool steps; tracking tokens, cost, latency and quality; drift monitoring for ML models; and OpenTelemetry semantic conventions for GenAI.
AI Governance: AI risk management with NIST AI RMF and ISO/IEC 42001, the EU AI Act risk tiers, AI use-case registries, model documentation, human oversight and responsible AI operating models.
Production GenAI Reference Architecture: An enterprise reference architecture for GenAI applications covering experience, orchestration, retrieval, models, tools, guardrails, evaluation, observability and governance layers.