Who this course is for
Developers with basic programming knowledge who want a structured path into AI engineering, and backend engineers moving into production AI systems.
From foundations to production AI systems
Progress through six phases from Python and ML foundations to RAG, AI agents, multimodal systems and production architecture.
01Phase 1 · About 7 weeksFoundations of AI Engineering
Build foundations in Python, mathematics, machine learning and PyTorch.
Module 01Introduction to AI Engineering10 topics
- What Is Artificial Intelligence?
- AI vs Machine Learning vs Deep Learning vs Generative AI
- AI Engineer vs ML Engineer vs AI Research Scientist
- The Modern AI Technology Stack
- Foundation Models and Their Capabilities
- Closed-Source vs Open-Weight Models
- AI Systems Architecture
- The AI Application Development Lifecycle
- Real-World AI Engineering Use Cases
- Common AI Engineering Anti-Patterns
Hands-on practice
Visualize the components and request lifecycle of an AI system.
Module 02Python for AI Engineering12 topics
- Python Fundamentals for Engineers
- Virtual Environments and Dependency Management
- Type Hints, Dataclasses, and Pydantic
- NumPy Arrays and Vectorized Computing
- Pandas and Data Manipulation
- Asynchronous Programming with asyncio
- HTTP Clients and REST APIs
- FastAPI Fundamentals
- Streaming Responses and Async Generators
- Testing, Logging, and Project Structure
- Jupyter Notebooks and Experimentation
- Building a Production-Ready Python Service
Hands-on practice
Build an asynchronous AI gateway with FastAPI.
Module 03Mathematics for Machine Learning12 topics
- Scalars, Vectors, Matrices, and Tensors
- Vector Operations and Matrix Multiplication
- Dot Product and Cosine Similarity
- Norms, Distances, and Vector Spaces
- Eigenvalues, Eigenvectors, and SVD
- Probability and Conditional Probability
- Bayes' Theorem
- Statistics and Distributions
- Derivatives and Partial Derivatives
- Gradients and Chain Rule
- Loss Functions and Optimization
- Gradient Descent and Backpropagation Mathematics
Hands-on practice
Implement linear regression and gradient descent with NumPy.
Module 04Machine Learning Fundamentals12 topics
- Supervised, Unsupervised, and Self-Supervised Learning
- Training, Validation, and Test Datasets
- Features, Labels, and Data Preparation
- Linear and Logistic Regression
- Decision Trees and Random Forests
- Classification and Regression Metrics
- Bias and Variance
- Overfitting and Underfitting
- Cross-Validation and Data Leakage
- Feature Engineering
- Hyperparameter Optimization
- Model Deployment Fundamentals
Hands-on practice
Build a fraud detection or classification model with Scikit-learn.
Module 05Deep Learning with PyTorch12 topics
- Neural Network Fundamentals
- Perceptrons and Multilayer Networks
- Activation Functions
- Forward and Backward Propagation
- Autograd and Computational Graphs
- PyTorch Tensors and Modules
- Training Loops and Optimizers
- Batch Size, Epochs, and Learning Rates
- Regularization, Dropout, and Normalization
- CNNs, RNNs, and Sequence Modeling
- GPU Acceleration and Memory
- Saving, Loading, and Evaluating Models
Hands-on practice
Train a neural network from scratch with PyTorch.
02Phase 2 · About 7 weeksLarge Language Models & Generative AI
Understand Transformers and build applications with model APIs, streaming and structured outputs.
Module 06Natural Language Processing Foundations10 topics
- Introduction to Natural Language Processing
- Text Cleaning and Normalization
- Bag of Words and TF-IDF
- Word2Vec, GloVe, and Word Embeddings
- Tokenization Fundamentals
- BPE, WordPiece, and SentencePiece
- Language Modeling and Probability
- Sequence-to-Sequence Models
- Encoder-Decoder Architectures
- Attention Mechanisms
Module 07Transformers Architecture Deep Dive15 topics
- Why Transformers Replaced Many Recurrent Architectures
- Transformer Architecture Overview
- Token and Positional Embeddings
- Self-Attention and Scaled Dot-Product Attention
- Query, Key, and Value Matrices
- Multi-Head Attention
- Causal Masking and Attention Masks
- Feed-Forward Networks
- Residual Connections and Layer Normalization
- Encoder-Only, Decoder-Only, and Encoder-Decoder Models
- Autoregressive Text Generation
- KV Cache and Attention Complexity
- Long-Context Transformers
- Mixture-of-Experts Models
- Building a Small Transformer from Scratch
Hands-on practice
Simulate the token, embedding, attention, logits and next-token pipeline.
Module 08LLM Inference & Model APIs14 topics
- LLM Inference Lifecycle
- Tokens, Context Windows, and Output Limits
- Temperature, Top-p, and Sampling
- Greedy Decoding and Beam Search
- Model Providers and API Architecture
- OpenAI Responses API and Comparable Provider APIs
- Model Routing and Provider Abstraction
- Streaming with Server-Sent Events
- Structured Outputs and JSON Schema
- Function Calling Fundamentals
- Retries, Timeouts, and Rate Limits
- Token Usage, Pricing, and Latency
- Prompt Caching
- Model Fallback and Reliability Patterns
Hands-on practice
Build a unified gateway for multiple LLM providers.
Module 09Prompt & Context Engineering14 topics
- Prompt Engineering Fundamentals
- System, Developer, and User Instructions
- Zero-Shot and Few-Shot Prompting
- Role and Task Definition
- Structured Output Design
- Prompt Templates and Versioning
- Decomposition and Reasoning-Oriented Prompts
- Context Engineering Fundamentals
- Context Window Management
- Context Compression and Summarization
- Grounding and Source Attribution
- Prompt Injection Fundamentals
- Prompt Testing and A/B Experiments
- Building Reusable Prompt Libraries
Module 10Building LLM-Powered Applications12 topics
- AI Chat Application Architecture
- Stateful and Stateless Conversations
- Conversation History Management
- Chat Session Persistence
- Token-Aware History Truncation
- Streaming Chat Interfaces
- User Authentication and Session Isolation
- Multi-Tenant AI Applications
- AI Gateway Design Patterns
- Error Handling and Graceful Degradation
- Usage Tracking and Quotas
- Deploying an End-to-End LLM Application
Hands-on practice
Build a chat platform with persistent sessions, streaming and model selection.
03Phase 3 · About 8 weeksRAG & Knowledge Engineering
Build document retrieval pipelines with source attribution, access controls and measurable quality.
Module 11Embeddings & Vector Search12 topics
- What Are Embeddings?
- Dense vs Sparse Representations
- Embedding Model Architectures
- Similarity Metrics: Cosine, Dot Product, Euclidean
- Semantic Search
- Approximate Nearest Neighbor Search
- HNSW, IVF, and Vector Indexing
- Vector Quantization
- Embedding Dimensions and Model Selection
- Multilingual Embeddings
- Embedding Evaluation
- Embedding Drift and Versioning
Module 12Vector Databases & Hybrid Search12 topics
- Vector Database Internals
- PostgreSQL with pgvector
- Qdrant and Weaviate
- Milvus and Managed Vector Services
- Elasticsearch Vector Search
- Metadata Filtering
- Hybrid Search: BM25 + Dense Retrieval
- Reciprocal Rank Fusion
- Index Building and Updates
- Sharding and Replication
- Multi-Tenant Retrieval Isolation
- Vector Database Performance Benchmarking
Hands-on practice
Compare retrieval with pgvector, Qdrant and Elasticsearch.
Module 13Retrieval-Augmented Generation15 topics
- Why RAG Exists
- RAG vs Fine-Tuning vs Long Context
- End-to-End RAG Architecture
- Document Ingestion Pipelines
- PDF, HTML, DOCX, and Markdown Parsing
- Text Chunking Strategies
- Semantic and Structure-Aware Chunking
- Parent-Child Retrieval
- Document Metadata and Provenance
- Query Embedding and Retrieval
- Context Assembly
- Grounded Answer Generation
- Citations and Source Verification
- Incremental Indexing and Document Updates
- Permission-Aware Retrieval
Hands-on practice
Build a RAG assistant that answers questions about documents with citations.
Module 14Advanced RAG Architectures15 topics
- Naive RAG vs Advanced RAG
- Query Rewriting and Expansion
- Multi-Query Retrieval
- HyDE - Hypothetical Document Embeddings
- Cross-Encoder Reranking
- Contextual Retrieval
- Adaptive and Corrective RAG
- Self-RAG Concepts
- Agentic RAG
- GraphRAG and Knowledge Graphs
- Multi-Hop Reasoning and Retrieval
- Multi-Source Federated Retrieval
- Multimodal RAG
- Long-Context RAG Optimization
- Production RAG Architecture Trade-offs
Module 15RAG Evaluation & Optimization14 topics
- Retrieval Evaluation Fundamentals
- Precision@K and Recall@K
- Mean Reciprocal Rank and nDCG
- Context Precision and Context Recall
- Answer Faithfulness and Groundedness
- Answer Relevance
- Hallucination Detection
- Building Golden Evaluation Datasets
- Synthetic Question Generation
- RAGAS and RAG Evaluation Tooling
- Latency, Cost, and Quality Trade-offs
- RAG Regression Testing
- A/B Testing Retrieval Strategies
- Diagnosing Retrieval vs Generation Failures
Hands-on practice
Build an enterprise knowledge assistant with permission-aware retrieval, hybrid search, reranking and evaluation.
04Phase 4 · About 9 weeksAgentic AI & Intelligent Workflows
Connect tools, memory and durable workflows with explicit permissions and failure recovery.
Module 16AI Agents Fundamentals13 topics
- What Is an AI Agent?
- Chatbots vs Workflows vs Autonomous Agents
- Agent Architecture and Components
- The Agent Execution Loop
- Reasoning, Actions, and Observations
- ReAct and Tool-Using Agents
- Planning and Task Decomposition
- Agent State Management
- Tool Selection and Execution
- Stopping Conditions and Execution Budgets
- Deterministic vs Autonomous Behavior
- Failure Recovery and Agent Reliability
- Designing Agents Without Frameworks
Hands-on practice
Build a tool-calling agent without a framework.
Module 17Tool Calling & Model Context Protocol16 topics
- Function Calling Deep Dive
- Tool Schemas and Argument Validation
- Parallel and Sequential Tool Calling
- Tool Result Handling
- Introduction to Model Context Protocol
- MCP Host, Client, and Server Architecture
- MCP Tools, Resources, and Prompts
- MCP Transport: stdio and Streamable HTTP
- Capability Discovery and Negotiation
- Building a Custom MCP Server
- Building an MCP Client
- Authentication and Authorization
- MCP Security and Trust Boundaries
- Tool Permissions and Human Approval
- Connecting Databases and External APIs
- Debugging and Testing MCP Integrations
Hands-on practice
Build an MCP server with restricted access to services such as PostgreSQL, Jira and GitHub.
Module 18LangChain, LangGraph & Agent Frameworks15 topics
- LangChain Architecture and Abstractions
- Models, Messages, and Tools
- Building a Simple LangChain Agent
- LangGraph Architecture
- Nodes, Edges, and State
- Conditional Routing
- Checkpointing and Persistence
- Short-Term and Long-Term Memory
- Interruptions and Human-in-the-Loop
- Durable Execution and Resumability
- OpenAI Agents SDK
- Agent Handoffs and Guardrails
- LlamaIndex and Knowledge Agents
- Framework Comparison and Selection
- Avoiding Unnecessary Framework Complexity
Hands-on practice
Compare the same agent workflow in pure Python, LangGraph and the Agents SDK.
Module 19AI Agent Memory & Context Management14 topics
- What Is Memory in AI Systems?
- Short-Term vs Long-Term Memory
- Working, Episodic, and Semantic Memory
- Conversation Memory
- Persistent Memory Stores
- Memory Extraction and Summarization
- Context Compression
- Memory Retrieval and Relevance Ranking
- User Preferences and Personalization
- Memory Consolidation and Forgetting
- Memory Conflicts and Stale Information
- Privacy, Consent, and Data Deletion
- Memory Evaluation and Testing
- Designing a Persistent Personal AI Assistant
Module 20Multi-Agent Systems & Orchestration16 topics
- Single-Agent vs Multi-Agent Architectures
- Agent Roles and Specialization
- Supervisor and Worker Patterns
- Sequential Agent Pipelines
- Parallel Agent Execution
- Routing and Dynamic Delegation
- Agent Handoffs
- Planner-Executor Patterns
- Evaluator-Optimizer Patterns
- Multi-Agent Shared State
- Agent-to-Agent Communication
- A2A Protocol Concepts
- Agent Coordination and Conflict Resolution
- Agentic Workflow Testing
- Multi-Agent Cost and Latency Optimization
- When Not to Use Multi-Agent Systems
Hands-on practice
Build a research platform with researcher, analyst, reviewer and report writer agents.
Module 21Durable & Event-Driven AI Workflows16 topics
- Why AI Agents Need Durable Execution
- Long-Running Agent Tasks
- Workflow State and Persistence
- Temporal for AI Orchestration
- Workflow and Activity Boundaries
- Retries, Timeouts, and Heartbeats
- Signals, Queries, and Human Approval
- Idempotency and Side-Effect Control
- Compensation and Recovery Patterns
- Kafka and Event-Driven AI Processing
- Asynchronous Job Execution
- Queue-Based Inference Workloads
- Distributed Agent Coordination
- Recovery After Worker Failure
- End-to-End Trace Correlation
- Designing Reliable AI Automation Systems
Hands-on practice
Build a durable automation platform with Temporal, AI agents and Kafka.
05Phase 5 · About 8 weeksModel Engineering & Multimodal AI
Run and adapt open-weight models, process images and speech, and benchmark inference.
Module 22Open-Weight LLMs & Local Inference12 topics
- Open-Weight Model Ecosystem
- Hugging Face Hub and Model Repositories
- Model Cards, Licenses, and Usage Restrictions
- Model Weights and Checkpoint Formats
- Loading Models with Transformers
- CPU vs GPU Inference
- VRAM and Memory Estimation
- Ollama and Local Model Runtimes
- Quantization: FP16, BF16, INT8, INT4
- GGUF and Quantized Model Formats
- Local Embedding and Reranking Models
- Model Quality and Hardware Trade-offs
Module 23Fine-Tuning & Model Adaptation15 topics
- Pretraining vs Fine-Tuning
- Instruction Tuning and Supervised Fine-Tuning
- Training Dataset Construction
- Chat Templates and Conversation Formats
- Full Fine-Tuning vs Parameter-Efficient Fine-Tuning
- LoRA and QLoRA
- Adapter Training and Management
- Training Hyperparameters
- Dataset Quality and Contamination
- Preference Optimization and DPO
- RLHF and Reinforcement Learning Concepts
- Distillation and Smaller Specialized Models
- Evaluating Fine-Tuned Models
- Model Versioning and Deployment
- When Fine-Tuning Is Not the Right Solution
Hands-on practice
Fine-tune a small open-weight instruction model on domain data with LoRA.
Module 24Multimodal AI Engineering15 topics
- Introduction to Multimodal Models
- Vision-Language Model Architecture
- Image Understanding and Visual Question Answering
- OCR and Document AI
- Tables, Charts, and Layout Understanding
- Speech Recognition and Transcription
- Text-to-Speech Systems
- Speech-to-Speech Architectures
- Audio Streaming and Voice Activity Detection
- Image Generation Fundamentals
- Diffusion Models and Latent Representations
- Video Understanding and Frame Processing
- Multimodal Embeddings
- Multimodal RAG Architecture
- Evaluating Multimodal Outputs
Hands-on practice
Build an assistant that reads documents, analyzes images and responds in text and speech.
Module 25Realtime Voice & Conversational AI15 topics
- Realtime AI System Architecture
- Speech-to-Text → LLM → Text-to-Speech Pipelines
- Native Speech-to-Speech Models
- WebSocket and WebRTC Fundamentals
- Audio Encoding and Streaming
- Voice Activity Detection
- Interruption and Barge-In Handling
- Turn Detection and Conversation Flow
- Realtime Function Calling
- Streaming Tool Results
- Latency Budgeting
- Voice Agent State Management
- Multilingual Voice Assistants
- Realtime Quality and Latency Testing
- Production Voice Agent Architecture
Module 26Efficient LLM Inference & Serving16 topics
- LLM Serving Architecture
- Prefill vs Decode Phases
- Time to First Token and Tokens per Second
- Throughput vs Latency
- Continuous Batching
- KV Cache Management
- PagedAttention
- vLLM and Model Serving Engines
- Speculative Decoding
- Quantization for Serving
- Tensor and Pipeline Parallelism
- GPU Memory Management
- Model Warmup and Cold Starts
- Autoscaling GPU Inference
- Model Routing and Load Balancing
- Serving Benchmarks and Capacity Planning
Hands-on practice
Serve a model with vLLM and benchmark concurrency, throughput and load.
06Phase 6 · About 9 weeksProduction AI, LLMOps & Security
Evaluate, secure, deploy and operate AI systems with tracing, capacity planning and release gates.
Module 27LLM Evaluation & AI Testing16 topics
- Why Traditional Testing Is Not Enough
- Deterministic vs Probabilistic Outputs
- Unit, Integration, and End-to-End AI Tests
- Golden Datasets and Test Cases
- Exact Match, Semantic Similarity, and Task Success
- LLM-as-a-Judge
- Pairwise Model Comparisons
- Human Evaluation and Labeling
- Agent Trajectory Evaluation
- Tool-Calling Accuracy
- Hallucination and Grounding Tests
- Adversarial and Safety Evaluation
- Offline and Online Evaluations
- Evaluation-Driven Development
- CI/CD Evaluation Gates
- Production Quality Monitoring
Module 28AI Security, Privacy & Guardrails16 topics
- Threat Modeling for AI Applications
- OWASP Top 10 for LLM Applications
- Direct and Indirect Prompt Injection
- Jailbreaks and Instruction Hierarchy Attacks
- Sensitive Information Disclosure
- Tool Output and Document Trust Boundaries
- Excessive Agency and Privilege Escalation
- Data and Model Poisoning
- Secure Tool Execution and Sandboxing
- Least-Privilege Agent Permissions
- PII Detection and Redaction
- Input, Output, and Retrieval Guardrails
- Human Approval for High-Impact Actions
- API Key and Secret Management
- Audit Logs and Retention Policies
- AI Red Teaming and Security Testing
Hands-on practice
Build a defense-in-depth test environment for prompt injection against RAG and agent applications.
Module 29LLMOps, Observability & Monitoring16 topics
- MLOps vs LLMOps
- AI Application Lifecycle Management
- Prompt, Model, and Dataset Versioning
- Experiment Tracking
- LangSmith, Langfuse, and Phoenix Concepts
- Distributed Tracing for LLM Applications
- OpenTelemetry Integration
- Model Invocation and Tool Call Traces
- Token and Cost Observability
- Latency Percentiles and SLOs
- Quality and Safety Monitoring
- Evaluation Dashboards
- Feedback Collection
- Model Drift and Regression Detection
- Alerts, Incident Response, and Rollbacks
- Production AI Operations Runbooks
Module 30Scalable AI System Design16 topics
- Designing an AI System for High Traffic
- AI Gateway and Model Router Architecture
- Stateless APIs and Stateful Workflows
- API Rate Limits and Admission Control
- Asynchronous Inference Queues
- Load Shedding and Backpressure
- Request Batching and Concurrency Control
- Prompt and Semantic Caching
- GPU Resource Scheduling
- Distributed Vector Search
- Multi-Region AI Infrastructure
- Tenant Isolation and Resource Quotas
- AI Service Resilience Patterns
- End-to-End Capacity Estimation
- Cost per Request and Unit Economics
- Designing for 100K+ Daily Active Users
Module 31AI Deployment, Cloud & Infrastructure16 topics
- Dockerizing AI Services
- Kubernetes Fundamentals for AI Workloads
- CPU and GPU Workload Scheduling
- Model Artifact Storage
- Model Registry and Deployment Versioning
- CI/CD for AI Applications
- Infrastructure as Code
- Managed AI Platforms vs Self-Hosting
- AWS, Azure, and GCP AI Infrastructure
- Kubernetes Autoscaling
- Secrets and Configuration Management
- Blue-Green and Canary Deployments
- Model Rollbacks
- Data Pipeline Scheduling
- Disaster Recovery and Business Continuity
- Production Release Checklist
Module 32Advanced AI Architecture & Emerging Patterns16 topics
- AI-Native Software Architecture
- Compound AI Systems
- Model and Tool Routing Architectures
- Agent Skills and Reusable Capabilities
- Sandboxed Code Execution for Agents
- Computer-Use Agents
- Browser and UI Automation Agents
- Deep Research Workflows
- Long-Running Autonomous Systems
- Agent Communication Protocols
- Knowledge Graphs and Neuro-Symbolic Approaches
- Synthetic Data Generation
- Small Specialized Model Architectures
- On-Device and Edge AI
- Evaluating New AI Technologies
- AI Architecture Decision Records
Hands-on practice
Build a production AI platform with monitoring, security, evaluation, distributed infrastructure and deployment.
A portfolio of 12 AI projects
- Machine Learning Prediction Service
Model training, feature engineering, evaluation and FastAPI deployment. - Multi-Model AI Chat Platform
LLM gateway, streaming, persistent sessions, model routing and usage tracking. - Intelligent Document Assistant
PDF processing, embeddings, pgvector, grounded answers and citations. - Enterprise RAG Search Engine
Hybrid retrieval, reranking, tenant isolation, evaluation and incremental indexing. - Custom MCP Integration Platform
MCP server, tool registry, schema validation, secure execution and audit logging. - Personal AI Assistant with Memory
Agent state, long-term memory, personalized context and external actions. - Multi-Agent Research System
Supervisor, researcher, evaluator, report writer, handoffs and agent traces. - Realtime Voice AI Assistant
Speech streaming, interruption handling, tool calls and low-latency responses. - Domain-Specific Fine-Tuned LLM
LoRA adapters, training datasets, evaluation and optimized local inference. - Intelligent Document Processing Pipeline
OCR, VLM, structured extraction, confidence checks, review and durable workflows. - AI Evaluation & Observability Platform
Golden datasets, prompt experiments, traces, regression testing and cost dashboards. - Production AI Engineering Capstone
Multi-tenant AI SaaS with RAG, agents, MCP, Temporal, evaluation, security and scalable deployment.
AI Enterprise Workspace
Build a multi-tenant platform with knowledge search, personal memory, MCP integrations, specialized agents, voice commands, approval workflows, monitoring and usage billing.
- Reproducible evaluation dataset
- Permission and tenant isolation tests
- Fault-injection and recovery scenarios
- Audit trail and deployment pipeline
- Predefined latency, cost and quality SLOs
Proposed assessment
- Theory quizzes
- 15%
- Hands-on labs
- 25%
- Module projects
- 25%
- Architecture challenges
- 10%
- Final capstone
- 25%
The proposed pass threshold is 75%, with 90% as an advanced achievement target. This is a course assessment model, not an industry certification.