Back to All Talks
DAY 3 ยท JULY 22, 2026

Evolution of Generative AI Foundation Models on Cloud Platform

PDP on Intelligent Cloud Systems: AI-Driven Architecture, Deployment & Innovation

Resource Person: Dr. B. Tamil Arasan (Principal Research Engineer, Saama Technologies)
Dept: Networking and Communications, School of Computing, SRMIST
Venue: MVI Lab, 15th Floor, Tech Park 1, SRMIST Kattankulathur
Session 6

Session 6: The Evolution (LSTM to Transformer)

Self-attention mechanism, scaled dot-product & transformer revolution

Session 7

Session 7: Emergence of Generative AI, BERT & GPT

Probabilistic models, VAEs, GANs, Attention math, BERT bidirectional & GPT autoregressive generation

Session 8

Session 8: What Are Foundation Models & How Do Models Learn?

Architecture scale, emergent abilities, quantization/pruning efficiency, and pretraining paradigms (Supervised, Unsupervised & Self-Supervised)

Session 9

Session 9: Pretraining Paradigms, Fine-Tuning & RLHF Alignment

CLM vs MLM vs Contrastive learning, PEFT LoRA math ($W_0 + B \cdot A$), QLoRA 4-bit, SFT, and RLHF alignment via PPO & KL divergence

Session 10

Session 10: LLM Scaling (MoE, Reasoning, Context) & Evaluation Metrics

Mixture of Experts (MoE) router gating, DeepSeek-R1 Chain-of-Thought reasoning, million-token context extensions, and Intrinsic (Perplexity, BLEU, FID) & Extrinsic evaluation metrics