Generative AI

Generative AI, co-developed with Assistant Professor Sam Raymond from Dartmouth College, explores the practical implementation of Generative AI with NVIDIA GPUs through hands-on experimentation with Large Language Models (LLMs), Diffusion Models for image and video, multimodal LLM architectures, distributed model training and accelerating inference. 

The curriculum prepares learners for the NVIDIA GenAI and GenAI Multimodal Associate Certification exams. The kit modules include:

• Introduction to Generative AI
• Word Embeddings, Tokens, and NLP
• Large Language Models and the Transformer
• LLM Scaling Laws and LLM Families
• Multimodal Learning and its Applications
• Diffusion Models in Generative AI
• Model Training (Pre-Training, Instruction Following, and PEFT)
• LLM Orchestration
• Scaling Model Training to Distributed Workloads