CUDA and GPU Programming with Elliot Arledge [Podcast #155]

On this week's episode of the podcast, freeCodeCamp founder Quincy Larson interviews Elliot Arledge. He's a 20-year old computer science student who's created several popular freeCodeCamp courses on LLMs, the Mojo programming language, and GPU programming with CUDA. He joins us from Edmonton, Alberta, Canada. Support for this podcast comes from a grant from Wix Studio. Wix Studio provides developers tools to rapidly build websites with everything out-of-the-box, then extend, replace, and break boundaries with code. Learn more at https://wixstudio.com. Support also comes from the 11,043 kind folks who support freeCodeCamp through a monthly donation. Join these kind folks and help our mission by going to https://www.freecodecamp.org/donate We talk about: - Building AI systems from scratch - How Elliot has learned so much so quickly and his methods - How he approaches reading academic papers - His CS degree coursework VS his self-directed learning Can you guess what song I'm playing in the intro? Links we talk about during our conversation: - Elliot's Mojo course on freeCodeCamp: https://www.freecodecamp.org/news/new-mojo-programming-language-for-ai-developers/ - Elliot's Cuda GPU programming course on freeCodeCamp: https://www.freecodecamp.org/news/learn-cuda-programming/ - Elliot's Python course on building an LLM from scratch: https://www.freecodecamp.org/news/how-to-build-a-large-language-model-from-scratch-using-python/ - Elliot's YouTube channel: https://www.youtube.com/@elliotarledge - Elliot's many projects on GitHub: https://github.com/Infatoshi Chapters - 0:00:00 Introduction to CUDA and GPU Programming - 0:07:27 The Importance of GPUs in AI and LLMs - 0:13:46 Learning Methodologies and Productivity Tips - 0:21:21 The Role of Sleep in Learning and Productivity - 0:26:39 Creating Educational Content - 0:32:32 Overcoming Challenges in Learning - 0:42:31 The Value of a Computer Science Degree - 0:48:03 Balancing Education and Career Opportunities - 0:53:45 The Future of AI and LLMs - 0:59:59 Incremental Innovations in AI Models - 1:07:18 Approaching Academic Papers with Confidence ❤️ Support for this channel comes from our friends at Scrimba – the coding platform that's reinvented interactive learning: https://scrimba.com/freecodecamp