According to @DeepLearningAI, a new short course has been launched in collaboration with Google, focusing on building and training a MiniGPT-style large language model (LLM) using JAX, the open-source library behind Gemini. This course enables participants to construct and train a 20M-parameter LLM architecture from scratch, offering valuable insights into advanced AI model development.

According to @DeepLearningAI, Google product manager Robert Crowe showed that Flax NNX makes JAX more intuitive for building and training neural networks. source: @DeepLearningAI He also demonstrated that JAX can automatically distribute models across hardware, making scaling easier for developers getting started. source: @DeepLearningAI The talk emphasized that accelerators are costly and that roofline analysis helps teams maximize utilization and efficiency. source: @DeepLearningAI This presentation took place at AI Dev 25 x NYC and focused on practical efficiency gains for AI workloads. source: @DeepLearningAI