Andrej Karpathy’s “Neural Networks: Zero to Hero” is a course that teaches building neural networks from scratch, focusing on language models, and covering topics like backpropagation, multilayer perceptrons, activations and gradients, batch normalization, and building a Generatively Pretrained Transformer.
