@the.synthetic.mind: In this video, we build recurrent neural networks from scratch, starting with how a single recurrent hidden state lets a network process sequences of arbitrary length. We walk through the arithmetic of vanishing gradients through time to see why plain RNNs inevitably forget, and how the gated conveyor belt of an LSTM resolves the issue. Finally, we trace how sequence-to-sequence bottlenecks inspired attention and transformers, and why modern state space models are bringing recurrence back. #RecurrentNeuralNetworks #LSTM #DeepLearning #MachineLearning