Backpropagation¶

Papers¶

1986-Learning representations by back-propagating errors¶

Learning representations by back-propagating errors¹. 通过BP进行梯度下降更新来训练NN的开山之作。

2023-The Backpropagation algorithm for a math student¶

The Backpropagation algorithm for a math student². 文章通过Jacobian Matrix来阐述反向传播中梯度的计算和更新，这种方法相比直接从矩阵/向量求导入手更加容易理解。 此外论文从简单到复杂，一步步的推导过程让论文理解起来更加容易。