Hands-On Natural Language Processing with Python
上QQ阅读APP看书,第一时间看更新

Batch normalization

Batch normalization rescales the input and all intermediate layer output of the network, making the training smoother and faster. The rescaling is done to achieve a 0 mean and a standard deviation of 1 for all of the input and output. This helps the neural network to train faster and leads to some regularization.