•When
updating a weight, also add the previous update to that weight times a momentum constant
m (0.0 <= m < 1.0).
•Possible
to carry weights
–across
plateaux in error surface
–through
local minima to global minima
–through
global minima to local minima (i.e. can have undesirable effects as well).
