Learning Rates tab (Training Options dialog box)

Top  Previous  Next

 

Use this tab to modify training rates for existing neural networks.

 

Layer

Select from this list the layer you want to modify.

 

Learning

 

Rate

Displays the currently set learning rate for the neurons in this layer. To modify this rate, type a learning rate.

Refer to Learning Rate (Layer Definition tab (Network Definition dialog box)) for additional information on learning rates.

 

Step

Displays the currently set step of the learning rate for the neurons in this layer. To modify this rate step, type a new learning rate step.

Refer to Learning Step (Layer Definition tab (Network Definition dialog box)) for additional information on the learning rate step.

 

<< Populate

Click this button to copy the current learning rate and step into all previous layers.

 

NoteThis command is available when the currently selected layer is other than the first hidden layer.

 

Populate >>

Click this button to copy the current learning rate and step into all following layers.

 

NoteThis command is available when the currently selected layer is other than the output layer.

 

Momentum

 

Rate

Displays the currently set momentum rate for the neurons in this layer. To modify this rate, type a new momentum rate.

Refer to Momentum Rate (Layer Definition tab (Network Definition dialog box)) for additional information on momentum rates.

 

Step

Displays the currently set step of the momentum rate for the neurons in this layer. To modify this rate step, type a new momentum rate step.

Refer to Momentum Step ((Layer Definition tab (Network Definition dialog box)) for additional information on the momentum rate step.

 

<< Populate

Click this button to copy the current learning rate and step into all previous layers.

 

NoteThis command is available when the currently selected layer is other than the first hidden layer.

 

Populate >>

Click this button to copy the current momentum rate and step into all following layers.

 

NoteThis command is available when the currently selected layer is other than the output layer.

 

Momentum Base

 

Momentum on Last Change

Indicates that the momentum rate is applied on the previous total learning rate change.

 

Momentum on Last Gradient

Indicates that the momentum rate is applied on the previous partial derivative only.

 

NoteThese options have no effect when the momentum rate for the neurons in this layer is set to zero.

Refer to backpropagation for additional information on the momentum base.

 

Sponsored

Try Predictive Systems Lab

Interactive Demo →

Need Help?
Contact support