draugr.torch_utilities.optimisation.debugging.gradients.flow.plot_grad_flow

draugr.torch_utilities.optimisation.debugging.gradients.flow.plot_grad_flow(model: Module, lines: bool = True, alpha: float = 0.5, line_width: float = 1.0) None[source]

Plots the gradients flowing through different layers in the net during training. Can be used for checking for possible gradient vanishing / exploding problems.

Usage: After value.backwards(), use plot_grad_flow(model) to visualize the gradient flow of model

Parameters
  • model

  • lines

  • alpha

  • line_width