The gradient encodes the direction of the steepest ascent of at point . It aways lives on the domain of the function .

In case of a 1D function, encodes the direction on the or axis where the function grows the most.

In case of a 2D function, it encodes the direction on the plane.

Note

Note that even if we visualize the 2D function in a 3D plane, the function is still 2D. As we visualize a 1D function on a 2D plane.

The length of the gradient vector encodes the strongness of the steepest ascent, meaning how much fast the function grows.