What is the best way to determine the learning rate parameters for stochastic gradient descent
when the distribution of the input data shifts over time?

A.
The learning rate should be adjusted periodically based on the setting that optimizes the
objective function over a sample of recent observations

B.
The learning rate should be fixed number that decays as the number of observations in the data
set increases

C.
The learning rate should be the value that optimizes the value of the objective function over the
first N samples in the dataset

D.
The learning rate should be a fixed number with a constant decay factor

E.
The learning rate should be continuously adjusted based on the value that optimizes the
objective function for the most recent observation from the input data