11/10/2018 Machine Learning - Inicio | Coursera

Neural Networks: Learning

1
point

1. 
You are training a three layer neural network and would like to use backpropagation to compute the gradient of the cost
function. In the backpropagation algorithm, one of the steps is to update

(2) (2) (3)

for every i, j . Which of the following is a correct vectorization of this step?

Δ(2) := Δ(2) + δ (3) ∗ (a(2) )T

Δ(2) := Δ(2) + δ (3) ∗ (a(3) )T

Δ(2) := Δ(2) + (a(2) )T ∗ δ (3)

Δ(2) := Δ(2) + (a(3) )T ∗ δ (2)

1
point

2. 
Suppose Theta1 is a 5x3 matrix, and Theta2 is a 4x6 matrix. You set thetaVec = [Theta1(:); Theta2(:)] . Which of the
following correctly recovers Theta2?

reshape(thetaVec(16 : 39), 4, 6)

reshape(thetaVec(15 : 38), 4, 6)

reshape(thetaVec(16 : 24), 4, 6)

reshape(thetaVec(15 : 39), 4, 6)

reshape(thetaVec(16 : 39), 6, 4)

1
point

3. 
Let J(θ) = 2θ4 + 2. Let θ = 1, and ϵ = 0.01. Use the formula J(θ+ϵ)−J(θ−ϵ)
2ϵ
to numerically compute an approximation to the
dJ(θ)
derivative at θ = 1. What value do you get? (When θ = 1, the true/exact derivative is dθ = 8.)

8.0008

https://www.coursera.org/learn/machine-learning/exam/3UQTb/neural-networks-learning 1/3
11/10/2018 Machine Learning - Inicio | Coursera

7.9992

 Neural Networks: Learning

1
point

4. 
Which of the following statements are true? Check all that apply.

Using gradient checking can help verify if one's implementation of backpropagation is bug-free.

Gradient checking is useful if we are using one of the advanced optimization methods (such as in fminunc) as our
optimization algorithm. However, it serves little purpose if we are using gradient descent.

For computational e ciency, after we have performed gradient checking to

verify that our backpropagation code is correct, we usually disable gradient checking before using backpropagation
to train the network.

Computing the gradient of the cost function in a neural network has the same e ciency when we use
backpropagation or when we numerically compute it using the method of gradient checking.

1
point

5. 
Which of the following statements are true? Check all that apply.

If we are training a neural network using gradient descent, one reasonable "debugging" step to make sure it is
working is to plot J(Θ) as a function of the number of iterations, and make sure it is decreasing (or at least non-
increasing) after each iteration.

Suppose you have a three layer network with parameters Θ(1) (controlling the function mapping from the inputs to
the hidden units) and Θ(2) (controlling the mapping from the hidden units to the outputs). If we set all the elements
of Θ(1) to be 0, and all the elements of Θ(2) to be 1, then this su ces for symmetry breaking, since the neurons are
no longer all computing the same function of the input.

If we initialize all the parameters of a neural network to ones instead of zeros, this will su ce for the purpose of
"symmetry breaking" because the parameters are no longer symmetrically equal to zero.

Suppose you are training a neural network using gradient descent. Depending on your random initialization, your
algorithm may converge to di erent local optima (i.e., if you run the algorithm twice with di erent random
initializations, gradient descent may converge to two di erent solutions).

Entiendo que enviar trabajo que no es mío resultará en la desaprobación permanente de este curso y la desactivación de
mi cuenta de Coursera. 

Obtén más información sobre el Código de Honor de Coursera

Cristian Cabello Martín

https://www.coursera.org/learn/machine-learning/exam/3UQTb/neural-networks-learning 2/3
11/10/2018 Machine Learning - Inicio | Coursera

Submit Quiz
Neural Networks: Learning
 Cuestionario, 5 preguntas

https://www.coursera.org/learn/machine-learning/exam/3UQTb/neural-networks-learning 3/3