Neural Network Forward and Backward Compute (2 layers)

1: Forward Compute with One Example

2: Forward Compute with Vectorizing across multiple examples

3. Gradient for Backward Compute

4. Formula for Backward Compute

5. To understand why the partial derivatives are calculated, check out the book here: http://www.deeplearningbook.org/  

or check the video here:

https://www.coursera.org/learn/neural-networks-deep-learning/lecture/6dDj7/backpropagation-intuition-optional