This is my note while using PyTorch
Table of Contents:
Dataset
Initialization
- Xavier
- Kaiming
Others
- nn from scratch:
- create weights, bias with torch.rand & torch.zeros with requires_grad
- make forward pass & call loss.backward to calculate gradients
- update weights, bias with gradients
