diff --git a/README.md b/README.md index 40355ae20dd8dec8bee78bc30951a0d9f6217207..89ea0478094fa2710138eec13cbe35016d909d70 100644 --- a/README.md +++ b/README.md @@ -43,32 +43,6 @@ Ces fonctions permettent de calculer la précision de l'algorithme k-NN pour dif ### Backpropagation in a Neural Network -#### Partial Derivatives with Chain Rule - -1. **\(\frac{\partial C}{\partial A^{(2)}}\)**: - \(\frac{\partial C}{\partial A^{(2)}} = \frac{2}{N_{out}}(\hat{Y} - Y)\) - -2. **\(\frac{\partial C}{\partial Z^{(2)}}\)**: - \(\frac{\partial C}{\partial Z^{(2)}} = \frac{2}{N_{out}}(\hat{Y} - Y) \cdot \sigma(Z^{(2)}) \cdot (1 - \sigma(Z^{(2)}))\) - -3. **\(\frac{\partial C}{\partial W^{(2)}}\)**: - \(\frac{\partial C}{\partial W^{(2)}} = \frac{\partial C}{\partial Z^{(2)}} \cdot A^{(1)T}\) - -4. **\(\frac{\partial C}{\partial B^{(2)}}\)**: - \(\frac{\partial C}{\partial B^{(2)}} = \frac{\partial C}{\partial Z^{(2)}}\) - -5. **\(\frac{\partial C}{\partial A^{(1)}}\)**: - \(\frac{\partial C}{\partial A^{(1)}} = (W^{(2)T} \cdot \frac{\partial C}{\partial Z^{(2)}})\) - -6. **\(\frac{\partial C}{\partial Z^{(1)}}\)**: - \(\frac{\partial C}{\partial Z^{(1)}} = \frac{\partial C}{\partial A^{(1)}} \cdot \sigma'(Z^{(1)})\) - -7. **\(\frac{\partial C}{\partial W^{(1)}}\)**: - \(\frac{\partial C}{\partial W^{(1)}} = \frac{\partial C}{\partial Z^{(1)}} \cdot A^{(0)T}\) - -8. **\(\frac{\partial C}{\partial B^{(1)}}\)**: - \(\frac{\partial C}{\partial B^{(1)}} = \frac{\partial C}{\partial Z^{(1)}\) - # Neural Network Training and Testing Overview diff --git a/main.py b/main.py index d817efb37c42c020c3c9834ead1fb040eef8a358..528b4515447525ff3a378f39aff80f5862319555 100644 --- a/main.py +++ b/main.py @@ -1,7 +1,7 @@ from read_cifar import read_cifar, split_dataset from knn import evaluate_knn_for_k, plot_accuracy_versus_k import matplotlib.pyplot as plt -from mlp2 import run_mlp_training, plot_accuracy_versus_epoch +from mlp import run_mlp_training, plot_accuracy_versus_epoch diff --git a/results/mlp1.png b/results/mlp1.png new file mode 100644 index 0000000000000000000000000000000000000000..0891d66a33d212f49cc4bb38fcc65c9042bf4b7c Binary files /dev/null and b/results/mlp1.png differ