The accuracy is increasing with each epochs without converging, we could increase the learning rate to speed up the training and inscrease the numbers of epoch to see what would be our maximum accuracy.
For 100 epochs and a learning rate of 0.1 we got a test accuracy of 0.13.
For 300 epochs and a learning rate of 0.1 we increased the training accuracy to 0.15991 and we got a test accuracy of 0.155
The result is dissapointing, the MLP as a lower accuracy than the KNN model...