Our 2021 science fair repository consisting of a neural network and optimization algorithms made for it from scratch.

(test.csv and train.csv can be found here)

https://www.youtube.com/watch?v=aircAruvnKk&list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi

https://towardsdatascience.com/optimizers-for-training-neural-network-59450d71caf6#:~:text=Many%20people%20may%20be%20using,order%20to%20reduce%20the%20losses

https://ruder.io/optimizing-gradient-descent/index.html#nesterovacceleratedgradient