Reading List - May 2015

John Lisman, "The Challenge of Understanding the Brain: Where We Stand in 2015", Neuron, 2015

For many in ML and AI,  biological knowledge is focussed on cortex. This paper gives an excellent broad overview of current biological understanding of intelligence.

Sebastian Billaudelle and Subutai Ahmad, "Porting HTM Models to the Heidelberg Neuromorphic Computing Platform", arXiv.org, 2015

Progress in Numenta's HTM and particularly interesting to see collaboration with the Human Brain Project. Does this signify growing collaboration with computational biologists?

Yann LeCun, Yoshua Bengio and Geoffrey Hinton, "Deep learning", Nature, 2015

Review of Deep learning by the guys that are recognised as THE fathers of the field - they have been working on NN for years without due acclaim, until recently.

LSTM Tutorial, Department of Computer Science, University of Kaiserslautem, 2015

Nitish Srivastava, Elman Mansimov and Ruslan Salakhutdinov, Unsupervised Learning of Video Representations using LSTMs", arXiv.org, 2015

Andrej Karpathy, "The Unreasonable Effectiveness of Recurrent Neural Networks", Andrej Karpathy blog, 2015

We have a renewed interest in RNN's and LSTM's and their great potential. Here are a few papers and tutorials that are well worthwhile for learning about this area.