Project AGI

Building an Artificial General Intelligence

This site has been deprecated. New content can be found at https://agi.io

Monday 1 June 2015

Reading List - May 2015

John Lisman, "The Challenge of Understanding the Brain: Where We Stand in 2015", Neuron, 2015
For many in ML and AI,  biological knowledge is focussed on cortex. This paper gives an excellent broad overview of current biological understanding of intelligence.

Sebastian Billaudelle and Subutai Ahmad, "Porting HTM Models to the Heidelberg Neuromorphic Computing Platform", arXiv.org, 2015
Progress in Numenta's HTM and particularly interesting to see collaboration with the Human Brain Project. Does this signify growing collaboration with computational biologists?

Yann LeCun, Yoshua Bengio and Geoffrey Hinton, "Deep learning", Nature, 2015
Review of Deep learning by the guys that are recognised as THE fathers of the field - they have been working on NN for years without due acclaim, until recently.

LSTM Tutorial, Department of Computer Science, University of Kaiserslautem, 2015

Nitish Srivastava, Elman Mansimov and Ruslan Salakhutdinov, Unsupervised Learning of Video Representations using LSTMs", arXiv.org, 2015

Andrej Karpathy, "The Unreasonable Effectiveness of Recurrent Neural Networks", Andrej Karpathy blog, 2015
We have a renewed interest in RNN's and LSTM's and their great potential. Here are a few papers and tutorials that are well worthwhile for learning about this area.