The Brain vs Deep Learning Part I: Computational Complexity — Or Why the Singularity Is Nowhere Near

Kannu

This was shared by a friend of mine. 

I read articles all the time but usually they don't blow my mind as this one did. I studied neuroscience in 1995 and 20 years hence the field has grown hugely. This may be too technical for you but if you can struggle through it, it will blow your mind. It talks about biology, mathematics, statistics, chemistry, logic, biology, computational science, nlp and and and. Brilliant article son. I loved it. I'm in awe of our own brains. So much to learn. 

Just one small point son. Sleep! Sleep well. That will help you learn! And eat well. You need to feed that brain hugely. 

Love

Baba

The Brain vs Deep Learning Part I: Computational Complexity — Or Why the Singularity Is Nowhere Near
https://timdettmers.wordpress.com/2015/07/27/brain-vs-deep-learning-singularity/
(via Instapaper)

---

In this blog post I will delve into the brain and explain its basic information processing machinery and compare it to deep learning. I do this by moving step-by-step along with the brains electrochemical and biological information processing pipeline and relating it directly to the architecture of convolutional nets. Thereby we will see that a neuron and a convolutional net are very similar information processing machines. While performing this comparison, I will also discuss the computational complexity of these processes and thus derive an estimate for the brains overall computational power. I will use these estimates, along with knowledge from high performance computing, to show that it is unlikely that there will be a technological singularity in this century.