Departments of Bioengineering and Neuroscience\
University of Pennsylvania
Credit assignment: brains and deep learning
I will review the problem of credit assignment in brains, deep learning and the field of deep learning. In doing so I will give an overview of the problems in credit assignment as they occur in any system. I will also review how various systems approximate gradient descent. Lastly I will discuss the effects of credit assignment on the deep learning field – and how cultural evolution offers a somewhat interesting way to view the history of that field.