계명대학교 의학도서관 Repository

Toward the biological model of the hippocampus as the successor representation agent

Metadata Downloads
Author(s)
Hyunsu Lee
Keimyung Author(s)
Lee, Hyun Su
Department
Dept. of Anatomy (해부학)
Journal Title
Biosystems
Issued Date
2022
Volume
213
Keyword
HippocampusPredictive mapSuccessor representationTemporal difference learningHeterosynaptic plasticity
Abstract
The hippocampus is an essential brain region for spatial memory and learning. Recently, a theoretical model of the hippocampus based on temporal difference (TD) learning has been published. Inspired by the successor representation (SR) learning algorithms, which decompose value function of TD learning into reward and state transition, they argued that the rate of firing of CA1 place cells in the hippocampus represents the probability of state transition. This theory, called predictive map theory, claims that the hippocampus representing space learns the probability of transition from the current state to the future state. The neural correlates of expecting the future state are the firing rates of the CA1 place cells. This explanation is plausible for the results recorded in behavioral experiments, but it is lacking the neurobiological implications.

Modifying the SR learning algorithm added biological implications to the predictive map theory. Similar with the simultaneous needs of information of the current and future state in the SR learning algorithm, the CA1 place cells receive two inputs from CA3 and entorhinal cortex. Mathematical transformation showed that the SR learning algorithm is equivalent to the heterosynaptic plasticity rule. The heterosynaptic plasticity phenomena in CA1 were discussed and compared with the modified SR update rule. This study attempted to interpret the TD algorithm as the neurobiological mechanism occurring in place learning, and to integrate the neuroscience and artificial intelligence approaches in the field.
Keimyung Author(s)(Kor)
이현수
Publisher
School of Medicine (의과대학)
Citation
Hyunsu Lee. (2022). Toward the biological model of the hippocampus as the successor representation agent. Biosystems, 213, 104612. doi: 10.1016/j.biosystems.2022.104612
Type
Article
ISSN
0303-2647
Source
https://www.sciencedirect.com/science/article/abs/pii/S0303264722000053
DOI
10.1016/j.biosystems.2022.104612
URI
https://kumel.medlib.dsmc.or.kr/handle/2015.oak/44170
Appears in Collections:
1. School of Medicine (의과대학) > Dept. of Anatomy (해부학)
공개 및 라이선스
  • 공개 구분공개
  • 엠바고Forever
파일 목록
  • 관련 파일이 존재하지 않습니다.

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.