DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | Yang, Hongseok | - |
dc.contributor.advisor | 양홍석 | - |
dc.contributor.author | Kim, Hyunsu | - |
dc.date.accessioned | 2022-04-27T19:32:03Z | - |
dc.date.available | 2022-04-27T19:32:03Z | - |
dc.date.issued | 2021 | - |
dc.identifier.uri | http://library.kaist.ac.kr/search/detail/view.do?bibCtrlNo=963354&flag=dissertation | en_US |
dc.identifier.uri | http://hdl.handle.net/10203/296132 | - |
dc.description | 학위논문(석사) - 한국과학기술원 : 전산학부, 2021.8,[iii, 15 p. :] | - |
dc.description.abstract | In this paper, I tackle the non-stationary kernel problem of the JSA algorithm by Ou and Song 2020, a recent proposal that learns a deep generative model pθ(x,h) and a corresponding approximate posterior qφ(h,x) by drawing samples from a non-stationary Markov chain and estimating gradients with these samples. The non-stationary kernel problem refers to the degraded performance of the algorithm due to the constant change of the transition kernel of the chain throughout the run of the algorithm. I present an automatic adaptive strategy for checking whether this change is significant at each gradient-update step or not, and resetting the chain with a sample drawn from the current approximate posterior qφ(h,x) if the answer to the check is yes. In the experiments with the binarized MNIST, this strategy gives results comparable with or slightly better than those reported in the original paper on JSA, while avoiding the nontrivial manual intervention required for handling the non-stationary kernel problem in the original JSA algorithm. | - |
dc.language | eng | - |
dc.publisher | 한국과학기술원 | - |
dc.subject | Model learning▼aDeep generative model▼aMonte-Carlo approximation▼aMarkov chain▼aJoint stochastic optimization | - |
dc.subject | 모델 학습▼a심층 생성 모델▼a몬테카를로 근사▼a마르코프 연쇄▼a결합 확률 근사 | - |
dc.title | Adaptive strategy for resetting a non-stationary Markov chain during learning via joint stochastic approximation | - |
dc.title.alternative | 결합확률근사 학습에서 비정상 마르코프 연쇄를 재설정하는 적응형 전략 | - |
dc.type | Thesis(Master) | - |
dc.identifier.CNRN | 325007 | - |
dc.description.department | 한국과학기술원 :전산학부, | - |
dc.contributor.alternativeauthor | 김현수 | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.