您当前的位置：home > Detailed Browse
Article Detail
Sharing deep generative representation for perceived image reconstruction from human brain activity
Abstracts
| Decoding human brain activities via functional magnetic resonance imaging (fMRI) has gained increasing attention in recent years. While encouraging results have been reported in brain states classification tasks, reconstructing the details of human visual experience still remains difficult. Two main challenges that hinder the development of effective models are the perplexing fMRI measurement noise and the high dimensionality of limited data instances. Existing methods generally suffer from one or both of these issues and yield dissatisfactory results. In this paper, we tackle this problem by casting the reconstruction of visual stimulus as the Bayesian inference of missing view in a multiview latent variable model. Sharing a common latent representation, our joint generative model of external stimulus and brain response is not only ``deep" in extracting nonlinear features from visual images, but also powerful in capturing correlations among voxel activities of fMRI recordings. The nonlinearity and deep structure endow our model with strong representation ability, while the correlations of voxel activities are critical for suppressing noise and improving prediction. We devise an efficient variational Bayesian method to infer the latent variables and the model parameters. To further improve the reconstruction accuracy, the latent representations of testing instances are enforced to be close to that of their neighbours from the training set via posterior regularization. Experiments on three fMRI recording datasets demonstrate that our approach can more accurately reconstruct visual stimuli. |
Download
Comment| Comment List |
|---|
| NO. | Comment content |
| 1 | 很棒 (Comment time:2017-03-29 00:11:13,From: Anonymous comments ) |
From:
杜长德
Subject:
Computer Science
>>
Computer Application Technology
DOI：10.12074/201703.00895
Cite as:
chinaXiv:201703.00895
(or this versionchinaXiv:201703.00895V5)
Recommended references：
Du, Changde, Du, Changying, He, Huiguang.(2017).Sharing deep generative representation for perceived image reconstruction from human brain activity.[ChinaXiv:201703.00895] (Click&Copy)
| Version History | ||||
|---|---|---|---|---|
| [V5] | 2017-05-20 13:00:44 | chinaXiv:201703.00895V5 | Download | |
| [V4] | 2017-05-18 18:36:32 | chinaXiv:201703.00895v4(View This Version) | Download | |
| [V3] | 2017-05-16 18:10:23 | chinaXiv:201703.00895v3(View This Version) | Download | |
| [V2] | 2017-05-15 21:11:35 | chinaXiv:201703.00895v2(View This Version) | Download | |
| [V1] | 2017-03-28 13:40:48 | chinaXiv:201703.00895v1(View This Version) | Download | |
| Related Paper |
|---|
1. 基于ChatGPT的用户图书评分偏好预测研究 2023-05-12
2. A Preliminary Study on the Capability Boundary of LLM and a New Implementation Approach for AGI 2023-05-06
3. Call for urgent regulations on artificial intelligence 2023-04-15
4. 从“拟人归因”到“联盟建立”：人与聊天机器人关系对参与度的影响 2023-04-03
5. An Improved YOLOv5-Based Method for UAV Object Detection 2023-03-23
7. Disentangled Representation Transformer Network for 3D Face Reconstruction and Robust Dense Alignment 2023-03-07
8. Delving into Semantic Scale Imbalance 2023-02-16
Copyright@2016 National Science Library，Chinese Academy of Sciences Address:33 Beisihuan Xilu,Zhongguancun,Beijing P.R.China,100190京ICP备05002861号-25