政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/135531

English | 正體中文 | 简体中文 | Post-Print筆數 : 27 | Items with full text/Total items : 109952/140887 (78%)
Visitors : 46354098 Online Users : 737

RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.

Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer

政大機構典藏 > 資訊學院 > 資訊科學系 > 會議論文 > Item 140.119/135531

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/135531

Title:	Visual Story Ordering with a Bidirectional Writer
Authors:	黃瀚萱 Huang, Hen-Hsen Lin, Wei-Rou Chen, Hsin-Hsi
Contributors:	資科系
Keywords:	Multimodal modeling;temporal information ordering;sentence ordering;visual-semantic representation
Date:	2020-06
Issue Date:	2021-06-04 14:45:27 (UTC+8)
Abstract:	This paper introduces visual story ordering, a challenging task in which images and text are ordered in a visual story jointly. We propose a neural network model based on the reader-processor-writer architecture with a self-attention mechanism. A novel bidirectional decoder is further proposed with bidirectional beam search. Experimental results show the effectiveness of the approach. The information gained from multimodal learning is presented and discussed. We also find that the proposed embedding narrows the distance between images and their corresponding story sentences, even though we do not align the two modalities explicitly. As it addresses a general issue in generative models, the proposed bidirectional inference mechanism applies to a variety of applications.
Relation:	Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR ’20), Association for Computing Machinery, pp.326-330
Data Type:	conference
DOI 連結:	https://doi.org/10.1145/3372278.3390735
DOI:	10.1145/3372278.3390735
Appears in Collections:	[資訊科學系] 會議論文

Files in This Item:

File	Size	Format
289.pdf	1703Kb	Adobe PDF2	143	View/Open

社群 sharing

著作權政策宣告 Copyright Announcement

1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.

Loading...