Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/36378
|
| Title: | 自動摘要方法之研究與探討 |
| Authors: | 吳家威
Wu, Chia-wei |
| Contributors: | 劉昭麟
吳家威
Wu, Chia-wei |
| Keywords: | summarization
ontology |
| Date: | 2002 |
| Issue Date: | 2009-09-18 18:26:21 (UTC+8) |
| Abstract: | 隨著網際網路的發展，人類能夠獲取的資訊也隨之增加。因此，如何增加獲取資訊的效率便成為重要的研究之一。自動摘要系統的目的即在於協助使用者有效率的閱讀。其根本的問題為：如何從文章中找出重要的資訊並呈現給使用者。本文採用三種方法進行摘要，應用於英文的新聞文件：第一種為利用ontology建立一領域的文章可能的主題資訊，並利用該資訊選出重要的段落作為摘要。第二種方法為建立一領域的ontology後，利用ontology所定義的標籤建構摘要的樣板，再利用該樣版搜尋所需的資訊，並將摘要輸出。第三種方法為利用各種不同的特徵找出文章中較重要的段落。另外，我們也將文章依其主題予以分類，利用不同主題的文章呈現的特徵表現不同，改良原本的特徵選取摘要的方法。本文呈現三種以不同方式獲取文章的主題資訊的方法，並利用該資訊呈現文章中較重要的訊息，經過實驗的評估皆獲得一定的成果。
In the past decade, the explosively growing number of online articles has made efficient information gathering a challenging necessity. We need ways to absorb the information contained in the news articles effectively. Automatically providing summaries of articles is one way to save people time. The essential problems of automatic summarization are: how to identify the useful information and how to present the results to readers. I compare and analyze three kinds of summarization methods. The first method constructs a domain-depend knowledge based on the ontology approach, then use the ontology for gathering the main topics, and chooses the desired proportion of paragraphs as the summary by gathered topical information. The second method is similar to that taken by information-extraction systems. I organize semantic tags into an ontological structure, and the summarization system learns tags patterns for creating summaries from tagged data. The summarization system creates summaries by extracting useful information from a news article, and replaces the semantic tags with extracts in selected tag patterns. The third method analyzes the effects of several previously proposed features for summarization under different situations. The most important observation is that the effectiveness if these features depends on the topics of the news articles Hence, I collect statistical information about the features for different possible new topics, and apply such conditional probabilistic information for extracting summaries. Effectiveness of these proposed methods vary from case to case, but is believed to be satisfactory based on the experimental results.
目錄
第一章 緒論 1
1.1 研究動機 2
1.2 問題描述 3
1.3 研究目的 4
1.4 論文貢獻 5
1.5 論文的章節架構 6
第二章 相關研究 7
2.1 自動摘要系統研究簡介 7
2.2 文獻探討 9
2.3 自動摘要系統的評估 13
2.4 討論 15
第三章 應用本體論設計與建置摘要系統 17
3.1 系統架構 17
3.2 本體論簡介 18
3.3 以Term-frequency為主要特徵的摘要方法 21
3.4 Ontology-based的摘要方法 22
3.5 資料來源 29
3.6 實驗步驟與結果分析 30
第四章 體育新聞摘要擷取 35
4.1背景簡述 35
4.2系統架構 36
4.3 摘要產生方法 37
4.3.1 標籤標記(tagging) 38
4.3.2 句型學習 40
4.3.3 句型篩選 42
4.3.4 選取摘要 43
4.3.5 摘要句型學習演算法 43
4.4 成果展示 45
4.5 分析與討論 47
第五章 比較與分析特徵摘要方法 49
5.1 系統架構 49
5.2文件分類 51
5.3 特徵 59
5.3.1常用特徵 59
5.3.2 Clustering Words 61
5.4 特徵值分析 64
5.4.1 資料來源 64
5.4.2 使用個別特徵挑選摘要的實驗方法與結果 64
5.4.3 特徵值於摘要段落與非摘要段落的差異 67
5.4.4 依文章主題分類後的特徵值 69
5.4.5 利用Information Gain分析特徵的摘要選取能力 72
5.4.6 利用段落特徵值的排序分析 74
5.5 實驗 76
5.5.1 統計方法 76
5.5.2 決策樹 82
5.5.3討論 85
5.6 結論 85
第六章 總結 87
參考文獻 89
附錄 一： Ontology 圖 95
附錄二 範例文章 99
附錄三 標籤內容 100 |
| Reference: | 參考文獻
[1] C. Aone, M. E. Okurowski, and J. Gorlinsky, and B. Larsen. “A Scalable Summarization System Using Robust NLP,” Proceedings of the Association for Computational Linguistics Work shop on Intelligent Scalable Text Summarization, pp.66-73, 1997.
[2] J. Allan, R. Gupta, and V. Khandelwal, “Temporal summaries of News Topics,” Proceedings of the 24th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.10-18, 2001.
[3] J. Aseltine, “WAVE: An Incremental Algorithm for Information Extraction,” In Proceedings of the AAAI Workshop on Machine Learning for Information Extraction.1999.
[4] R. Barzilay, N. Elhadad, and K. R. McKeown, “Inferring Strategies for Sentence Ordering in Multidocument News Summarization,”Journal of Artificial Intelligence Research, (17), pp.33-55, 2002.
[5] L. D. Baker and A. K. McCallum, “Distributional Clustering of Words for Text Classification,” Proceedings of the 21th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.96-103, 1998.
[6] S. Chan, T. Lai, W. Gao, B. T’sou, “Mining discourse markers for chinese textual summarization,” Proceedings, Conference of the North American Chapter of the Association for Computational Linguistics and Conference on Applied Natural Language Processing Workshop on Automatic Summarization, 2000.
[7] B. Chandrasekaran, J. R. Josephson, and V. R. Benjamins, “What Are Ontologies, and Why Do We Need Them?,” IEEE Intelligent Systems, 14(1):pp.20-26, 1999.
[8] R. O. Duda, P. E. Hart, D. G. Stork “Pattern Classification and Scene Analysis: Pattern Classification,” Brooks/Cole Wiley, John & Sons, Incorporated Pub Co, 2000.
[9] S. Deerwester, S. Dumais, G.Furnas, T. Landauer, and R.Harshman, “Indexing by Latent Semantic Analysis,” Journal of the American Society for Information Science, (41), pp.391-407, 1990.
[10] H. Edmundson. “New Methods in Automatic Abstracting,” Journal of ACM, 16(2), pp.264-285, 1969.
[11] Tom Gruber, Ontology Definition, http://www-ksl.Stanford.edu/kst/what-is-an-ontology.html
[12] H. H. Good, “Greenhouse of Science for Management,” Management Science, pp. 3,1958.
[13] J. Goldstein, M. Kantrowitz, V. O. Mittal, and J. Carbonell, Summarizing “Text Documents: Sentence Selection and Evaluation Metrics, ” Proceedings of the 22th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 121-128, 1999.
[14] C. W. Holsapple, and K. D. Joshi, “A Collaborative Approach to Ontology Design,” Communications of the ACM, 45, pp. 42~47, 2002.
[15] V. Hatzivassiloglou, J. L. Klavans, M. L. Holcombe,R. Barzilay, M.-Y. Kan, and K. R. McKeown. “Simfinder: A Flexible Clustering Tool for Summarization,” Proceedings of the North American Chapter of the Association for Computational Linguistics 2001 Workshop on Automatic Summarization, pp.41-49, 2001.
[16] U. Hahn, I. Mani, “The Challenges of Automatic Summarization,” IEEE Computer Society, (11), pp.29-36, 2002.
[17] E. Hovy, and C. Y. Lin, “Automated Text Summarization in SUMMARIST, ” Advances in Automatic Text Summarization, MIT Press, pp.81-94, 1999.
[18] K. S. Jones and J. Galliers, “Evaluating Natural Language Processing Systems: An Analysis and Review, ” Springer-Verlag, 1996.
[19] H. Jing, R. Barzilay, K. McKeown, and M. Elhadad, “Summarization Evaluation Methods: Experiments and Analysis,” In Working Notes of the AAAI-98 Spring Symposium on Intelligent Text Summarization, pp.60-68, 1998
[20] J. Kupiec, J. Pedersen, F. Chen, “A Trainable Document Summarizer,” Proceedings of the 18th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.68-73, 1995.
[21] M. Kobayashi and K. Takeda, “Information retrieval on the web,” ACM Computing Surveys, (32), pp.144-173, 2000.
[22] C. Y Lin, “Training a Selection Function for Extraction,” Proceedings of the eighth international conference on Information and knowledge management, pp.55-62, 1999.
[23] H. P. Luhn., “The automatic creation of literature abstracts,” IBM Journal of Research and Development, 2(2), pp.159-165, 1958.
[24] I. Mani, D. House, G. Klein, L. Hirschman, L. Obrst, T. Firmin, M. Chrzanowski, and B. Sundheim,” The tipster summac text summarization evaluation: Final report. Technical report, DARPA, 1998.
[25] K. McKeown,“D.R.Radev, “Generating Summaries of Multiple News Articles,” Proceedings of the 18th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.74-82, 1995.
[26] D. D. McDonald, “The View from the Trenches: Issues in the Ontology of Restricted Domains, ” Proceedings of the international Conference on Formal Ontology in Information Systems 2001, pp.22-33, 2001.
[27] D. L. McGuinness, http://www.ontology.org/main/papers/iccs-dlm.html
[28] T. M. Mitchell, “Machine Learning, ” The McGraw-Hill Companies, 1997.
[29] M. Mitra, A. Singhal, and C. Buckley. “Automatic text summarization by paragraph extraction, ” In Applied Natural Language Processing / European Chapter of the Association for Computational Linguistics 97 Workshop on Intelligent Scalable Text Summarization, pp.31-36, 1997.
[30] D. Marcu. “From discourse structures to text summaries,” In Applied Natural Language Processing / European Chapter of the Association for Computational Linguistics 97 Workshop on Intelligent Scalable Text Summarization, pp.82-88, 1997.
[31] I. Mani, D. House, G. Klein, L. Hirschman, L. Obrst, T. Firmin, M. Chrzanowski, and B. Sundheim. “Advances in Automatic Text Summarization Evaluation: Final report. Technical report,” DARPA, 1998.
[32] S. Miike, E. Itoh, K. Ono, and K. Sumita. “A FullText Retrieval System with Dynamic Abstract Generation Function,” Proceedings of the 17th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.152-161.1994.
[33] A. Maedche, B. Motik, L. Stojanovic, R. Studer, and R. Volz, “Ontologies for Enterprise Knowledge Management,” IEEE Intelligent Systems, 18(2), pp.26-33, 2003.
[34] S. H. Manning, “Foundations of Statistical Natural Language Processing”, MIT Press, 1999.
[35] R. Navigli, P. Velardi, and A. Gangemi, “Ontology Learning and Its Application to Automated Terminology Translation,” IEEE Intelligent Systems, 18(1), pp.22-31, 2003.
[36] M. F. Porter, “An Algorithm for Suffix Stripping,” Program, 14(3), pp.30-137, 1980.
[37] J. R. Quinlan. , “C4.5: Programs for Machine Learning, ” 1993.
[38] D. R. Radev, H. Jing, and M. Budzikowska, “Centro-based summarization of multiple documents: sentence extraction, utility-based evaluation and user studies,” In Applied Natural Language Processing / North American Chapter of the Association for Computational Linguistics 2000 Workshop, pp.21-29, 2000
[39] G. Salton, M. J. McGill, “Introduction to modern information retrieval,” NY: McGraw-Hill, 1983
[40] J. F. Sowa, “Knowledge Representation: Logical, Philosophical, and Computational Foundations, ” Brooks/Cole Pub Co, 1999.
[41] D. Yarowsky, “Word-Sense Disambiguation Using Statistical Models of Roget`s Categories Trained on Large Corpora,” Proceedings of the 14th International Conference on Computational Linguistics, pp.454--460, 1992.
[42] R. Yangarber, “Scenario Customization for Information Extraction,” Ph.D. thesis, New York University, 2000.
[43] G. Yihong and X. Lin, “Generic Text Summarization Using Relevance Measure and Latent Semantic Analysis,” Proceedings of the 24th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, pp.19-25, 2001.
[44] http://www.cs.waikato.ac.nz/ml/weka/
[45] www.mitre.org/resources/centers/it/maybury/summarization.html
[46] ProQuest: www.proquest.com
[47] Stop words: http://libraries.mit.edu/tutorials/general/stopwords.html
[48] ESPN www.espn.com
[49] 沈健誠，張俊盛, “多篇文件摘要系統,” 中華民國90年第十四屆計算機語言學會研討會論文集, pp.65-88. 2001
[50] 李祥賓，柯淑津, “新聞文件摘要之研究,” 中華民國90年第十四屆計算機語言學會研討會論文集, pp.23-42. 2001
[51] 吳宗璠，謝清佳, “資訊管理-理論與實務”, 智勝, 2000.
[52] 新力索尼股份有限公司全球資訊網: www.sony.com. |
| Description: | 碩士
國立政治大學
資訊科學學系
90753010
91 |
| Source URI: | http://thesis.lib.nccu.edu.tw/record/#G0090753010 |
| Data Type: | thesis |
| Appears in Collections: | [資訊科學系] 學位論文
|
Files in This Item:
| File |
Size | Format | |
|---|
| index.html | 0Kb | HTML2 | 270 | View/Open |
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
