English  |  正體中文  |  简体中文  |  Post-Print筆數 : 27 |  Items with full text/Total items : 109951/140892 (78%)
Visitors : 46202545      Online Users : 671
RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.
Scope Tips:
  • please add "double quotation mark" for query phrases to get precise results
  • please goto advance search for comprehansive author search
    •  Adv. Search
    Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer Goto mobile version
    政大機構典藏 > 商學院 > 統計學系 > 期刊論文 >  Item 140.119/139847


    Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/139847


    Title: 基於類別資訊的監督式t分布隨機鄰近嵌入法於維度縮減與視覺化之研究
    Supervised t-SNE for Dimension Reduction and Visualization Based on Class Information
    Authors: 吳漢銘
    Wu, Han-Ming
    張一凡
    Contributors: 統計系
    Keywords: 流形學習;監督式維度縮減
    t-SNE;Manifold learning;Supervised dimensionality reduction;t-SNE
    Date: 2021-06
    Issue Date: 2022-04-12
    Abstract: 維度縮減是資料特徵擷取的一種方法，可幫助使用者在低維度空間中，以視覺化方式探索此高維度資料所隱含的內在結構與資訊，並且有利於接續的分析處理與應用。近年來，非線性維度縮減法相關的研究及應用蓬勃發展，其中t分佈隨機鄰近嵌入法（t-SNE）是目前最熱門的非監督式維度縮減法之一，它主要的創新之處是以機率分佈來當成距離尺度。近期，將類別資訊加入距離計算的監督式t-SNE（稱為S-tSNE）方法被發展出來。然而，S-tSNE所採用的距離計算公式有兩個主要缺點。第一，當資料的類別個數僅有一個的時候，S-tSNE演算法並不會回復到原來的t-SNE。第二，此距離的定義並沒有滿足距離三個公理。為克服上述缺點，本研究提出了另一個基於類別資訊的監督式t-SNE方法，稱為連結監督式t分佈隨機鄰近嵌入法（L-tSNE）。所提出的方法運用了聚合階層式分群法中的群間距離計算連結法則，可發展出不需要額外調整超參數的距離計算方式，有效降低計算成本。我們以六組模擬資料來測試t-SNE、S-tSNE及L-tSNE等方法，並以排列檢定驗證維度縮減結果的可靠度。同時，我們也採用數個實際資料，實現L-tSNE非線性維度縮減與視覺化結果比較。最後我們將降維後之資料應用於分類問題上，用以評估各種維度縮減的效果。
    The dimensionality reduction (DR) technique can be regarded as a feature extraction tool for the data, it assists users to explore the data structure embedded within higher dimensional space in the lower-dimensional DR subspace. The DR results are helpful for the subsequent analysis and application. Recently, with the flourish development of the researches and applications of the nonlinear dimensionality reduction (NLDR) techniques, t-distributed stochastic neighbor embedding (t-SNE) is the most popular unsupervised NLDR method. The novelty of t-SNE is that it employs the probability density as the distance metric. Most recent, a supervised t-SNE (S-tSNE) has been proposed to incorporate the class information into the distance calculation process. However, S-tSNE has two major drawbacks. Firstly, if the number of the classes is one, S-tSNE cannot be reduced to t-SNE. Secondly, the distance metric proposed by S-tSNE did not satisfy the three distance axioms. To overcome these drawbacks, we proposed an alternative method, called L-tSNE, to incorporate the class information into the distance calculation process according to the linkage criterion of the agglomerative hierarchical clustering. The proposed method reduces the computational cost without the needs of the extra hyperparameters tuning. We use the simulation data to evaluate the proposed method and compare it with t-SNE and S-tSNE. We also use the permutation test to validate the significance of the DR results. Also, we apply the proposed method to real datasets for visualization and classification problems. The results shows that L-tSNE is comparable to S-tSNE and is superior than t-SNE.
    Relation: 中國統計學報, Vol.59, No2, pp.53-97
    Data Type: article
    Appears in Collections:[統計學系] 期刊論文

    Files in This Item:

    File Description SizeFormat
    37.pdf1949KbAdobe PDF2119View/Open


    All items in 政大典藏 are protected by copyright, with all rights reserved.


    社群 sharing

    著作權政策宣告 Copyright Announcement
    1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
    The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

    2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
    NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.
    DSpace Software Copyright © 2002-2004  MIT &  Hewlett-Packard  /   Enhanced by   NTU Library IR team Copyright ©   - Feedback