 |
English
|
正體中文
|
简体中文
|
Post-Print筆數 : 27 |
Items with full text/Total items : 118405/149442 (79%)
Visitors : 78375537
Online Users : 182
|
|
|
Loading...
|
Please use this identifier to cite or link to this item:
https://nccur.lib.nccu.edu.tw/handle/140.119/159630
|
| Title: | 應用機器學習於小樣本研究：巢套交叉驗證之倡議
Applying Machine Learning to Small Sample Research: A Proposal for Nested Cross-Validation |
| Authors: | 黃柏僩
Huang, Po-Hsien |
| Contributors: | 心理系 |
| Keywords: | 小樣本;交叉驗證;機器學習
Cross-validation;Machine learning;Small sample |
| Date: | 2025-03 |
| Issue Date: | 2025-09-24 09:38:56 (UTC+8) |
| Abstract: | 近年來，機器學習（machine learning, ML）不只在電腦視覺、自然語言處理等科學領域取得前所未有的成就，生成式人工智慧的商品化也讓ML進入了大眾生活。儘管心理學研究主要仰賴線性統計模型，但仍有部分指標性的研究開始將ML運用於行為資料分析。然而，心理學研究常伴隨的小樣本問題對ML之應用造成了挑戰。本文透過偏誤變異權衡（bias-variance tradeoff）來說明小樣本對預測誤差之影響，以及ML慣用之交叉驗證與測試（cross-validation and testing, CVT）會如何導致所謂「預測誤差樂透（prediction error lottery）」之現象。為了減緩前述的問題，本研究提出一巢套交叉驗證（nested cross-validation, NCV）策略，預期NCV能得到更穩定的預測誤差估計，並有效避免預測誤差樂透之發生。本研究透過模擬實驗來檢驗前述假設，並了解CVT、NCV、以及其衍生策略的實徵表現。模擬的結果支持了我們的假設，並根據這些結果，我們為打算應用ML之研究者提供了使用策略之建議。
In recent years, machine learning (ML) has not only achieved unprecedented success in scientific domains such as computer vision and natural language processing but also, through the commercialization of generative AI, has infiltrated the everyday lives of the lay public. Psychological research, traditionally dependent on linear statistical models, is now incorporating ML to analyze behavioral data. This shift, however, is hampered by the typically small sample sizes in psychological studies, which challenge the robust application of ML techniques. This paper elucidates the effects of small sample sizes on prediction error estimates through an analysis of the bias-variance tradeoff and illustrates how the prevalent cross-validation and testing (CVT) strategy may inadvertently instigate a "prediction error lottery." To counteract these issues, we introduce a nested cross-validation (NCV) strategy, which is posited to yield more stable prediction error estimates and to circumvent the prediction error lottery phenomenon effectively. We performed simulations to assess the empirical performance of CVT, NCV, and their variants, thereby validating our hypotheses. The outcomes of these simulations corroborate our conjectures and lead us to offer strategic recommendations for researchers poised to leverage ML in their work. |
| Relation: | 中華心理學刊, Vol.67, No.1, pp.1-22 |
| Data Type: | article |
| DOI 連結: | https://doi.org/10.6129/CJP.202503_67(1).0001 |
| DOI: | 10.6129/CJP.202503_67(1).0001 |
| Appears in Collections: | [心理學系] 期刊論文
|
Files in This Item:
| File |
Description |
Size | Format | |
|---|
| index.html | | 0Kb | HTML | 7 | View/Open |
|
All items in 政大典藏 are protected by copyright, with all rights reserved.
|
著作權政策宣告 Copyright Announcement1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.
2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(
nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(
nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.
