政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/159629

English | 正體中文 | 简体中文 | Post-Print筆數 : 27 | Items with full text/Total items : 118405/149442 (79%)
Visitors : 78375524 Online Users : 169

RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.

Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer

政大機構典藏 > 理學院 > 心理學系 > 期刊論文 > Item 140.119/159629

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/159629

Title:	Residual permutation tests for feature importance in machine learning
Authors:	黃柏僩 Huang, Po-Hsien
Contributors:	心理系
Keywords:	feature importance;machine learning;permutation test
Date:	2025-08
Issue Date:	2025-09-24 09:38:54 (UTC+8)
Abstract:	Psychological research has traditionally relied on linear models to test scientific hypotheses. However, the emergence of machine learning (ML) algorithms has opened new opportunities for exploring variable relationships beyond linear constraints. To interpret the outcomes of these ‘black-box’ algorithms, various tools for assessing feature importance have been developed. However, most of these tools are descriptive and do not facilitate statistical inference. To address this gap, our study introduces two versions of residual permutation tests (RPTs), designed to assess the significance of a target feature in predicting the label. The first variant, RPT on Y (RPT-Y), permutes the residuals of the label conditioned on features other than the target. The second variant, RPT on X (RPT-X), permutes the residuals of the target feature conditioned on the other features. Through a comprehensive simulation study, we show that RPT-X maintains empirical Type I error rates under the nominal level across a wide range of ML algorithms and demonstrates appropriate statistical power in both regression and classification contexts. These findings suggest the utility of RPT-X for hypothesis testing in ML applications.
Relation:	British Journal of Mathematical and Statistical Psychology,
Data Type:	article
DOI 連結:	https://doi.org/10.1111/bmsp.70009
DOI:	10.1111/bmsp.70009
Appears in Collections:	[心理學系] 期刊論文

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	11	View/Open

社群 sharing

著作權政策宣告 Copyright Announcement

1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.

Loading...