stat.MLMar 2, 2024

High-Dimensional Tail Index Regression

Authors: Yuya Sasaki, Jing Tao, Yulong Wang

Organizations: Department of Economics, Vanderbilt University, VU Station B #351819, 2301 Vanderbilt Place, Nashville, TN 37235-1819 · Department of Economics, University of Washington, Box 353330, Savery 305, University of Washington, Seattle, WA 98195-3330 · Department of Economics, Lehigh University, Bethlehem, PA 18015

Abstract

Motivated by the empirical observation of power-law distributions in the credits (e.g., ``likes'') of viral posts on social media, we introduce a high-dimensional tail index regression model and propose methods for estimation and inference of its parameters. First, we propose a regularized estimator, establish its consistency, and derive its convergence rate. Second, we construct a debiased version of the regularized estimator to facilitate inference and prove its asymptotic normality. Monte Carlo simulation studies corroborate our theoretical findings. We apply these methods (1) to the text analysis of viral posts on X (formerly Twitter) and (2) to the analysis of abnormally high health expenditures.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Partially Observed Sparse Graphs: The Unknown Sampling Rate is a Tail Index

    Aug 14, 2026Jian Xu, Delu Zeng, John Paisley +1

  2. Breaking the Curse with BAND: Nonparametric Distribution Estimation in High Dimensions

    Jul 29, 2026Shuo-Chieh Huang, Chien-Ming Chi, Jau-er ChenBayesian NetworksDensity Estimation

  3. The Manifold-Index Model: provably and efficiently avoiding the statistical and computational curse of dimensionality

    Nov 15, 2026Yantao Wu, Mauro MaggioniNonparametric RegressionCurse of Dimensionality