Hierarchical Representation Learning

Overview

Hierarchical representation learning studies how models can encode data at multiple levels, from local details such as pixels, atoms, or signal segments to broader objects, concepts, and tasks. Common approaches use multiscale pooling and attention, self-supervised prediction or contrastive learning across levels, and explicit taxonomies or graphs; hyperbolic geometry is often used to represent tree-like relationships. These methods are applied to images, language, graphs, molecules, medical data, and long time series, often to improve transfer, fine-grained prediction, retrieval, or interpretability. A central tension is whether useful hierarchies should be imposed from labels and domain knowledge or discovered from data, and how to preserve fine detail without making representations costly or overly constrained.

Latest papers

CardsList

240 papers19 papers in the last four weeks, down 14% on the four weeks before. 0.1% of all new papers.

  1. Provable Cross-Modal Transfer of Hierarchical Concept Structure in CLIP Embeddings

    Nov 13, 2026Nghia Nguyen, Tianjiao Ding, Lachlan Ewen MacDonald +1Vision-Language ModelsMultimodal Embedding

  2. Helgason-Fourier Random Features for Scalable Hyperbolic Latent Variables

    Nov 12, 2026Koshi Watanabe, Daichi Mochihashi, Hideitsu Hino +2Hyperbolic Representation LearningFourier Feature Embeddings

  3. One Hierarchy, Many Sports: Hierarchy-Aligned Multi-Task Learning for Next-Shot Prediction

    Nov 11, 2026Chao-Wei Cai, Min-Te Sun, Sheng Kuang Wu +1Multi-Task LearningHierarchical Representation Learning

  4. TrajLift: Lifting Memory Recall Trajectories with Latency-Modulated Heat Diffusion

    Nov 9, 2026Jiawen Kang, Jinchao Li, Mingyu Cui +3Temporal Representation LearningHierarchical Representation Learning

  5. OcTreeMamba: Topology-Aware Mamba for 3D Medical Segmentation via Octree Sparsification

    Nov 5, 2026Kaixiang Mai, Jiaqi Yu, Yuzhu Ji +43D Medical Image SegmentationMamba

  6. Balancing hierarchical representation and quantization: A performance trade-off in text embeddings

    Nov 4, 2026Kai Ponel, Marco Polignano, Erasmo Purificato +4Embedding CompressionText Embedding Evaluation

  7. Interpretable Text Embeddings Based on Hierarchical Questions

    Nov 4, 2026Kohei Oda, Po-Min Chuang, Kiyoaki Shirai +1Text EmbeddingsText Embedding Models

  8. TaxoMFM: A Taxonomy-Aware Foundation Model for the Human Gut Microbiome

    Oct 29, 2026Haochen Xue, Anastasia Godneva, Yulong Li +6BioinformaticsHierarchical Representation Learning

  9. SSQA: Sibling-Selective Quadtree Attention for Hierarchical Modeling in Perception Tasks

    Oct 28, 2026Yufan Chen, Arnav Bali, Angela Liu +2Efficient ViTsHierarchical Representation Learning

  10. Euclidean Crowding-Driven Adaptive Euclidean-Hyperbolic Graph Learning

    Oct 27, 2026Hao Chen, Jian Sun, Chuan Shi +1Riemannian Representation LearningGraph Representation Learning

  11. Hierarchical Multimodal Interaction Reasoning for Dyadic Relationship Recognition

    Oct 26, 2026Wang Tang, Fethiye Irmak Dogan, Linbo Qing +2Relational ReasoningMultimodal Reasoning

  12. TaxoSAE: Rethinking Sparse Autoencoders through Taxonomic Logic

    Oct 22, 2026Xinyu Guo, Minglai Yang, Clayton T. Morrison +2Sparse AutoencodersHierarchical Representation Learning

  13. NEST: Nested Embedding Representation for Multiscale Clustering

    Oct 21, 2026Zhanqi Zhang, Mikio Aoi, Gal MishneClusteringUnsupervised Clustering

  14. Uncovering Semantic Hierarchies in Text-Attributed Graphs via Variational EM-based LLM-GNN Synergy

    Oct 17, 2026Yunhui Liu, Xudong Jin, Qizhuo Xie +5Text-Attributed Graph LearningHierarchical Representation Learning

  15. SMI: Ontology-Grounded Semantic IDs for Hierarchy-Aware Medical Concept Representation

    Oct 13, 2026Ziyang Song, Lia Shen, Yixuan Li +6Representation LearningHierarchical Representation Learning

  16. GeoMER: A Joint Euclidean-Hyperbolic Geometry Framework for Multimodal Emotion Recognition

    Oct 13, 2026Ting Zhu, Huizhi Liang, Boguslaw Obara +2Multimodal Emotion RecognitionMultimodal Fusion

  17. HASTE: Hierarchical and Attribute-aware Supervision for Generative Recommendation

    Oct 12, 2026Tripti Shukla, Shwetha Somasundaram, Akshat Gupta +3Long-Tail RecommendationRecommender Systems

  18. Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another

    Oct 5, 2026Federico Larroca, Paola Bermolen, Marcelo Fiori +1Riemannian OptimizationHierarchical Representation Learning

  19. HiER-BLS: A Hierarchy-Guided and Error-Correcting Robust Incremental Broad Learning System

    Oct 5, 2026Gongli Zhang, C. L. Philip Chen, Zhulin LiuHierarchical Representation LearningNeural Network Robustness

  20. HIGS: Hierarchical Implicit Grids for Joint Geometric and Semantic Scene Understanding

    Sep 29, 2026Hanwen Cao, Wenqiang Wu, Kuang-Ting Tu +5Implicit Neural RepresentationsHierarchical Representation Learning

  21. Progressive Memory Transformer: Memory-Aware Attention for Time-Series

    Sep 25, 2026Tord Sture Stangeland, Andreas Köhler, Steffen Mæland +1Self-Supervised Time Series Representation LearningTemporal Representation Learning

  22. Learning Hierarchical Causal Representations of the Effects of Forcings on Temperature in Climate Models

    Sep 25, 2026Shan Zhao, Ilija Trajkovic, Julia Kaltenborn +4Surrogate ModelingCausal Representation Learning