Cross-Entropy Losses

Ask about this topic

Momentum

18 papers in the last four weeks, up 260% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 102

All topics
CardsList

  1. Cut Binary Cross Entropy: Efficient Large-Vocabulary Loss and Gradient Kernels for Sequential Recommendation

    Oct 4, 2026Yaoyiran Li, Haowen Ning, Mohamed HammadCross-Entropy Losses

    Google Cloud London, United Kingdom · Google Cloud Mountain View, USA

  2. Stochastic Rounding in Low-Precision Transformer Inference: A Variable-Precision Emulation Study of a Small GPT-2

    Oct 1, 2026Yohan Chatelain, Pablo de Oliveira CastroFull-Precision PerformanceLanguage Model Perplexity

    Krembil Centre for Neuroinformatics, CAMH, Toronto, Canada · Universite Paris-Saclay, UVSQ, LI-PaRAD, Versailles, France

  3. No Model Required: Text Entropy Rate Filtering Mitigates Iterative Fine-Tuning Collapse

    Oct 1, 2026Lewis MitchellCollapseToken-Level Entropy

    Adelaide Data Science Centre School of Mathematical Sciences Adelaide University Adelaide SA 5005, Australia

  4. Cross-entropy optimization with prioritized constraints

    Oct 1, 2026Francisco Roldan Sanchez, Pau de las Heras Molins, David Fridovich-Keil +1Constrained OptimizationPrioritization

    LTCI, Télécom Paris, Institut Polytechnique de Paris · The University of Texas at Austin

  5. In CEM, a World Model Is Also a Proposal Mechanism

    Oct 1, 2026Oliver Obst, Frieder StolzenburgModel SelectionWorld Models

    UNSW Sydney · Harz University of Applied Sciences

  6. Collapse, Not Invariance: Diagnosing Auxiliary Objectives in Speech Anti-Spoofing

    Sep 30, 2026Ksenia Lysikova, Kirill Borodin, Maxim Maslov +1SpoofingCross-Entropy Losses

    Lab260, Yerevan, Armenia · BitmanagerAI, Dubai, UAE · MTUCI, Moscow, Russia

  7. Cross-Entropy Guided Routing in Mixture-of-Experts Large Language Models

    Sep 29, 2026Yury Nahshan, Nati Daniel, Jacob Goldberger +1Mixture-Of-Experts Large Language ModelsMixture-Of-Experts Architectures

    Bar-Ilan University, Ramat-Gan, Israel · NVIDIA, Israel

  8. Reference-Tail Trust:Certified Probability Floors for Learned Updates Inside a Deployed Network

    Sep 28, 2026Abdolvahab Khalili Sadaghiani, Jose Nunez-YanezLog-Ratio-Based Gaussian Trust WeightGraph Neural Networks

  9. BV Loss: Block Verification-Aware Loss for Block Diffusion Speculative Decoding

    Sep 28, 2026Suyoung Kim, Jahyun Koo, Hyeonjin Kim +5Block-Diffusion DrafterDiffusion Language Models

    a2sys (a2sys.ai) · Seoul National University (snu.ac.kr) · University of Wisconsin (wisc.edu)

  10. Information-Theoretic Analysis of Next-Token Prediction under Markovian Data

    Sep 28, 2026Masoud Kavian, Abdellatif Zaidi, Milad SefidgaranNext-Token PredictionInformation-Theoretic Limits

    Mathematical and Algorithmic Science Laboratory, Huawei Paris Research Center, 92100 Boulogne-Billancourt, France · Laboratoire d’Informatique Gaspard Monge, Université Gustave Eiffel, 77420 Champs-sur-Marne, France

  11. MaskCoFT: Masked Co-Adaptive Fine-Tuning for Memory-Efficient MoE Inference

    Sep 28, 2026Junfeng Wu, Zehao Fan, Hadjer Benmeziane +3Mixture-Of-ExpertsParameter-Efficient Fine-Tuning Methods

    Department of Industrial and Systems Engineering, Rensselaer Polytechnic Institute · Department of Electrical, Computer, and Systems Engineering, Rensselaer Polytechnic Institute · IBM Research

  12. Direct Optimization of Generators for Search in Automated Theorem Proving

    Sep 22, 2026Adam Ousherovitch, Ambuj TewariTheorem ProvingCross-Entropy Losses

    Department of Statistics University of Michigan

  13. Align, Integrate, and Fire: Efficient Token-Level Alignment for Zero-Shot SpeechLLMs

    Sep 16, 2026Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes +1Speech Language ModelsAcoustic Latent Space

    Department of Advanced Computing Sciences Maastricht University

  14. Learning Sign Language Recognition under Label Noise: A Study of Noise-Robust Losses for Isolated and Continuous Settings

    Sep 14, 2026Akihisa Shitara, Yoichi OchiaiSign Language TranslationLoss Function

    R&D Center for Digital Nature, University of Tsukuba · Faculty of Library, Information and Media Science, University of Tsukuba · Pixie Dust Technologies, Inc.

  15. Adaptive Margin Ordinal Loss: Penalizing Center-Class Hedging in Ordinal Classification

    Sep 12, 2026Manisha KandelLoss FunctionCross-Entropy Losses

    Data Science Institute & Department of Civil, Construction & Environmental Engineering University of Delaware Newark, DE, USA

  16. Rebalancing Token Importance in Language Models with TF-IDF Weighted Cross-Entropy Loss

    Sep 10, 2026Zhijian Li, Stefan Larson, Kevin LeachLarge Language Model MemoryTerm Frequency-Inverse Document Frequency

    University of Southern California, Los Angeles · Vanderbilt University, Nashville

  17. Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

    Sep 9, 2026Yaning Jia, Chunhui Zhang, Wenxuan Xu +3Supervised FinetuningMathematical Reasoning Benchmarks

    Dartmouth College · Carnegie Mellon University

  18. SGD in Multiclass Logistic Regression: Sequential Learning and Scaling Laws

    Sep 7, 2026Konstantinos Christopher Tsiolis, Denny Wu, Christos Thrampoulidis +1Logistic RegressionMulticlass Classification

    University of Toronto, Vector Institute · New York University, Flatiron Institute · University of British Columbia +1

  19. AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via αα-Corrected Binary Cross Entropy and Factorized Latent Supervision

    Sep 1, 2026Jianzhong You, Yuan Gao, Chris McIntoshChest X-RayMedical Vision-Language Models

    Peter Munk Cardiac Centre, University Health Network (UHN), Toronto, Canada · Ted Rogers Centre for Heart Research, Toronto, Canada · Vector Institute, Toronto, Canada +5

  20. Beyond Global Realism: Virtual Try-On Evaluation and Optimization with Dimension-wise Garment Fidelity Assessment

    Aug 30, 2026Kaidong Zhang, Yukang Ding, Xiaoyu Liu +1Virtual Try-OnGarments

    Taobao & Tmall Group of Alibaba · Harbin Institute of Technology

  21. The Objective Is the Bottleneck: Latent World Models Encode What Their Planners Cannot Use

    Aug 13, 2026Joyjeet SinghLatent World ModelsLong-Horizon Task Planning

    Independent researcher

  22. Distill Skills into Weights, Not Prompts: Abstract Skills as Privileged Signals for On-Policy Self-Distillation

    Aug 10, 2026Yubo Jiang, Fengying Xie, Zhiguo Jiang +1Unsupervised On-Policy Self-DistillationDataset Distillation

    School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China

  23. Second-Order Muon Done Right: A Principled Marriage of Spectral Geometry and Curvature

    Aug 10, 2026Tong CheMuonNewton

    NVIDIA Research

  24. No Unique Minimizer, No Problem: On the Consistency of Robust Neural Classifiers

    Aug 9, 2026Subhabrata Majumdar, Anand Deo, Partha Pratim Saha +1Empirical Risk MinimizationCross-Entropy Losses

    Indian Institute of Management Bangalore · Independent Researcher · Indian Statistical Institute, Kolkata

  25. Adaptive Supervised Anchoring for On-Policy Self-Distillation

    Aug 8, 2026Meilin Yang, Zixuan Ding, Jianhao Nie +5Unsupervised On-Policy Self-DistillationProcess-Level Supervision

    Renmin University of China, Beijing, China · Renmin University of China, Beijing, China.

  26. Multivariate Time Series Forecasting needs Cross Variable Loss

    Aug 6, 2026Kuiye Ding, Yifan Hu, Hanchen Wang +1Multivariate Time Series ForecastingForecasting Backbone

    University of Technology Sydney · Tsinghua University · The Hong Kong University of Science and Technology (Guangzhou)

  27. MedJudgeRAG: Option-Wise Evidence Judgment with Dynamic Knowledge Graphs for Medical MCQA

    Jul 24, 2026Seongwon Seo, Seung Hwan Cho, Young-Min KimHievi-RagClinical Reasoning Training

    Department of Industrial Data Engineering, Hanyang University, Seoul, South Korea · School of Interdisciplinary Industrial Studies, Hanyang University, Seoul, South Korea

  28. Context-weighted Discrete Flow Matching

    Jul 23, 2026Daniil Cherniavskii, Daniel Severo, Karen UllrichGenerative Flow NetworksGenerative Models

    University of Amsterdam · Work done during an internship at Meta FAIR. · Meta FAIR

  29. Loss Landscape Topology Reveals Why Simple Baselines are Competitive at 3D Point Cloud Segmentation Under Class Imbalance

    Jul 23, 2026Antonis Savva, Christos Kyrkou, Theocharis TheocharidesPoint CloudsInteractive 3D Segmentation

    KIOS Research and Innovation Center of Excellence, University of Cyprus, 1 Panepistimiou Avenue, 2109 Aglantzia, Nicosia · Department of Electrical and Computer Engineering, University of Cyprus, 1 Panepistimiou Avenue, 2109 Aglantzia, Nicosia

  30. Subjective Risk Decomposition: A New View for Uncertainty Quantification

    Jul 16, 2026Raghad Alamri, Michele Caprio, Gavin BrownUncertainty QuantificationUncertainty

    Department of Computer Science, The University of Manchester · Department of Computer Science, University of Warwick

  31. Conservation Laws for Diffusion Models

    Jul 11, 2026Ziv Aharoni, Henry D. PfisterCross-Entropy LossesDiffusion Models

    Department of Electrical and Computer Engineering Duke University Durham, NC, USA

  32. Similarity search generalisation in contrastive learning with InfoNCE loss

    Jul 10, 2026Nick WhiteleyContrastive LearningText Embeddings

    School of Mathematics, University of Bristol, U.K.

  33. Ensemble Diversity Optimization for Subjective Supervision

    Jul 9, 2026Xia Cui, Ziyi Huang, N. R. AbeynayakeEnsembleCross-Entropy Losses

    School of Computing and Mathematics, Manchester Metropolitan University, Manchester, UK. · School of Computer Science, Hubei University, Wuhan, China.

  34. PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

    Jul 9, 2026Wanyi Ning, Wei Zhou, Yingpeng Li +3Target Speaker ExtractionSpeaker Similarity

    Yijiahe AI, Nanjing, China · Tianjin University, Tianjin, China · Nanjing University, Nanjing, China

  35. Asymmetric Focal Loss Improves Graph Neural Network Prediction of Drug-Drug Interactions

    Jul 8, 2026Faranak Hatami, Mousa MoradiAbsorption, Distribution, Metabolism, And ExcretionDrug-Drug Interactions

    Department of Chemistry, University of Illinois Chicago, Chicago, IL 60607, USA · Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA

  36. Enhanced Seam Segmentation for Automated Welding Robot in Construction Through Transfer Learning: Addressing Limitations of Bilateral Segmentation Network

    Jul 7, 2026Keonvin Park, Yong Ann Voeurn, Hyeokjun Kweon +1Transfer LearningConstruction

    Interdisciplinary Program in Artificial Intelligence, Seoul National University, Seoul, 08826, Republic of Korea · Department of Civil Engineering and Construction, Georgia Southern University, Statesboro, GA 30460, USA · The Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University, Seoul, 06974, Republic of Korea

  37. Comparison of Loss Functions for Robust Deep Learning-based Echocardiography Segmentation when Learning with Partially Labelled Data from Multiple Domains

    Jul 6, 2026Iman Islam, Esther Puyol-Antón, Bram Ruijsink +2EchocardiographyLoss Function

    School of Biomedical Engineering & Imaging Sciences, King’s College London, UK

  38. Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

    Jul 2, 2026Tianjian Yang, Meng LiDrafterSpeculative Decoding

    School of Electronics Engineering and Computer Science, Peking University, Beijing, China · Institute for Artificial Intelligence, Peking University, Beijing, China · School of Integrated Circuits, Peking University, Beijing, China

  39. Radial Suppression Accelerates Algorithmic Generalization: A Geometric Analysis of Delayed Generalization

    Jun 30, 2026Srijan Tiwari, Aditya Chauhan, Manjot SinghCross-Entropy Losses

    Indian Institute of Technology Roorkee

  40. LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization

    Jun 30, 2026Md Raqib Khan, Santosh Kumar Vipparthi, Subrahmanyam MuralaStereo MatchingZero-Shot

    CVPR Lab, Trinity College Dublin, The University of Dublin, Dublin, Ireland · CVPR Lab, Indian Institute of Technology Ropar, Rupnagar, Punjab, India

  41. Deep Neural Networks with Ordinal Loss for Medical Applications

    Jun 24, 2026Tal Dvora, Rotem Haba, Gonen SingerCross-Entropy LossesMedical Image Classification

    Bar-Ilan University Ramat Gan, Israel

  42. Protein contacts are already in the attention: a single-forward-pass alternative to the Categorical Jacobian

    Jun 20, 2026Rome ThorstensonProteinJacobian

    Independent Researcher

  43. Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Locality

    Jun 17, 2026Hong-Jun Choi, Jongho Lee, Jaeyoung KimGeometry-AwareCross-Entropy Losses

    Teamreboott Inc., South Korea

  44. What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy

    Jun 16, 2026Truong Xuan KhanhGrokkingWeight Decay

    H&K Research Studio, Clevix LLC · Hanoi, Vietnam

  45. Dense Supervision Is Not Enough: The Readout Blind Spot in Looped Language Models

    Jun 12, 2026Rituraj Sharma, Tu VuHidden StatesCross-Entropy Losses

    Virginia Tech

  46. DIFF-ERO: A Conformance-Aware Loss for Deep Learning in Process Mining

    Jun 12, 2026Johannes De Smedt, Jari Peeperkorn, Artem Polyvyanyy +1Cross-Entropy LossesDeep Learning

    KU Leuven, Leuven, Belgium · The University of Melbourne, Parkville, VIC 3010, Australia

  47. A Stationary (and Therefore Compatible) Representation is All You Need

    Jun 10, 2026Niccolò Biondi, Federico Pernici, Simone Ricci +1Representation LearningRepresentation Space

    Media Integration and Communication Center (MICC), Dipartimento di Ingegneria dell’Informazione, Università degli Studi di Firenze, 50139, Firenze, Italy

  48. Audio-Visual Exchange-Aware Token Pruning for Efficient Audio-Visual Captioning

    Jun 9, 2026Zihan Meng, Dexiang Hong, Weidong Chen +3Visual Token PruningAudio-Visual Reasoning

    University of Science and Technology of China

  49. Constrained Paraphrase Consistency for LLM Hallucination Detection

    Jun 6, 2026Shanshan Lin, Dongsheng Hong, Sibo Ju +3Large Language Model HallucinationCitation Hallucination Detection

    1Fuzhou University · 2Harbin Institute of Technology (Shenzhen) · 3Beijing University of Posts and Telecommunications

  50. Test-Time Trajectory Optimization for Autonomous Driving

    Jun 5, 2026Yihong Xu, Eloi Zablocki, Yuan Yin +4Autonomous DrivingRobust Trajectory

    valeo.ai, Paris, France · Sorbonne Universit´e, CNRS, ISIR, F-75005 Paris, France

  51. Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction

    Jun 4, 2026Hu Tan, Kuo Gai, Shihua ZhangDeep NetworkRectified Linear Unit

    1State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China · School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing 100049, China · 3Shanghai Institute for Mathematics and Interdisciplinary Sciences (SIMIS), Shanghai, China +1

  52. Reinforcement Learning from Rich Feedback with Distributional DAgger

    Jun 3, 2026Rishabh Agrawal, Jacob Fein-Ashley, Paria RashidinejadDistributional Reinforcement LearningReinforcement Learning With Verifiable Reward

    University of Southern California

  53. Tree-Based Formalization of Multi-Agent Complementarity in Human-AI Interactions

    Jun 3, 2026Andrea FerrarioHuman-Ai CollaborationComplementarity

    Institute of Biomedical Ethics and History of Medicine, University of Zurich, Zurich, Switzerland · SUPSI, Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland · ETH Zurich, Zurich, Switzerland

  54. QuBLAST: A Framework for Quantizing Large Language Models with Block-Level Compression Approach and Activation Scaling Strategy

    Jun 3, 2026Pasindu Wickramasinghe, Achyuta Muthuvelan, Rachmad Vidya Wicaksana Putra +2Large Language Model QuantizationCross-Entropy Losses

    eBRAIN Lab, Division of Engineering, New York University (NYU) Abu Dhabi, United Arab Emirates

  55. Edge of Stability Selectively Shapes Learning Across the Data Distribution

    Jun 2, 2026Shauna Kwag, Anakha Ganesh, Tomaso Poggio +1HessianDistributions

    MIT

  56. ROBUST-WT: Robust Uncertainty-aware Segmentation Transform via Whitening and Training Enhancements

    Jun 2, 2026Aqsa Naseer, Maryam Bibi, Syeda Samiya Urooj +1Semi-Supervised Medical Image SegmentationWhitening

    School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan

  57. RRISE: Robust Radius Inference via a Surrogate Estimator

    Jun 1, 2026Jong-Ik Park, Shreyas Chaudhari, Carlee Joe-Wong +1SmoothingMachine Learning Surrogates

    Carnegie Mellon University

  58. The Representation-Rationalizability Tradeoff in Reward Learning

    May 29, 2026Jing Dong, Yaoliang Yu, Pascal PourpartReinforcement Learning From Human FeedbackReward Functions

    Vector Institute · University of Waterloo & Vector Institute

  59. Convergence Theory for Iterative LLM-Based Neural Architecture Search: A Parametric Cross-Entropy Framework with Closed-Form Proxy Reliability

    May 28, 2026Santosh Premi Adhikari, Radu Timofte, Dmitry IgnatovNeural Architecture SearchIterative

    Computer Vision Lab, CAIDAS & IFI, University of Würzburg, Germany

  60. Parallel Adaptive Multi-Objective Evolutionary Learning of Discretized Bayesian Network Classifiers for Clinical Data

    May 27, 2026Damy M. F. Ha, Thalea Schlender, Yvette M. van der Linden +2Bayesian NetworksClassifier

    Leiden University Medical Center · Centrum Wiskunde & Informatica