Open-Weight Language Models

Overview

Open-weight language models make trained model weights available so people can run them locally, adapt them to new tasks or languages, and examine how they behave. Researchers build them with dense or mixture-of-experts architectures, then improve them through instruction tuning, preference training, retrieval, and quantization for efficient deployment. Evaluations cover reasoning, coding, multilingual and domain tasks, as well as bias, safety, reliability, and energy use; capable open models can compete with proprietary systems in some settings, but performance varies across languages, tasks, and hardware. Wider access supports local control and reproducibility, while also making misuse easier and leaving open how to provide robust safeguards, trustworthy evaluations, and model-lineage accountability.

Latest papers

CardsList

65 papers6 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)

    Nov 17, 2026Allen G. Roush, Minh Nhat Nguyen, Ravid Shwartz-Ziv +2Language Model DecodingText Generation

  2. Watermark Evidence under Open-Weight LLM Modification: Exact Bounds for Low-Rank Output Watermarks

    Nov 16, 2026Prashant Shekhar, Dumindu Samaraweera, Caroline HowardLLM WatermarkingOpen-Weight Language Models

  3. The Logic Chain Breaking Point: A Controlled-Variable Benchmark for Reasoning Degradation in Open-Weight Language Models

    Nov 16, 2026Akif Islam, Mohd. Ruhul Ameen, Md. Ekramul HamidLanguage Model Reasoning EvaluationLogical Reasoning

  4. The novelty exposed: ablation, reproducibility and transparency in 40 technical reports of open-weight large language models (LLMs)

    Nov 15, 2026Bahaeddin TürkoğluOpen-Weight Language ModelsML Reproducibility

  5. Small Open-Weight Language Models for Crowd Decision-Making: Capabilities and Limits of Output-Level Fusion and Linguistic Aggregation

    Nov 12, 2026David Herrera-Poyatos, Cristina Zuheros, Carlos Peláez-González +3LLM Decision-MakingOpen-Weight Language Models

  6. On the Effectiveness and Limitations of Open-Weight LLMs for Low-Resource Offensive Language Detection in Danish

    Nov 6, 2026Elnur Adl Zarabi, Amit Kumar, Adi Singh +3Hate Speech DetectionOpen-Weight Language Models

  7. Analysis of Local Open-Weight LLM Agents on Vulnerability-Reproduction Tasks

    Nov 4, 2026Jorge García-Carrasco, Javier Sanchis, Álvaro Navarro +2LLMs for CybersecurityOpen-Weight Language Models

  8. Padding to k: A Minimum Count in the Schema Makes Open-Weight Models Pad Their Extraction Lists

    Oct 22, 2026Abhishek Barali, Aayush PaudelLLM Information ExtractionText Generation

  9. Wolof-Adapted Industry-Ready Open-Weight Language Models

    Oct 14, 2026Gwénolé Lecorvé, Delphine Charlet, Pierre Adam +15Language ModelingOpen-Weight Language Models

  10. Unconstrained CTI-REALM with Open-Weights

    Oct 9, 2026Sahil Garg, Ruhi Gottumukkala, Vishal Agarwal +1AI Agent EvaluationAI Agent Security Benchmarks

  11. Autonomous Structuring of Radiology Reports Across Modalities at Archive Scale Using an Open-Weight Large Language Model

    Oct 3, 2026Friedrich Puttkammer, Fabian Drexel, Marlene Fritzsche +19Medical Report GenerationRadiology Report Generation

  12. The Fragility of Trigger-Tag Mechanisms for Misuse Detection in Open-Weight LLMs

    Oct 2, 2026Toluwani Aremu, Manit Baser, Mohan Gurusamy +2Adversarial Attacks on LLMsOpen-Weight Language Models

  13. Cheap, open agents make LLM pollution harder to mitigate

    Sep 25, 2026Raluca Rilla, Anne-Marie Nussberger, Rui Mata +1AI-Generated Text DetectionLLM Agent Evaluation

  14. Witness Overlap: Directional Provenance Inside Open-Weight Model Families

    Sep 24, 2026Siyuan Li, Haoxuan Zeng, Xin Luo +6LLM AuditingOpen-Weight Language Models

  15. Evaluating Open-Weight LLMs for Turkish Domain Documents Under Retrieval and Hardware Constraints

    Sep 23, 2026Imtiaz Ul Hassan, Öykü Akbulut, Onur Kaya +4Multilingual Language Model EvaluationLLM Evaluation

  16. Misaligned Clinical Risk Classification and Cost Asymmetry in Open-Weight Large Language Models

    Sep 21, 2026Star S. D. Liu, Xiyu Ding, Robert B. Barrett +3Cost-Sensitive LearningLLM Interpretability

  17. WiC is Not WSD: A Study on LLMs and Lexical Ambiguity Resolution

    Sep 17, 2026Yi Zhou, Kiamehr Rezaee, Danushka Bollegala +2Open-Weight Language ModelsWord Sense Disambiguation

  18. Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment

    Sep 16, 2026Kosuke Kitahara, Nobuhiro YamaguchiGender Bias in Language ModelsAI-Assisted Decision Making

  19. AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research

    Sep 15, 2026Bernie Boscoe, Srinath Saikrishnan, Vikram Seenivasan +6AI-Assisted Scientific ResearchOpen-Weight Language Models

  20. List Counting Failures Are Not One Phenomenon

    Sep 3, 2026Iyad Ait Hou, Saad Mankarious, Aya Zirikly +1Numerical Reasoning in Language ModelsOpen-Weight Language Models

  21. Manacá-1B: An Open, Reproducible Brazilian-Portuguese Language Model and a Tokenizer-Aware, Paired Evaluation

    Aug 31, 2026Bruno Leonardo Santos Menezes, Carlos Leonardo Souza Cardoso, Fabio Andre Machado PortoLanguage Model PretrainingPortuguese Language Models

  22. LLMs as Acquisition Policies for Finite-Pool Materials Optimization: A Controlled Study

    Aug 20, 2026Dino-Rober Demir, Florian Le Bronnec, Rio YokotaLarge Language Model-Guided OptimizationActive Learning

  23. Can Open-Weight Models Compete on Financial Text Comprehension?

    Aug 9, 2026Jan SpörerLLM EvaluationFinancial QA