Text Generation
Text generation research focuses on creating models that produce high-quality, coherent, and controllable text. Current efforts concentrate on improving evaluation methods (e.g., using LLMs as judges and incorporating adaptive references), enhancing controllability through techniques like divide-and-conquer strategies and prompt engineering, and addressing challenges such as hallucinations and memorization through various decoding strategies and knowledge integration. These advancements have significant implications for diverse applications, including clinical documentation, scientific writing, and creative content generation, while also raising important ethical considerations regarding bias, safety, and responsible use.
Papers
Attribute First, then Generate: Locally-attributable Grounded Text Generation
Aviv Slobodkin, Eran Hirsch, Arie Cattan, Tal Schuster, Ido Dagan
Grammatical vs Spelling Error Correction: An Investigation into the Responsiveness of Transformer-based Language Models using BART and MarianMT
Rohit Raju, Peeta Basa Pati, SA Gandheesh, Gayatri Sanjana Sannala, Suriya KS
Loops On Retrieval Augmented Generation (LoRAG)
Ayush Thakur, Rashmi Vashisth
Embedded Named Entity Recognition using Probing Classifiers
Nicholas Popovič, Michael Färber
Reinforcement Learning with Token-level Feedback for Controllable Text Generation
Wendi Li, Wei Wei, Kaihe Xu, Wenfeng Xie, Dangyang Chen, Yu Cheng
DEE: Dual-stage Explainable Evaluation Method for Text Generation
Shenyu Zhang, Yu Li, Rui Wu, Xiutian Huang, Yongrui Chen, Wenhao Xu, Guilin Qi
3M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation
Huaisheng Zhu, Teng Xiao, Vasant G Honavar
LSTM-Based Text Generation: A Study on Historical Datasets
Mustafa Abbas Hussein Hussein, Serkan Savaş
Evolving Knowledge Distillation with Large Language Models and Active Learning
Chengyuan Liu, Yangyang Kang, Fubang Zhao, Kun Kuang, Zhuoren Jiang, Changlong Sun, Fei Wu
A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterization
Tharindu Kumarage, Garima Agrawal, Paras Sheth, Raha Moraffah, Aman Chadha, Joshua Garland, Huan Liu
Towards Full Authorship with AI: Supporting Revision with AI-Generated Views
Jiho Kim, Ray C. Flanagan, Noelle E. Haviland, ZeAi Sun, Souad N. Yakubu, Edom A. Maru, Kenneth C. Arnold