Text Generation
Text generation research focuses on creating models that produce high-quality, coherent, and controllable text. Current efforts concentrate on improving evaluation methods (e.g., using LLMs as judges and incorporating adaptive references), enhancing controllability through techniques like divide-and-conquer strategies and prompt engineering, and addressing challenges such as hallucinations and memorization through various decoding strategies and knowledge integration. These advancements have significant implications for diverse applications, including clinical documentation, scientific writing, and creative content generation, while also raising important ethical considerations regarding bias, safety, and responsible use.
Papers
Transfer Learning for Text Diffusion Models
Kehang Han, Kathleen Kenealy, Aditya Barua, Noah Fiedel, Noah Constant
Detecting LLM-Assisted Writing in Scientific Communication: Are We There Yet?
Teddy Lazebnik, Ariel Rosenfeld
Towards Generating Informative Textual Description for Neurons in Language Models
Shrayani Mondal, Rishabh Garodia, Arbaaz Qureshi, Taesung Lee, Youngja Park