ChatGPT Generated Conversation
Research on ChatGPT-generated conversations explores how this large language model (LLM) performs in various interactive contexts, focusing on its capabilities, limitations, and potential biases. Current studies investigate its application in diverse fields, including education (e.g., essay scoring, literature review assistance), healthcare (e.g., medication management, robot interaction), and software development (e.g., code generation, library recommendation), often comparing its performance to human experts or other AI models. This work is significant because it helps assess the reliability and ethical implications of LLMs in real-world applications, informing the development of responsible AI and highlighting potential risks and benefits across numerous sectors.
Papers
Medical Data Augmentation via ChatGPT: A Case Study on Medication Identification and Medication Event Classification
Shouvon Sarker, Lijun Qian, Xishuang Dong
Investigating the Effectiveness of ChatGPT in Mathematical Reasoning and Problem Solving: Evidence from the Vietnamese National High School Graduation Examination
Xuan-Quy Dao, Ngoc-Bich Le
ChatGPT is fun, but it is not funny! Humor is still challenging Large Language Models
Sophie Jentzsch, Kristian Kersting
Long-form analogies generated by chatGPT lack human-like psycholinguistic properties
S. M. Seals, Valerie L. Shalin
Evaluation of ChatGPT on Biomedical Tasks: A Zero-Shot Comparison with Fine-Tuned Generative Transformers
Israt Jahan, Md Tahmid Rahman Laskar, Chun Peng, Jimmy Huang
On the Detectability of ChatGPT Content: Benchmarking, Methodology, and Evaluation through the Lens of Academic Writing
Zeyan Liu, Zijun Yao, Fengjun Li, Bo Luo
ChatGPT as a mapping assistant: A novel method to enrich maps with generative AI and content derived from street-level photographs
Levente Juhász, Peter Mooney, Hartwig H. Hochmair, Boyuan Guan
Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction
Rose E. Wang, Dorottya Demszky
Evaluation of AI Chatbots for Patient-Specific EHR Questions
Alaleh Hamidi, Kirk Roberts
Log Parsing: How Far Can ChatGPT Go?
Van-Hoang Le, Hongyu Zhang
ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity?
Michael Heck, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Shutong Feng, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk, Milica Gašić
ChatGPT is a Remarkable Tool -- For Experts
Amos Azaria, Rina Azoulay, Shulamit Reches