Research Reproducibility
Research reproducibility focuses on ensuring that scientific findings can be reliably replicated by independent researchers, a crucial aspect for validating results and advancing knowledge. Current efforts concentrate on addressing reproducibility challenges across various domains, including machine learning (with a focus on algorithms like random forests and deep neural networks), natural language processing, and high-performance computing, often involving the development of standardized evaluation frameworks and tools to improve transparency and documentation. Improving reproducibility is vital for enhancing the reliability and trustworthiness of scientific research, ultimately leading to more robust and impactful results across diverse fields and applications.
Papers
The Rise of Open Science: Tracking the Evolution and Perceived Value of Data and Methods Link-Sharing Practices
Hancheng Cao, Jesse Dodge, Kyle Lo, Daniel A. McFarland, Lucy Lu Wang
GPT-4 as an interface between researchers and computational software: improving usability and reproducibility
Juan C. Verduzco, Ethan Holbrook, Alejandro Strachan
A Remote Sim2real Aerial Competition: Fostering Reproducibility and Solutions' Diversity in Robotics Challenges
Spencer Teetaert, Wenda Zhao, Niu Xinyuan, Hashir Zahir, Huiyu Leong, Michel Hidalgo, Gerardo Puga, Tomas Lorente, Nahuel Espinosa, John Alejandro Duarte Carrasco, Kaizheng Zhang, Jian Di, Tao Jin, Xiaohan Li, Yijia Zhou, Xiuhua Liang, Chenxu Zhang, Antonio Loquercio, Siqi Zhou, Lukas Brunke, Melissa Greeff, Wolfgang Hoenig, Jacopo Panerati, Angela P. Schoellig
In-class Data Analysis Replications: Teaching Students while Testing Science
Kristina Gligoric, Tiziano Piccardi, Jake Hofman, Robert West