Research Reproducibility
Research reproducibility focuses on ensuring that scientific findings can be reliably replicated by independent researchers, a crucial aspect for validating results and advancing knowledge. Current efforts concentrate on addressing reproducibility challenges across various domains, including machine learning (with a focus on algorithms like random forests and deep neural networks), natural language processing, and high-performance computing, often involving the development of standardized evaluation frameworks and tools to improve transparency and documentation. Improving reproducibility is vital for enhancing the reliability and trustworthiness of scientific research, ultimately leading to more robust and impactful results across diverse fields and applications.
Papers
Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from the Decision Boundary Perspective
Gowthami Somepalli, Liam Fowl, Arpit Bansal, Ping Yeh-Chiang, Yehuda Dar, Richard Baraniuk, Micah Goldblum, Tom Goldstein
RB2: Robotic Manipulation Benchmarking with a Twist
Sudeep Dasari, Jianren Wang, Joyce Hong, Shikhar Bahl, Yixin Lin, Austin Wang, Abitha Thankaraj, Karanbir Chahal, Berk Calli, Saurabh Gupta, David Held, Lerrel Pinto, Deepak Pathak, Vikash Kumar, Abhinav Gupta