New Framework
Recent research focuses on developing versatile frameworks for various tasks, primarily aiming to improve efficiency, reproducibility, and accessibility within their respective domains. These frameworks leverage diverse techniques, including programmatic data generation for LLMs, deep learning architectures for image and audio processing, and reinforcement learning for optimization and automated testing. The resulting advancements enhance the development and evaluation of AI models, improve the reliability of benchmarking processes, and offer new tools for diverse applications ranging from healthcare diagnostics to autonomous vehicle navigation.
Papers
CHASE: A Causal Heterogeneous Graph based Framework for Root Cause Analysis in Multimodal Microservice Systems
Ziming Zhao, Tiehua Zhang, Zhishu Shen, Hai Dong, Xingjun Ma, Xianhui Liu, Yun Yang
Function+Data Flow: A Framework to Specify Machine Learning Pipelines for Digital Twinning
Eduardo de Conto, Blaise Genest, Arvind Easwaran
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework
Zackary Rackauckas, Arthur Câmara, Jakub Zavrel
How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence
Luke Zaphir, Jason M. Lodge, Jacinta Lisec, Dom McGrath, Hassan Khosravi
Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs
Yuxuan Qiao, Haodong Duan, Xinyu Fang, Junming Yang, Lin Chen, Songyang Zhang, Jiaqi Wang, Dahua Lin, Kai Chen
Vahana.jl -- A framework (not only) for large-scale agent-based models
Steffen Fürst, Tim Conrad, Carlo Jaeger, Sarah Wolf
Metacognitive AI: Framework and the Case for a Neurosymbolic Approach
Hua Wei, Paulo Shakarian, Christian Lebiere, Bruce Draper, Nikhil Krishnaswamy, Sergei Nirenburg
SegHist: A General Segmentation-based Framework for Chinese Historical Document Text Line Detection
Xingjian Hu, Baole Wei, Liangcai Gao, Jun Wang
JobFair: A Framework for Benchmarking Gender Hiring Bias in Large Language Models
Ze Wang, Zekun Wu, Xin Guan, Michael Thaler, Adriano Koshiyama, Skylar Lu, Sachin Beepath, Ediz Ertekin, Maria Perez-Ortiz
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework
Siyuan Yu, Wei Chen, H. Vincent Poor