Empirical Analysis
Empirical analysis is a crucial methodology for validating and improving machine learning models and algorithms across diverse domains. Current research focuses on evaluating model performance, robustness, and fairness using various techniques, including contrastive preference optimization, conformal prediction, and different fine-tuning strategies for large language models (LLMs), vision-language models, and other architectures. These analyses reveal critical insights into model biases, vulnerabilities to adversarial attacks, and the trade-offs between accuracy, efficiency, and resource consumption, informing the development of more reliable and responsible AI systems. The findings directly impact the design and deployment of AI in various applications, from translation and fraud detection to medical diagnosis and autonomous driving.
Papers
How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts
Yusu Qian, Haotian Zhang, Yinfei Yang, Zhe Gan
Towards an empirical understanding of MoE design choices
Dongyang Fan, Bettina Messmer, Martin Jaggi
Patent Value Characterization -- An Empirical Analysis of Elevator Industry Patents
Yuhang Guan, Runzheng Wang, Lei Fu, Huanle Zhang