Performance Evaluation
Performance evaluation assesses the effectiveness and efficiency of systems, algorithms, and models across diverse domains. Current research emphasizes developing robust evaluation metrics and benchmarks, often focusing on deep learning architectures (like YOLO and transformer models) and specific algorithms (e.g., TOPSIS, Federated Learning). This field is crucial for advancing various scientific fields and practical applications, from improving the reliability of autonomous systems and medical diagnoses to optimizing resource allocation and enhancing the performance of large language models. The development of more comprehensive and interpretable evaluation frameworks is a key ongoing focus.
Papers
Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
Amey Agrawal, Anmol Agarwal, Nitin Kedia, Jayashree Mohan, Souvik Kundu, Nipun Kwatra, Ramachandran Ramjee, Alexey Tumanov
Performance Evaluation of Knowledge Graph Embedding Approaches under Non-adversarial Attacks
Sourabh Kapoor, Arnab Sharma, Michael Röder, Caglar Demir, Axel-Cyrille Ngonga Ngomo