Scientific Inference

Scientific inference, the process of drawing conclusions from data, is a core challenge across numerous scientific fields, with current research focusing on improving efficiency and accuracy. This involves developing novel algorithms and architectures, such as those based on Bayesian networks, diffusion transformers, and autoregressive models, to optimize inference processes in various contexts, including large language models and image processing. These advancements are crucial for accelerating scientific discovery and enabling real-world applications in areas like personalized medicine, legal tech, and industrial automation, where efficient and reliable inference is paramount. The emphasis is on addressing computational bottlenecks and improving the reliability of inferences, particularly in scenarios with limited data or complex models.

Papers

June 5, 2023

Human-like Few-Shot Learning via Bayesian Reasoning over Natural Language
Kevin Ellis
Language Model LeArning Abstract Natural Language Scientific Inference Human Like Hypothesis Class Inductive Learning

June 4, 2023

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models
Changhun Lee, Jungyu Jin, Taesu Kim, Hyungjun Kim, Eunhyeok Park
Large Language Model Scientific Inference Balancing Weight LLM Adaptation Low Precision Representation

May 30, 2023

Towards Machine Learning and Inference for Resource-constrained MCUs
Yushan Huang, Hamed Haddadi
Machine Learning Machine Learning Model Scientific Inference Machine Learning Inference Inference Accelerator Fish Segmentation

May 27, 2023

Data Minimization at Inference Time
Cuong Tran, Ferdinando Fioretto
Scientific Inference Sensitive Data Inference Time Input Feature Data Minimization Information Accuracy

May 25, 2023

LLHR: Low Latency and High Reliability CNN Distributed Inference for Resource-Constrained UAV Swarms
Marwan Dhuheir, Aiman Erbad, Sinan Sabeeh
Unmanned Aerial Vehicle Scientific Inference Low Latency UAV Swarm Reliable Deep Learning Ultra Reliable Low Latency Communication

May 23, 2023

Understanding and Improving Optimization in Predictive Coding Networks
Nick Alonso, Jeff Krichmar, Emre Neftci
Neural Network Scientific Inference Back Propagation Human Understanding Predictive Coding Memory Efficient Supervised Machine Learning Optimization Strategy

May 19, 2023

ReFIT: Relevance Feedback from a Reranker during Inference
Revanth Gangi Reddy, Pradeep Dasigi, Md Arafat Sultan, Arman Cohan, Avirup Sil, Heng Ji, Hannaneh Hajishirzi
Scientific Inference Neural Information Retrieval Retrieve and Rerank Imperfect Recall

May 18, 2023

May 17, 2023

Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan
Language Model Scientific Inference Chain of Thought Right Problem Thought Reasoning Reasoning Path Language Model Inference

May 12, 2023

DAISM: Digital Approximate In-SRAM Multiplier-based Accelerator for DNN Training and Inference
Lorenzo Sonnino, Shaswot Shresthamali, Yuan He, Masaaki Kondo
Scientific Inference Hardware Accelerator DNN Training Parallel Processing Processing in Memory SRAM Cell Memory Technology Common Belief

May 10, 2023

Fast Distributed Inference Serving for Large Language Models
Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, Xin Jin
Large Language Model Scientific Inference LLM Inference Model Inference Inference Service

May 8, 2023

Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!
Zecheng Tang, Pinzheng Wang, Keyan Zhou, Juntao Li, Ziqiang Cao, Min Zhang
Diffusion Model Training Data Text Generation Scientific Inference Performance Improvement Text Generation Task Diffusion Trajectory Training Inference

May 3, 2023

Data Privacy with Homomorphic Encryption in Neural Networks Training and Inference
Ivone Amorim, Eva Maia, Pedro Barbosa, Isabel Praça
Neural Network Scientific Inference Homomorphic Encryption Privacy Guarantee Data Privacy Privacy Sensitive

April 25, 2023

CIMLA: Interpretable AI for inference of differential causal networks
Payam Dibaeinia, Saurabh Sinha
Scientific Inference Causal Relationship Single Cell Feature Attribution Method Interpretable AI Regulatory Network Causal Interpretation

April 10, 2023

Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang, Linjun Yang, Rangan Majumder, Furu Wei
Large Language Model Scientific Inference Higher Quality Reference Multi Turn Conversation Lossless Acceleration DaG LLM

April 6, 2023

Probing the Purview of Neural Networks via Gradient Analysis
Jinsol Lee, Charlie Lehman, Mohit Prabhushankar, Ghassan AlRegib
Neural Network Ground Truth Scientific Inference Gradient Based Best View Inference Problem Ambiguous Input

April 2, 2023

Geometric constraints improve inference of sparsely observed stochastic dynamics
Dimitra Maoutsa
Scientific Inference Geometric Constraint Semi Parametric Data Driven Control Invariant Distribution

March 31, 2023