Scientific Inference

Scientific inference, the process of drawing conclusions from data, is a core challenge across numerous scientific fields, with current research focusing on improving efficiency and accuracy. This involves developing novel algorithms and architectures, such as those based on Bayesian networks, diffusion transformers, and autoregressive models, to optimize inference processes in various contexts, including large language models and image processing. These advancements are crucial for accelerating scientific discovery and enabling real-world applications in areas like personalized medicine, legal tech, and industrial automation, where efficient and reliable inference is paramount. The emphasis is on addressing computational bottlenecks and improving the reliability of inferences, particularly in scenarios with limited data or complex models.

Papers

July 22, 2024

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models
Georgy Tyukin, Gbetondji J-S Dovonon, Jean Kaddour, Pasquale Minervini
Scientific Inference Human Attention Attention Layer Low Latency LLM Benchmark Tuned Llama Model

July 19, 2024

Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference
Joyjit Kundu, Wenzhe Guo, Ali BanaGozar, Udari De Alwis, Sourav Sengupta, Puneet Gupta, Arindam Mallik
Large Language Model Scientific Inference Inference Latency Performance Prediction Large Language Model Training Performance Bottleneck Performance Model Workload Estimation

July 16, 2024

ChatBCG: Can AI Read Your Slide Deck?
Nikita Singh, Rob Balian, Lukas Martinelli
Artificial Intelligence Scientific Inference Multimodal Model Summarization Task Chart Image Presentation Slide

July 12, 2024

Accelerating the inference of string generation-based chemical reaction models for industrial applications
Mikhail Andronov, Natalia Andronova, Michael Wand, Jürgen Schmidhuber, Djork-Arné Clevert
Scientific Inference Retrosynthesis Prediction Industrial Application Autoregressive Generation String Problem Reaction Prediction Transformer Based Molecular

July 8, 2024

July 3, 2024

ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets
Ahmed Frikha, Nassim Walha, Ricardo Mendes, Krishna Kanth Nakka, Xue Jiang, Xuebing Zhou
Scientific Inference Obfuscation Technique Private Datasets Online Fine Tuning

July 1, 2024

Neural Conditional Probability for Inference
Vladimir R. Kostic, Karim Lounici, Gregoire Pacreau, Pietro Novelli, Giacomo Turri, Massimiliano Pontil
Scientific Inference Efficient Inference Conditional Distribution Inference Task Confidence Region Convolutional Conditional Neural Process

June 27, 2024

The Remarkable Robustness of LLMs: Stages of Inference?
Vedang Lad, Wes Gurnee, Max Tegmark
Medical LLM Scientific Inference Robust Version Model Ensembling Contextual Representation Multiple Stage

June 26, 2024

Multi-step Inference over Unstructured Data
Aditya Kalyanpur, Kailash Karthik Saravanakumar, Victor Barres, CJ McFate, Lori Moon, Nati Seifu, Maksim Eremeev, Jose Barrera, Abraham Bautista-Castillo, Eric Brown, David Ferrucci
Scientific Inference Neuro Symbolic Unstructured Data Symbolic Reasoning Natural Language Processing Application Neuro Symbolic Approach Retrieval System

June 25, 2024

What type of inference is planning?
Miguel Lázaro-Gredilla, Li Yang Ku, Kevin P. Murphy, Dileep George
Markov Decision Process Scientific Inference Variational Inference Probabilistic Graphical Model Hierarchical Planning

June 24, 2024

Inference of Sequential Patterns for Neural Message Passing in Temporal Graphs
Jan von Pichowski, Vincenzo Perri, Lisi Qarkaxhija, Ingo Scholtes
Scientific Inference Temporal Graph Message Passing Temporal Pattern Sequential Pattern Temporal GNN

June 21, 2024

June 20, 2024

June 18, 2024

June 17, 2024

Scientific Inference

Papers

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models

Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference

ChatBCG: Can AI Read Your Slide Deck?

Accelerating the inference of string generation-based chemical reaction models for industrial applications

Distilling System 2 into System 1

Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models

ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets

Neural Conditional Probability for Inference

The Remarkable Robustness of LLMs: Stages of Inference?

Multi-step Inference over Unstructured Data

What type of inference is planning?

Inference of Sequential Patterns for Neural Message Passing in Temporal Graphs

Logicbreaks: A Framework for Understanding Subversion of Rule-based Inference

Detecting Synthetic Lyrics with Few-Shot Inference

Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference

Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices

A variational Bayes approach to debiased inference for low-dimensional parameters in high-dimensional linear regression

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory

Modeling, Inference, and Prediction in Mobility-Based Compartmental Models for Epidemiology

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models