BERT LID Model

BERT-LID models leverage the power of BERT-like architectures to improve language identification, particularly for short audio segments where accuracy is traditionally lower. Research focuses on adapting BERT for various input modalities, including phonetic representations and text, and enhancing its performance through techniques like specialized pre-training on domain-specific corpora (e.g., scientific texts or protein sequences) and improved uncertainty calibration. These advancements have significant implications for improving the accuracy and efficiency of multilingual speech processing systems and automated scoring of written responses in diverse fields like education and scientific research.

Papers

February 9, 2024

G-SciEdBERT: A Contextualized LLM for Science Assessment Tasks in German
Ehsan Latif, Gyeong-Geon Lee, Knut Neumann, Tamara Kastorff, Xiaoming Zhai
BERT Model Ticket BERT LLM in Context Code BERT Science Assessment BERT LID Model

October 30, 2023

GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Models
Seongwon Kim, Parisa Mollaei, Akshay Antony, Rishikesh Magar, Amir Barati Farimani
BERT Model Protein Sequence Protein Language Model Protein Function Prediction Pre Trained Protein Model Sequence Motif G Protein Coupled Receptor BERT LID Model Sequential Information Design

March 15, 2023

Efficient Uncertainty Estimation with Gaussian Process for Reliable Dialog Response Retrieval
Tong Ye, Zhitao Li, Jianzong Wang, Ning Cheng, Jing Xiao
Gaussian Process BERT Model Conversational Search BERT Architecture Efficient Uncertainty Estimation BERT LID Model Dialog Response Retrieval

May 13, 2022

Improving Contextual Representation with Gloss Regularized Pre-training
Yu Lin, Zhecheng An, Peihao Wu, Zejun Ma
Language Model Contextual Representation Sentence BERT BERT LID Model

March 27, 2022

Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection
Xin Huang, Ashish Khetan, Rene Bidart, Zohar Karnin
NLP Task Complexity Matter Transformer Based Language Model Code BERT Core Set Token Selection BERT LID Model

March 1, 2022

BERT-LID: Leveraging BERT to Improve Spoken Language Identification
Yuting Nie, Junhong Zhao, Wei-Qiang Zhang, Jinfeng Bai
Ticket BERT Language Identification Segmentation Label BERT LID Model