BERT Model

BERT, a powerful transformer-based language model, is primarily used for natural language processing tasks by leveraging contextualized word embeddings to understand the meaning of text. Current research focuses on improving BERT's efficiency (e.g., through pruning and distillation), adapting it to specific domains (e.g., finance, medicine, law), and exploring its application in diverse areas such as text classification, information extraction, and data imputation. This versatility makes BERT a significant tool for advancing NLP research and impacting various applications, from improving healthcare diagnostics to enhancing search engine capabilities.

Papers

January 30, 2024

January 28, 2024

Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddings
Logan Hallee, Rohan Kapur, Arjun Patel, Jason P. Gleghorn, Bohdan Khomtchouk
Contrastive Learning Mixture Component BERT Model Expert Knowledge Deep Transformer Sentence Similarity Vector Embeddings

January 25, 2024

A comparative study of zero-shot inference with large language models and supervised modeling in breast cancer pathology classification
Madhumita Sushil, Travis Zack, Divneet Mandair, Zhiwei Zheng, Ahmed Wali, Yan-Ning Yu, Yuwei Quan, Atul J. Butte
Large Language Model Zero Shot Comparative Study BERT Model Breast Cancer Classification Large Scale Annotated Label Model Clinical NLP

January 21, 2024

SEBERTNets: Sequence Enhanced BERT Networks for Event Entity Extraction Tasks Oriented to the Finance Field
Congqing He, Xiangyu Zhu, Yuquan Le, Yuzhong Liu, Jianhong Yin
BERT Model BERT Based Event Extraction Multi Channel

January 20, 2024

Unfair TOS: An Automated Approach using Customized BERT
Bathini Sai Akash, Akshara Kupireddy, Lalita Bhanu Murthy
Procedural Fairness BERT Model Automated Approach

January 15, 2024

SemEval-2017 Task 4: Sentiment Analysis in Twitter using BERT
Rupak Kumar Das, Dr. Ted Pedersen
Large Language Model Sentiment Analysis BERT Model Ticket BERT SemEval 2022 Task Twitter Resource Twitter Data

January 13, 2024

Joint Extraction of Uyghur Medicine Knowledge with Edge Computing
Fan Lu, Quan Qi, Huaibin Qin
BERT Model Relation Extraction Edge Computing Knowledge Extraction Joint Extraction

January 10, 2024

Reinforcement Learning for Optimizing RAG for Domain Chatbots
Mandar Kulkarni, Praveen Tangarajan, Kyung Kim, Anusua Trivedi
Reinforcement Learning Retrieval Augmented Generation BERT Model Open Domain Retrieval Model

December 30, 2023

L3Cube-MahaSocialNER: A Social Media based Marathi NER Dataset and BERT models
Harsh Chaudhari, Anuja Patil, Dhanashree Lavekar, Pranav Khairnar, Raviraj Joshi
Entity Recognition Social Medium BERT Model Named Entity Recognition L3Cube MahaSocialNER

December 29, 2023

TuPy-E: detecting hate speech in Brazilian Portuguese social media with a novel dataset and comprehensive analysis of models
Felipe Oliveira, Victoria Reis, Nelson Ebecken
Full Model Social Medium BERT Model Hate Speech Hate Speech Detection Novel Dataset Comprehensive Analysis Brazilian Portuguese

December 17, 2023

Can persistent homology whiten Transformer-based black-box models? A case study on BERT compression
Luis Balderas, Miguel Lastra, José M. Benítez
Case Study BERT Model Ticket BERT Black Box Model Persistent Homology

December 16, 2023

Cross-Linguistic Offensive Language Detection: BERT-Based Analysis of Bengali, Assamese, & Bodo Conversational Hateful Content from Social Media
Jhuma Kabir Mim, Mourad Oussalah, Akash Singhal
Social Medium BERT Model Hate Speech Bangla Text Monolingual Model Hateful Content Offensive Content Offensive Language Detection

December 10, 2023

FP8-BERT: Post-Training Quantization for Transformer
Jianwei Li, Tianchi Zhang, Ian En-Hsu Yen, Dongkuan Xu
Transformer Based BERT Model Ticket BERT Quantization Operator Quantization Aware Training BERT Variant 8 Bit Quantization

December 6, 2023

Corporate Bankruptcy Prediction with Domain-Adapted BERT
Alex Kim, Sangwon Yoon
Sentiment Analysis Domain Specific BERT Model Corporate Disclosure BERT Like Bankruptcy Prediction

December 2, 2023

Knowledge Graph Enhanced Aspect-Level Sentiment Analysis
Kavita Sharma, Ritu Patel, Sunita Iyer
Knowledge Graph Sentiment Analysis BERT Model Implicit Sentiment Sentiment Feature Aspect Level Sentiment Analysis

November 29, 2023

Enhancing Answer Selection in Community Question Answering with Pre-trained and Large Language Models
Xinghang Hu
BERT Model Community Question Answering Answer Selection

November 27, 2023

Leveraging deep active learning to identify low-resource mobility functioning information in public clinical notes
Tuan-Dung Le, Zhuqi Miao, Samuel Alvarado, Brittany Smith, William Paiva, Thanh Thieu
BERT Model Human Annotation Full Information Clinical Note Annotated Dataset Deep Active Learning Resource Constrained Device Clinical Natural Language Processing Clinical Natural Language Processing Task

November 21, 2023

LowResource at BLP-2023 Task 2: Leveraging BanglaBert for Low Resource Sentiment Analysis of Bangla Language
Aunabil Chakma, Masum Hasan
Sentiment Analysis BERT Model Low Resource Bangla Text Bangla Natural Language

November 18, 2023

SBTRec- A Transformer Framework for Personalized Tour Recommendation Problem with Sentiment Analysis
Ngai Lam Ho, Roy Ka-Wei Lee, Kwan Hui Lim
Sentiment Analysis BERT Model Recommendation System Transformer Based Framework Recommendation Accuracy POI Recommendation

BERT Model

Papers

Detecting mental disorder on social media: a ChatGPT-augmented explainable approach

D-Nikud: Enhancing Hebrew Diacritization with LSTM and Pretrained Models

Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddings

A comparative study of zero-shot inference with large language models and supervised modeling in breast cancer pathology classification

SEBERTNets: Sequence Enhanced BERT Networks for Event Entity Extraction Tasks Oriented to the Finance Field

Unfair TOS: An Automated Approach using Customized BERT

SemEval-2017 Task 4: Sentiment Analysis in Twitter using BERT

Joint Extraction of Uyghur Medicine Knowledge with Edge Computing

Reinforcement Learning for Optimizing RAG for Domain Chatbots

L3Cube-MahaSocialNER: A Social Media based Marathi NER Dataset and BERT models

TuPy-E: detecting hate speech in Brazilian Portuguese social media with a novel dataset and comprehensive analysis of models

Can persistent homology whiten Transformer-based black-box models? A case study on BERT compression

Cross-Linguistic Offensive Language Detection: BERT-Based Analysis of Bengali, Assamese, & Bodo Conversational Hateful Content from Social Media

FP8-BERT: Post-Training Quantization for Transformer

Corporate Bankruptcy Prediction with Domain-Adapted BERT

Knowledge Graph Enhanced Aspect-Level Sentiment Analysis

Enhancing Answer Selection in Community Question Answering with Pre-trained and Large Language Models

Leveraging deep active learning to identify low-resource mobility functioning information in public clinical notes

LowResource at BLP-2023 Task 2: Leveraging BanglaBert for Low Resource Sentiment Analysis of Bangla Language

SBTRec- A Transformer Framework for Personalized Tour Recommendation Problem with Sentiment Analysis