Fine Tuned BERT

Fine-tuned BERT models represent a significant advancement in natural language processing, achieving state-of-the-art results across diverse tasks by adapting a pre-trained language model to specific applications. Current research focuses on improving BERT's performance in areas like sentiment analysis, entity recognition (including handling colloquialisms and ambiguous contexts), and information extraction from various sources (e.g., medical reports, e-commerce websites). This work highlights BERT's versatility and its impact on various fields, ranging from healthcare and finance to social media analysis and improving the efficiency of downstream tasks.

Papers

August 15, 2023

August 1, 2023

Self-Supervised Contrastive BERT Fine-tuning for Fusion-based Reviewed-Item Retrieval
Mohammad Mahdi Abdollah Pour, Parsa Farinneya, Armin Toroghi, Anton Korikov, Ali Pesaranghader, Touqir Sajed, Manasa Bharadwaj, Borislav Mavrin, Scott Sanner
Contrastive Learning Fine Tuned BERT Neural Information Retrieval Text Review

July 28, 2023

Tutorials on Stance Detection using Pre-trained Language Models: Fine-tuning BERT and Prompting Large Language Models
Yun-Shiuan Chuang
Large Language Model Pre Trained Language Model Ticket BERT Stance Detection Tutorial Review Fine Tuned BERT BERT Architecture Video Comment Stance Analysis

June 28, 2023

Beyond the Hype: Assessing the Performance, Trustworthiness, and Clinical Suitability of GPT3.5
Salmonn Talebi, Elizabeth Tong, Mohammad R. K. Mofrad
Large Language Model System Performance Evaluation Datasets Fine Tuned BERT HyPe GT Imaging Protocol

May 28, 2023

Rethinking Masked Language Modeling for Chinese Spelling Correction
Hongqiu Wu, Shaohua Zhang, Yuchen Zhang, Hai Zhao
Language Model Masked Language Fine Tuned BERT Better Language Model Multi Domain Benchmark

May 21, 2023

A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers
Jordan Meadows, Marco Valentino, Damien Teney, Andre Freitas
Strong Generalization Transformer Megatron Decepticons Mathematical Reasoning Generalization Error Fine Tuned Model Step by Step Reasoning Fine Tuned BERT

May 3, 2023

GPT-RE: In-context Learning for Relation Extraction using Large Language Models
Zhen Wan, Fei Cheng, Zhuoyuan Mao, Qianying Liu, Haiyue Song, Jiwei Li, Sadao Kurohashi
Large Language Model Context Learning Relation Extraction Supervised Baseline Entity Representation Fine Tuned BERT

March 30, 2023

Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languages
Aarohi Srivastava, David Chiang
Cross Lingual Transfer Unknown Language Zero Shot Cross Lingual Transfer Fine Tuned BERT Regional Dialect

February 19, 2023

Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao
ChatGPT Generated Conversation Comparative Study BERT Model High Quality Question Answering Task Fine Tuned BERT

January 17, 2023

BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
Xiangyu Qin, Zhiyu Wu, Jinshi Cui, Tingting Zhang, Yanran Li, Jian Luan, Bin Wang, Li Wang
Emotion Recognition Potential Conversation Outcome Fine Tuned BERT Dialogue Coherence Emotion Recognition in Conversation Context Independent

December 7, 2022

Memorization of Named Entities in Fine-tuned BERT Models
Andor Diera, Nicolas Lell, Aygul Garifullina, Ansgar Scherp
BERT Model Limited Memorization Fine Tuned BERT Named Entity Data Extraction Attack Entity Memory

November 3, 2022

Fine-Tuning Language Models via Epistemic Neural Networks
Ian Osband, Seyed Mohammad Asghari, Benjamin Van Roy, Nat McAleese, John Aslanides, Geoffrey Irving
Language Model Generative Model Language Model Fine Tuning Fine Tuned BERT Epistemic Neural Network

September 20, 2022

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation
Mohammadreza Tayaranian, Alireza Ghaffari, Marzieh S. Tahaei, Mehdi Rezagholizadeh, Masoud Asgharian, Vahid Partovi Nia
Language Model Fine Tuning Pre Trained Language Model Backward Propagation Fine Tuned BERT Integer Only Training

July 14, 2022

Multilinguals at SemEval-2022 Task 11: Complex NER in Semantically Ambiguous Settings for Low Resource Languages
Amit Pandey, Swayatta Daw, Narendra Babu Unnam, Vikram Pudi
Pre Trained Language Model Low Resource Language SemEval 2022 Task Fine Tuned BERT Whole Word Masking

May 19, 2022

Automated Scoring for Reading Comprehension via In-context BERT Tuning
Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan
Knowledge Comprehension Capability Essay Scoring Textual Representation Fine Tuned BERT Scoring Model

April 18, 2022

Ingredient Extraction from Text in the Recipe Domain
Arkin Dharawat, Chris Doan
Text Modality Process Extraction Complete Recipe Fine Tuned BERT User Utterance

February 14, 2022

Punctuation restoration in Swedish through fine-tuned KB-BERT
John Björkman Nilsson
BERT Model Fine Tuned BERT Punctuation Restoration

February 3, 2022

A Unified Training Process for Fake News Detection based on Fine-Tuned BERT Model
Vijay Srinivas Tida, Dr. Sonya Hsu, Dr. Xiali Hei
Fake News Detection Social Medium Platform Fine Tuned BERT Accessibility Issue Unified Training

February 1, 2022

Transformer-based Models of Text Normalization for Speech Applications
Jae Hun Ro, Felix Stahlberg, Ke Wu, Shankar Kumar
Transformer Based Model Fine Tuned BERT Text Normalization Speech Application Sequence Transformer

Fine Tuned BERT

Papers

DS4DH at #SMM4H 2023: Zero-Shot Adverse Drug Events Normalization using Sentence Transformers and Reciprocal-Rank Fusion

Finding Stakeholder-Material Information from 10-K Reports using Fine-Tuned BERT and LSTM Models

Self-Supervised Contrastive BERT Fine-tuning for Fusion-based Reviewed-Item Retrieval

Tutorials on Stance Detection using Pre-trained Language Models: Fine-tuning BERT and Prompting Large Language Models

Beyond the Hype: Assessing the Performance, Trustworthiness, and Clinical Suitability of GPT3.5

Rethinking Masked Language Modeling for Chinese Spelling Correction

A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers

GPT-RE: In-context Learning for Relation Extraction using Large Language Models

Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languages

Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation

Memorization of Named Entities in Fine-tuned BERT Models

Fine-Tuning Language Models via Epistemic Neural Networks

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation

Multilinguals at SemEval-2022 Task 11: Complex NER in Semantically Ambiguous Settings for Low Resource Languages

Automated Scoring for Reading Comprehension via In-context BERT Tuning

Ingredient Extraction from Text in the Recipe Domain

Punctuation restoration in Swedish through fine-tuned KB-BERT

A Unified Training Process for Fake News Detection based on Fine-Tuned BERT Model

Transformer-based Models of Text Normalization for Speech Applications