BERT Model

BERT, a powerful transformer-based language model, is primarily used for natural language processing tasks by leveraging contextualized word embeddings to understand the meaning of text. Current research focuses on improving BERT's efficiency (e.g., through pruning and distillation), adapting it to specific domains (e.g., finance, medicine, law), and exploring its application in diverse areas such as text classification, information extraction, and data imputation. This versatility makes BERT a significant tool for advancing NLP research and impacting various applications, from improving healthcare diagnostics to enhancing search engine capabilities.

Papers

November 16, 2023

GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets
Wolfgang Otto, Matthäus Zloch, Lu Gan, Saurav Karmakar, Stefan Dietze
Data Set Machine Learning Model Entity Recognition Large Corpus BERT Model NLP Task Named Entity Recognition Scholarly Information Extraction

November 14, 2023

Investigating the Encoding of Words in BERT's Neurons using Feature Textualization
Tanja Baeumel, Soniya Vijayakumar, Josef van Genabith, Guenter Neumann, Simon Ostermann
BERT Model Ticket BERT Pretrained Language Model Word List Single Neuron Level Data Encoding Activation Maximization Visual Interpretation

November 3, 2023

Not all layers are equally as important: Every Layer Counts BERT
Lucas Georges Gabriel Charpentier, David Samuel
Language Model Transformer Architecture Pre Training Multi Layer BERT Model Transformer Layer BabyLM Challenge

October 31, 2023

October 26, 2023

torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP
Yoshitomo Matsubara
Knowledge Distillation Case Study BERT Model NLP Field Computer Vision Community

October 25, 2023

URL-BERT: Training Webpage Representations via Social Media Engagements
Ayesha Qamar, Chetan Verma, Ahmed El-Kishky, Sumit Binnani, Sneha Mehta, Taylor Berg-Kirkpatrick
Social Medium BERT Model Graph Embeddings Graph Based Representation

October 21, 2023

COVIDFakeExplainer: An Explainable Machine Learning based Web Application for Detecting COVID-19 Fake News
Dylan Warman, Muhammad Ashad Kabir
Covid 19 BERT Model Fake News Fake News Detection Explainable Machine Learning

October 16, 2023

Learning to Rank Context for Named Entity Recognition Using a Synthetic Dataset
Arthur Amalvy, Vincent Labatut, Richard Dufour
Large Language Model LeArning Abstract Entity Recognition BERT Model Named Entity Recognition Synthetic Dataset Stable Rank

October 13, 2023

Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection
Davide Napolitano, Lorenzo Vaiani, Luca Cagliero
BERT Model Sentence Level Visual Question Text to Text Masked Language Modeling Knowledge Based Visual Question

October 12, 2023

October 6, 2023

A Process for Topic Modelling Via Word Embeddings
Diego Saldaña Ulloa
BERT Model Word Embeddings Complex Process Clustering Algorithm

September 26, 2023

XGV-BERT: Leveraging Contextualized Language Model and Graph Neural Network for Efficient Software Vulnerability Detection
Vu Le Anh Quan, Chau Thuan Phat, Kiet Van Nguyen, Phan The Duy, Van-Hau Pham
Graph Neural Network BERT Model Vulnerability Detection Software Vulnerability Pre Trained Code Model Contextualized Language Model

September 21, 2023

Stock Market Sentiment Classification and Backtesting via Fine-tuned BERT
Jiashu Lou
BERT Model Fine Tuned BERT Quantitative Trading Efficient Market Automated Cryptocurrency Trading

September 19, 2023

Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi
Md Nishat Raihan, Dhiman Goswami, Antara Mahmud
BERT Model Indian Language Bangla Text Code Mixed Distilled BERT

September 12, 2023

Balanced and Explainable Social Media Analysis for Public Health with Large Language Models
Yan Jiang, Ruihong Qiu, Yi Zhang, Peng-Fei Zhang
Social Medium BERT Model Balanced Approach Social Medium Mining

BERT Model

Papers

GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets

Investigating the Encoding of Words in BERT's Neurons using Feature Textualization

Not all layers are equally as important: Every Layer Counts BERT

Breaking the Token Barrier: Chunking and Convolution for Efficient Long Text Classification with BERT

EELBERT: Tiny Models through Dynamic Embeddings

Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications

GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Models

BTRec: BERT-Based Trajectory Recommendation for Personalized Tours

torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP

URL-BERT: Training Webpage Representations via Social Media Engagements

COVIDFakeExplainer: An Explainable Machine Learning based Web Application for Detecting COVID-19 Fake News

Learning to Rank Context for Named Entity Recognition Using a Synthetic Dataset

Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection

Analyzing Textual Data for Fatality Classification in Afghanistan's Armed Conflicts: A BERT Approach

Effects of Human Adversarial and Affable Samples on BERT Generalization

A Process for Topic Modelling Via Word Embeddings

XGV-BERT: Leveraging Contextualized Language Model and Graph Neural Network for Efficient Software Vulnerability Detection

Stock Market Sentiment Classification and Backtesting via Fine-tuned BERT

Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi

Balanced and Explainable Social Media Analysis for Public Health with Large Language Models