cs.IRFeb 29, 2024

PaECTER: Patent-level Representation Learning using Citation-informed Transformers

Authors: Mainak Ghosh, Michael E. Rose, Sebastian Erhardt, Erik Buunk, Dietmar Harhoff

Organizations: Max Planck Institute for Innovation and Competition

Abstract

PaECTER is an open-source document-level encoder specific for patents. We fine-tune BERT for Patents with examiner-added citation information to generate numerical representations for patent documents. PaECTER performs better in similarity tasks than current state-of-the-art models used in the patent domain. More specifically, our model outperforms the patent specific pre-trained language model (BERT for Patents) and general-purpose text embedding models (e.g., E5, GTE, and BGE) on our patent citation prediction test dataset on different rank evaluation metrics. PaECTER predicts at least one most similar patent at a rank of 1.32 on average when compared against 25 irrelevant patents. Numerical representations generated by PaECTER from patent text can be used for downstream tasks such as classification, tracing knowledge flows, or semantic similarity search. Semantic similarity search is especially relevant in the context of prior art search for both inventors and patent examiners.

Figures & tables

Explore similar work

CardsList
  1. Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Bench

    Apr 24, 2026Younes Djemmal, You Zuo, Kim Gerdes +1Legal IRText Embedding Models

  2. Benchmarking Patent Embeddings: A Multi-Task Evaluation of 22 Models Across Retrieval, Classification, and Clustering

    May 22, 2026Amirhossein Yousefiramandi, Ciaran CooneyLegal IRClustering