Jina Embeddings

Jina embeddings are vector representations of data, primarily text and images, designed to capture semantic meaning and relationships for improved information retrieval and downstream tasks. Current research focuses on enhancing embedding quality through novel loss functions (e.g., SimO loss for fine-grained contrastive learning), developing efficient architectures like decoupled embeddings for handling large datasets and multilingual contexts, and exploring non-Euclidean spaces (e.g., hyperbolic space) to better represent complex relationships. These advancements are improving performance in diverse applications, including recommendation systems, question answering, and even cybersecurity by enabling more accurate similarity searches and more effective model training.

Papers

August 9, 2022

Where's the Learning in Representation Learning for Compositional Semantics and the Case of Thematic Fit
Mughilan Muthupari, Samrat Halder, Asad Sayeed, Yuval Marton
LeArning Abstract Representation Learning Jina Embeddings Word Embeddings Case Relevance Topic Analysis Semantic Role Labeling Compositional Semantics Sparse Embeddings

August 2, 2022

Gender bias in (non)-contextual clinical word embeddings for stereotypical medical categories
Gizem Sogancioglu, Fabian Mijsters, Amar van Uden, Jelle Peperzak
Jina Embeddings Word Embeddings Gender Bias Stereotype Content BioNLP Workshop Clinical BERT

July 30, 2022

DAS: Densely-Anchored Sampling for Deep Metric Learning
Lizhao Liu, Shangxin Huang, Zhuangwei Zhuang, Ran Yang, Mingkui Tan, Yaowei Wang
Jina Embeddings Deep Model Deep Metric Learning

July 29, 2022

SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter
Heng Ee Tay, Mei Kuan Lim, Chun Yong Chong
Jina Embeddings BERT Model Twitter Resource Depression Detection Depression Symptom Convolutional Recurrent Nondeterministic Stack Mental Health Screening

July 22, 2022

A flexible PageRank-based graph embedding framework closely related to spectral eigenvector embeddings
Disha Shur, Yufan Huang, David F. Gleich
New Framework Graph Drawing Jina Embeddings Spectral Embedding Personalized Pagerank PageRank Algorithm

July 13, 2022

The DLCC Node Classification Benchmark for Analyzing Knowledge Graph Embeddings
Jan Portisch, Heiko Paulheim
Knowledge Graph Jina Embeddings Link Prediction Node Classification Knowledge Graph Embeddings Description Logic Real World Knowledge Graph

July 12, 2022

Using Paraphrases to Study Properties of Contextual Embeddings
Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea
Jina Embeddings Many Property Contextual Embeddings Paraphrase Detection High Quality Paraphrase

July 11, 2022

July 2, 2022

GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce
Chao Yang, Ru He, Fangquan Lin, Suoyuan Song, Jingqiao Zhang, Cheng Yang
Jina Embeddings Mixture Component BERT Model Individual Representation E Commerce Multi Modal Data General Text Item Embeddings Novel Representation

July 1, 2022

Assessing the Effects of Hyperparameters on Knowledge Graph Embedding Quality
Oliver Lloyd, Yi Liu, Tom Gaunt
Knowledge Graph Mixed Effect Jina Embeddings Link Prediction Quality Issue Related Hyperparameters Hyperparameter Space

June 29, 2022

Teach me how to Interpolate a Myriad of Embeddings
Shashanka Venkataramanan, Ewa Kijak, Laurent Amsaleg, Yannis Avrithis
Jina Embeddings Mixup Method Spatio Temporal Mixup Mechanism Dense Training Target Model Interpolation Based Data Augmentation

June 26, 2022

Edge Direction-invariant Graph Neural Networks for Molecular Dipole Moments Prediction
Yang Jeong Park
Graph Neural Network Jina Embeddings Graph Representation Dipole Moment

June 24, 2022

June 21, 2022

Nimble GNN Embedding with Tensor-Train Decomposition
Chunxing Yin, Da Zheng, Israt Nisa, Christos Faloutos, George Karypis, Richard Vuduc
Graph Neural Network Jina Embeddings GNN Based Node Feature Graph Partitioning

June 18, 2022

Secure Embedding Aggregation for Federated Representation Learning
Jiaxiang Tang, Jinbao Zhu, Songze Li, Lichao Sun
Jina Embeddings Private Data Data Aggregation Secure Approach Representation Learning Framework Local Embeddings Federated Representation Learning

Jina Embeddings

Papers

Where's the Learning in Representation Learning for Compositional Semantics and the Case of Thematic Fit

Gender bias in (non)-contextual clinical word embeddings for stereotypical medical categories

DAS: Densely-Anchored Sampling for Deep Metric Learning

SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter

A flexible PageRank-based graph embedding framework closely related to spectral eigenvector embeddings

The DLCC Node Classification Benchmark for Analyzing Knowledge Graph Embeddings

Using Paraphrases to Study Properties of Contextual Embeddings

Embedding Recycling for Language Models

Deep Squared Euclidean Approximation to the Levenshtein Distance for DNA Storage

GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce

Assessing the Effects of Hyperparameters on Knowledge Graph Embedding Quality

Teach me how to Interpolate a Myriad of Embeddings

Edge Direction-invariant Graph Neural Networks for Molecular Dipole Moments Prediction

MultiSAGE: a multiplex embedding algorithm for inter-layer link prediction

Geometry Interaction Knowledge Graph Embeddings

Nimble GNN Embedding with Tensor-Train Decomposition

Secure Embedding Aggregation for Federated Representation Learning

On the Surprising Behaviour of node2vec

TransDrift: Modeling Word-Embedding Drift using Transformer

Towards Better Understanding with Uniformity and Explicit Regularization of Embeddings in Embedding-based Neural Topic Models