NVE: A Separability and Coverage-Aware Internal Validation Metric for Biclustering
Organizations: Robert Bosch Center for Cyber-Physical Systems (RBCCPS), Indian Institute of Science, Bengaluru, India · Cisco India · University of Melbourne, Australia · Robert Bosch Centre for Cyber-Physical Systems (RBCCPS) and the Centre for Infrastructure, Sustainable Transportation and Urban Planning (CiSTUP), Indian Institute of Science, Bengaluru, India
Abstract
Biclustering, or co-clustering, aims to discover coherent submatrices by grouping rows and columns of a data matrix simultaneously. This local two-dimensional structure makes validation more difficult than in ordinary clustering, where internal indices usually rely on compactness and separation in a single shared feature space. Existing popular internal biclustering measures such as Mean Squared Residue (MSR), and Virtual Error (VE) mainly evaluate within-bicluster coherence. Although useful, these measures do not directly assess whether the extracted biclusters are mutually distinct or whether they explain a meaningful portion of the data matrix. This paper investigates Normalised Virtual Error (NVE), an internal validation metric that extends VE using a super-bicluster normalization strategy. By comparing the VE of each bicluster with the VE obtained after merging it with other biclusters, NVE introduces a relative notion of separability and redundancy. We also study a coverage-adjusted variant, NVE\textsubscript{cov}, which penalizes solutions that obtain low error by selecting only very small submatrices. Through controlled synthetic benchmarks and yeast gene-expression datasets, we examine whether NVE and NVE\textsubscript{cov} provide information beyond standard coherence-based metrics. The results show that NVE is sensitive to redundant and poorly separated biclusters, while NVE\textsubscript{cov} changes solution rankings when low-error biclusters cover only a negligible part of the matrix. These findings suggest that NVE-based measures are useful complementary criteria for internal co-clustering validation, especially when coherence, separability, and coverage must be considered jointly.
Figures & tables
| ID | Name | Signal type | Stress test | |
| S1 | Additive | 4 | Pure additive, low noise | Baseline agreement; NVE |
| S2 | Scaling | 4 | All-positive scaling | MSR high, VE ; MSR–VE disagreement |
| S3 | Mixed shift-scale | 4 | Shift + scale, mixed-sign | Both MSR and VE degrade; NVE separability persists |
| S4 | Size vs. quality | 4 | Additive (2 clean, 2 noisy) | Coverage–coherence trade-off; NVE cov sensitivity |
| S5 | Overlap | 4 | Additive, equal signal | Redundancy detection; MSR/VE blind, NVE sensitive |
| S6 | Thin columns | 4 | Additive + constant stripes | VE degeneracy; minimum-size filter necessity |
| Metric | Most frequent winner |
| ASR | CCA (5/10 datasets) |
| AvgVE | LAS (8/10 datasets) |
| NVE | LAS (8/10 datasets) |
| NVE cov | Spectral (8/10 datasets) |
| Dataset / Algorithm | ASR | AvgVE | NVE | NVE cov |
| 01_alpha_factor / CCA | 15 | 5 | 5 | 8 |
| 02_cdc_15 / CCA | 15 | 3 | 3 | 15 |
| 02_cdc_15 / Spectral | 5 | 5 | 5 | 3 |
| 03_cdc_28 / CCA | 10 | 8 | 5 | 15 |
| 04_elutriation / CCA | 10 | 5 | 10 | 8 |
| 14_nitrogen_depletion / CCA | 3 | 3 | 3 | 8 |
| Scenario | ASR | AvgVE | NSR | NVE | NVE cov | Coverage |
| S1 additive | 0.0861 | 0.1548 | 0.0372 | 0.2587 | 0.7292 | 0.1258 |
| S2 scaling | 1.4897 | 0.1561 | 0.2443 | 0.2231 | 0.6291 | 0.1258 |
| S7 identical clones | 0.0958 | 0.2339 | 1.0366 | 1.0973 | 3.2126 | 0.1167 |
| S9a coverage tiling | 0.2041 | 0.3497 | 0.1349 | 0.4709 | 1.6312 | 0.0833 |
| S9b coverage cherry-pick | 0.0517 | 0.2331 | 0.0192 | 0.2716 | 2.7163 | 0.0100 |
Clustering
Clustering groups data points by shared structure, developing methods to discover, validate, and interpret groups across diverse data and constraints.
See all 348 papers