A Multi-Label Temporal Convolutional Framework for Transcription Factor Binding Characterization
Abstract
Transcription factors (TFs) regulate gene expression through complex and co-operative mechanisms. While many TFs act together, the logic underlying TFs binding and their interactions is not fully understood yet. Most current approaches for TF binding site prediction focus on individual TFs and binary classification tasks, without a full analysis of the possible interactions among various TFs. In this paper we investigate DNA TF binding site recognition as a multi-label classification problem, achieving reliable predictions for multiple TFs on DNA sequences retrieved in public repositories. Our deep learning models are based on Temporal Convolutional Networks (TCNs), which are able to predict multiple TF binding profiles, capturing correlations among TFs andtheir cooperative regulatory mechanisms. Our results suggest that multi-label learning leading to reliable predictive performances can reveal biologically meaningful motifs and co-binding patterns consistent with known TF interactions, while also suggesting novel relationships and cooperation among TFs.
Figures & tables
| Dataset | HC-M-E2F | D-7TF-2CL | D-5TF-3CL |
|---|---|---|---|
| Parameter | Final Value | Final Value | Final Value |
| batch size | 64 | 64 | 64 |
| dropout ratio | 0.5 | 0.5 | 0.5 |
| epochs | 50 | 50 | 50 |
| learning rate | 0.00258 | 0.00508 | 0.00219 |
| MLP hidden size | 100 | 100 | 100 |
| AP | AU-ROC | Accuracy | |
|---|---|---|---|
| mean | 0.88 | 0.87 | 0.80 |
| std | 0.11 | 0.11 | 0.11 |
| min | 0.49 | 0.49 | 0.48 |
| 25% | 0.84 | 0.83 | 0.75 |
| 50% | 0.91 | 0.90 | 0.82 |
| 75% | 0.96 | 0.95 | 0.89 |
| Model | TCN | RNN | ||||||||
| Label | f1-score | precision | recall | f1-score | precision | recall | f1-score | precision | recall | support |
| E2F1 | 3876 | |||||||||
| E2F6 | 4338 | |||||||||
| E2F8 | 1977 | |||||||||
| MYC | 7012 | |||||||||
| macro avg | 17203 | |||||||||
| Model | TCN | RNN | ||||||||
| Label | f1-score | precision | recall | f1-score | precision | recall | f1-score | precision | recall | support |
| ATF3 | 3257 | |||||||||
| ELF1 | 9660 | |||||||||
| MAZ | 9350 | |||||||||
| SP1 | 7200 | |||||||||
| TAF1 | 5859 | |||||||||
| Model | TCN | RNN | Diff (TCN - RNN) | |||||||
| Label | f1-score | precision | recall | f1-score | precision | recall | f1-score | precision | recall | support |
| ATF3 | 3952 | |||||||||
| SP1 | 9452 | |||||||||
| TAF1 | 8615 | |||||||||
| USF2 | 3457 | |||||||||
| c-Myc | 7889 | |||||||||
| Label | E2F | g0 | g1 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| f1-score | precision | recall | f1-score | precision | recall | f1-score | precision | recall | |
| Medie | |||||||||
| macro avg | |||||||||
| micro avg | |||||||||
| samples avg | |||||||||
| weighted avg | |||||||||
Multi-Label Classification
Multi-label classification assigns several potentially related tags to each example, from medical findings and topics to objects and user interests.
See all 137 papersCausal dictionary learning reveals and validates transcription-factor binding features in genomic language models
concept'' inside a model is real rather than an artifact of sequence composition. We introduce a framework that combines sparse dictionary learning with causal intervention to extract, validate, and causally test interpretable features in genomic foundation models. Training top-$k$ sparse autoencoders on the hidden activations of two architecturally distinct models, Nucleotide Transformer ($6$-mer tokenization) and DNABERT-2 (byte-pair encoding), we recover thousands of monosemantic features that map to transcription-factor (TF) sequence motifs. We show that the naive validation of such features against position weight matrices is severely confounded by GC composition and repetitive elements, producing hundreds of spurious TF features'', and we develop a composition-matched, binding-resolved protocol that removes these confounds. Critically, we move beyond correlation: by ablating individual dictionary directions during the model's forward pass and measuring the induced shift in the model's own predictive distribution, we establish that specific features are causally used to represent cell-type-specific TF binding, not merely motif presence. Across three transcription factors (CTCF, GATA1, REST) and both architectures, causally validated binding features emerge reproducibly (-- of tested features per condition), while two classes of negative control, scrambled binding labels and randomly selected features, yield no detectable signal. The framework is purely computational, uses only public data, and provides a reusable standard for interpretability claims in genomic deep learning.