Structure and Lineage Evidence for Vietnamese Statutory Article Retrieval on DRiLL
Organizations: University of Information Technology, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
Abstract
We study Vietnamese statutory Article retrieval on DRiLL using features for provision identity and local form, same-law support, and citation and lineage evidence. Across five random seeds, selectors sharing candidates, listwise Qwen evidence, and learner settings improve official from 71.77% to 72.91%, with the largest descriptive gain on two-Article questions. Added features account for 18.20% of the proposed selector's total decision-tree split gain, measured as training-objective reduction, mainly from same-law and citation evidence. Cases reveal base provisions and amendments, companion recovery, distractor removal, and failures. These findings motivate research on other datasets, representations, and learners without establishing individual feature effects or requiring LightGBM, hand-crafted scores, or explicit graphs.
Figures & tables
| Study split | Questions | Multi-Article | Published partition |
|---|---|---|---|
| Train | 2,190 | 544 | Training |
| Development | 312 | 79 | Public test |
| Test | 627 | 153 | Private test |
| ID | Feature | Explanation |
|---|---|---|
| 1 | Article/alias match | Query numbering distinguishes an intended provision or its introducing Article from topical neighbors. |
| 2 | Compatible Clause cue | A Clause cue marks a request for a specific condition within a compatible Article. |
| 3 | Compatible Point cue | A Point cue marks finer targeting of an enumerated case or exception within a compatible Article. |
| 4 | Instrument-ID mention | An instrument ID disambiguates statutes that reuse Article numbers or discuss similar topics. |
| 5 | Article coreference | Article self-reference signals that an isolated text match may omit necessary surrounding context. |
| 6 | Clause coreference | Clause self-reference flags conditions requiring context from another part of the candidate. |
| Setting | Control ranker | Proposed ranker | Both selectors |
|---|---|---|---|
| Trees | 700 | 600 | 400 |
| Max. leaves / depth | 7 / 4 | 15 / 6 | 31 / 5 |
| Minimum child samples | 20 | 40 | 40 |
| Learning rate | 0.07325 | 0.06467 | 0.03000 |
| regularization | 2.75643 | 0.31089 | 1.00000 |
| Configuration | R@10 | R@100 |
|---|---|---|
| Control: 22 conventional | ||
| Proposed: 22 + 27 legal | \mathord{\hbox{\makebox[51.90244pt][c]{\resizebox{3401478}{}{\hbox{\boldsymbol{88.27\pm 0.74}}}}}} | \mathord{\hbox{\makebox[51.90244pt][c]{\resizebox{3401478}{}{\hbox{\boldsymbol{97.52\pm 0.15}}}}}} |
| Seed | R@10 | Mean control | Mean proposed | |
|---|---|---|---|---|
| 0 | +0.94 | +0.76 | 2.08 | 2.04 |
| 1 | +1.56 | +2.12 | 2.05 | 2.05 |
| 2 | +0.87 | +0.77 | 2.02 | 2.00 |
| 3 | +0.85 | +1.51 | 2.07 | 2.04 |
| 4 | +0.52 | +0.55 | 2.02 | 1.96 |
| System | Precision | Recall | |
|---|---|---|---|
| ducanger [ 6 ] | |||
| unknow_123 [ 7 ] | |||
| EDM (edmmm) [ 12 ] | |||
| Control (this study) | |||
| Proposed (this study) |
| Added feature group | Ranker (%) | Selector (%) |
|---|---|---|
| Identity / local form (1–10) | ||
| Same-law support (11–13) | ||
| Citation / lineage (14–27) |
| Control | Proposed | W | T | L | |||
|---|---|---|---|---|---|---|---|
| 1 | 474 | 71.49 | 71.91 | +0.42 | 166 | 217 | 91 |
| 2 | 121 | 61.34 | 65.79 | +4.45 | 61 | 42 | 18 |
| 32 | 43.51 | 46.40 | +2.89 | 12 | 11 | 9 |
| Field | Question, evidence and outcome |
|---|---|
| Vietnamese | Hồ sơ đăng ký bình chọn sản phẩm công nghiệp nông thôn tiêu biểu cấp huyện bao gồm những gì? |
| English | What does the application dossier for district-level selection of outstanding rural industrial products include? |
| Legal text | Base: Circular 26/2014/TT-BCT, Art. 12 ( 49460 ), lists application documents and requires “chuẩn bị 01 bộ hồ sơ ” (prepare one dossier). Amendment: Circular 14/2018/TT-BCT, Art. 1(6) ( 49474 ), amends Art. 12(1): “gửi 02 (hai) bộ hồ sơ (kèm theo bản hồ sơ điện tử )”. It requires two dossier sets plus an electronic dossier. |
| Selections | . Control returns in all five runs. Proposed returns in seeds 0, 1, 2 and 4, and in seed 3. |
| Field | Question, evidence and outcome |
|---|---|
| Vietnamese | Con trong giá thú và con ngoài giá thú có được hưởng di sản thừa kế như nhau hay không? |
| English | Are children born within and outside marriage entitled to equal inheritance? |
| Legal text | All three Articles belong to Civil Code 91/2015/QH13. Scope: Art. 650 ( 53420 ) specifies when statutory succession applies. Art. 650(1)(a), “ Không có di chúc ” (there is no will), is one such circumstance. Equal shares: Art. 651 ( 53421 ) identifies heirs. Art. 651(2) states “Những người thừa kế cùng hàng được hưởng phần di sản bằng nhau .” Heirs in the same rank receive equal shares. Distractor: Art. 652 ( 53422 ) concerns inheritance by representation for grandchildren and great-grandchildren. |
| Selections | . In all five runs, and . |
| Field | Question, evidence and outcome |
|---|---|
| Vietnamese | Những tài liệu đánh giá xếp loại chất lượng công chức nào sẽ được lưu trữ? |
| English | Which documents on civil servants’ performance assessment and classification will be archived? |
| Legal text | Base: Decree 90/2020/NĐ-CP, Art. 22 ( 28455 ), lists assessment records retained in personnel files. Amendment: Decree 48/2023/NĐ-CP, Art. 1(2) ( 58296 ), replaces Art. 22. Records “được lưu giữ bằng hình thức điện tử ” (are retained electronically). Items 2 and 4 (“khoản 2 và khoản 4”) of the replacement Art. 22 also “lưu bằng văn bản ” (remain in writing). These items concern assessment forms and conclusions/notices. |
| Selections | . Control returns in all five runs. Proposed returns in seeds 0, 1 and 2, and in seeds 3 and 4. |
Legal IR
Legal information retrieval finds and ranks relevant statutes, cases, patents, and other legal materials for queries and evidence-grounded systems.
See all 60 papers