RFW-S: Everyday Deformable Objects with Independent Simulation Verification
Organizations: Alibaba Group · Tsinghua University · Nanyang Technological University · Nanjing University ·
Abstract
Large-scale robotic simulation requires diverse deformable objects with executable physical properties and realistic interaction behaviors. However, existing 3D asset collections primarily emphasize visual diversity, while scalable physical construction and verification remain challenging. We introduce RFW-S, a large-scale dataset of 83,365 simulation-verified assets spanning 485 everyday categories across five structural families: soft solids, cloth sheets, shells, garments, and bags. We develop an automated pipeline integrating reference-guided 3D generation, structure-aware physical modeling, and LLM-assisted parameter estimation and calibration. To ensure physical reliability, we introduce an independent simulation verification framework that evaluates object behaviors under interactions distinct from those used for parameter calibration. Extensive experiments demonstrate the effectiveness of independent verification and characterize deformable responses under different physical configurations. We further evaluate robotic grasping in terms of both task success and object integrity, and demonstrate the physical realism of our simulated objects through sim-to-real replay of fragile-object manipulation. RFW-S provides a scalable foundation for physically grounded simulation and embodied robotic learning.
Figures & tables
| A. Scale, semantic organization, and physical scope | |||
|---|---|---|---|
| Resource | Reported scale / unit | Category organization | Object scope |
| Objaverse-XL | 10M+ 3D objects | Diverse source collections | Broad visual geometry |
| CLOTH3D | 11.3K garments; 2.1M time samples | Six garment groups | Simulated clothing |
| SoftGym | 10 environments | Task-defined objects | Rope, cloth, fluid |
| ManiTwin-100K | 100K 3D objects | 512 categories | Rigid graspable objects |
| PhysXVerse | 8.7K+ 3D assets | 2.9K+ general categories | Rigid, deformable, articulated |
| Family | Types | Pool | Physical | RC | Both |
|---|---|---|---|---|---|
| Soft solids | 168 | 34,641 | 21,112 | 34,502 | 21,103 |
| Cloth sheets | 89 | 18,347 | 18,308 | 18,097 | 18,064 |
| Shells | 63 | 12,990 | 11,415 | 12,990 | 11,415 |
| Garments | 94 | 19,386 | 19,055 | 19,386 | 19,055 |
| Bags | 71 | 14,636 | 13,728 | 14,611 | 13,728 |
| Total | 485 | 100,000 | 83,618 | 99,586 | 83,365 |
| Component | Model / update | Input to proposer | Temp. |
|---|---|---|---|
| Physical prior | qwen3.8-max | Reference images, semantics, parameter catalog | 0.1 |
| Production correction | qwen3.8-max | Prior, current candidate, calibration metrics and diagnosis | 0.2 |
| Local text-only controls | qwen3.8-max | Structured parameter JSON; no images or video | 0.2 |
| Numeric agent | Mechanical rules | Numerical calibration residuals | — |
| Study | Distinct units and design | Outcomes |
|---|---|---|
| Full-pool verification | 100,000 assets, 485 categories | 100,000 per check |
| Supplementary stability | 2,000 bags, stability drop | 2,000 |
| Garment configurations | 4 garments 3 settings 2 probes | 24 |
| Response matching | 30 asset/target pairs 7 methods 4 budgets | 840 |
| Expanded verification | 300 bags 7 methods 4 budgets | 8,400 |
| Grasping | 1,000 instances from 7 base geometries; three single-trial controllers and a five-trial reference | 4,000 |
| Drop | Compression | |||
|---|---|---|---|---|
| Configuration | Height ratio | Speed (m/s) | Height ratio | Speed (m/s) |
| Shape-preserving | 0.499 | 0.00091 | 0.876 | 0.15938 |
| Softer material | 0.470 | 0.03125 | 0.707 | 0.00571 |
| Flexible cloth | 0.312 | 0.14820 | 0.303 | 0.15665 |
| Population | Both pass | Cal. only | Indep. only | Neither | Missing | Total |
|---|---|---|---|---|---|---|
| 30 targets | 682 | 49 | 3 | 83 | 23 | 840 |
| 300 bags | 8,075 | 325 | 0 | 0 | 0 | 8,400 |
| Controller | Cal. task | Held-out task | Intact | Damage |
|---|---|---|---|---|
| Fixed command | 595/660 (90.2%) | 245/340 (72.1%) | 0/340 | 0.654 |
| Slip feedback | 634/660 (96.1%) | 245/340 (72.1%) | 0/340 | 0.784 |
| Force prior (local) | 600/660 (90.9%) | 200/340 (58.8%) | 0/340 | 0.478 |
| Privileged reference | 360/660 (54.5%) | 200/340 (58.8%) | 0/340 | 0.493 |
Appendix figures & tables22 assets
Supplementary material from the paper’s appendix.
Appendix
| Component | Contents and purpose |
|---|---|
| Semantic identity | Canonical category, structural family, reference appearance |
| Geometry | Source mesh, visual appearance, simulation mesh, repair description |
| Scale | Intended size, solver normalization, coordinate transforms |
| Physical configuration | Representation, solver, proposed and effective parameters |
| Calibration | Probe configuration, measured response, diagnostic, candidate trace |
| Independent verification | Selected configuration, distinct probe, outcome and measurements |
| Construction outcome | Assets |
| Accepted at first candidate | 83,292 |
| Accepted after correction | 326 |
| Model-limit rejection | 16,317 |
| Numerical rejection | 2 |
| Unresolved judgment | 63 |
| Family | First pass | Corrected | Model limit | Numerical | Unresolved |
|---|---|---|---|---|---|
| Soft solids | 21,071 | 41 | 13,493 | 0 | 36 |
| Cloth sheets | 18,099 | 209 | 36 | 0 | 3 |
| Shells | 11,349 | 66 | 1,553 | 1 | 21 |
| Garments | 19,055 | 0 | 330 | 1 | 0 |
| Bags | 13,718 | 10 | 905 | 0 | 3 |
| Executed solver | Assets | Physically verified |
|---|---|---|
| PBD cloth | 193 | 189 |
| Elastic MPM | 7 | 6 |
| Elastoplastic MPM | 100 | 74 |
| Quantity | Definition | Acceptance |
|---|---|---|
| Finite fraction | Fraction of recorded states with finite positions and velocities | |
| Contact fraction | Fraction of recorded observations with detected contact | |
| Drop deformation | MPM ; PBD | |
| Compression deformation | , using compression-axis extent | MPM at commanded ratio ; PBD |
| Recovery | Final tail mean vertical extent / pre-contact mean vertical extent | MPM ; PBD |
| Penetration | Any recorded particle below the negative penetration margin | Absent |
| Garment | Probe | Shape-preserving | Softer material | Flexible cloth |
|---|---|---|---|---|
| 000193 | Drop | 0.399 / 0.002 | 0.379 / 0.122 | 0.289 / 0.181 |
| 000193 | Compression | 0.966 / 0.620 | 0.323 / 0.005 | 0.338 / 0.160 |
| 000202 | Drop | 0.451 / 0.001 | 0.406 / 0.001 | 0.279 / 0.170 |
| 000202 | Compression | 0.988 / 0.002 | 0.985 / 0.002 | 0.256 / 0.161 |
| 002117 | Drop | 0.594 / 0.001 | 0.571 / 0.001 | 0.324 / 0.110 |
| 002117 | Compression | 0.549 / 0.016 | 0.524 / 0.014 | 0.259 / 0.087 |
| Dimension | Rated clips | Score 4 or 5 | Proportion |
|---|---|---|---|
| Settling | 150 | 148 | 98.7% |
| Deformation | 150 | 146 | 97.3% |
| Recovery | 75 | 72 | 96.0% |
| Contact | 150 | 143 | 95.3% |
| Overall | 150 | 141 | 94.0% |
| Method | Recovery pass | Error | Valid n | Expanded pass | Error |
|---|---|---|---|---|---|
| Fixed profile | 100/120 | 0.0521 | 115 | 1152/1200 | 0.0127 |
| One-shot prior | 99/120 | 0.0704 | 119 | 1148/1200 | 0.0128 |
| Rule-based update | 98/120 | 0.0626 | 117 | 1151/1200 | 0.0125 |
| Sobol search | 97/120 | 0.0670 | 117 | 1156/1200 | 0.0121 |
| Vid2Sid-style (text) | 98/120 | 0.0622 | 115 | 1151/1200 | 0.0128 |
| Swim2Real-style (text) | 96/120 | 0.0734 | 118 | 1159/1200 | 0.0118 |
| Method | Budget 1 | Budget 2 | Budget 4 | Budget 8 |
|---|---|---|---|---|
| Fixed profile | 0.0533 (28) | 0.0527 (29) | 0.0446 (29) | 0.0579 (29) |
| One-shot prior | 0.0698 (30) | 0.0696 (30) | 0.0836 (30) | 0.0582 (29) |
| Rule-based update | 0.0659 (29) | 0.0727 (29) | 0.0585 (29) | 0.0537 (30) |
| Sobol search | 0.0676 (29) | 0.0583 (29) | 0.0663 (29) | 0.0757 (30) |
| Vid2Sid-style (text) | 0.0756 (29) | 0.0709 (29) | 0.0438 (28) | 0.0578 (29) |
| Swim2Real-style (text) | 0.0633 (29) | 0.0884 (30) | 0.0658 (29) | 0.0755 (30) |
| Method | Budget 1 | Budget 2 | Budget 4 | Budget 8 |
|---|---|---|---|---|
| Fixed profile | 0.0126 (300) | 0.0136 (300) | 0.0104 (300) | 0.0141 (300) |
| One-shot prior | 0.0138 (300) | 0.0126 (300) | 0.0127 (300) | 0.0119 (300) |
| Rule-based update | 0.0135 (300) | 0.0122 (300) | 0.0129 (300) | 0.0114 (300) |
| Sobol search | 0.0128 (300) | 0.0110 (300) | 0.0120 (300) | 0.0125 (300) |
| Vid2Sid-style (text) | 0.0168 (300) | 0.0109 (300) | 0.0116 (300) | 0.0119 (300) |
| Swim2Real-style (text) | 0.0131 (300) | 0.0115 (300) | 0.0123 (300) | 0.0104 (300) |
| Experiment | Method | Both | Cal. only | Indep. only | Neither | Missing |
|---|---|---|---|---|---|---|
| Recovery | Fixed profile | 99 | 4 | 1 | 11 | 5 |
| Recovery | One-shot prior | 98 | 5 | 1 | 15 | 1 |
| Recovery | Rule-based update | 97 | 6 | 1 | 13 | 3 |
| Recovery | Sobol search | 97 | 9 | 0 | 11 | 3 |
| Recovery | Vid2Sid-style (text) | 98 | 10 | 0 | 7 | 5 |
| Recovery | Swim2Real-style (text) | 96 | 10 | 0 | 12 | 2 |
| Experiment | Budget | Pairs | Difference | 95% interval |
|---|---|---|---|---|
| Recovery | 1 | 27 | -0.0102 | [-0.0355, 0.0113] |
| Recovery | 2 | 28 | 0.0227 | [-0.0028, 0.0593] |
| Recovery | 4 | 29 | 0.0196 | [-0.0015, 0.0544] |
| Recovery | 8 | 28 | 0.0052 | [0.0000, 0.0117] |
| Filter | 1 | 300 | -0.0003 | [-0.0043, 0.0037] |
| Filter | 2 | 300 | -0.0015 | [-0.0048, 0.0018] |
| Split | Controller | N | Task | Intact | Flag | Damage | Integrity |
|---|---|---|---|---|---|---|---|
| Calibration | Fixed command | 660 | 595 | 0 | 660 | 0.658 | 0.342 |
| Held-out | Fixed command | 340 | 245 | 0 | 340 | 0.654 | 0.346 |
| All | Fixed command | 1000 | 840 | 0 | 1000 | 0.654 | 0.346 |
| Calibration | Slip feedback | 660 | 634 | 0 | 660 | 0.950 | 0.050 |
| Held-out | Slip feedback | 340 | 245 | 0 | 340 | 0.784 | 0.216 |
| All | Slip feedback | 1000 | 879 | 0 | 1000 | 0.784 | 0.216 |
Synthetic Data Generation for Robotics
Synthetic data generation for robotics creates simulated scenes, sensor readings, and action trajectories to train and evaluate robots.
See all 327 papers