LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents
Organizations: Huazhong University of Science and Technology · Peking University · Independent Researcher · Technical University of Munich
Abstract
In this paper, we introduce LATO, a novel topology-preserving latent representation that enables scalable, flow matching-based synthesis of explicit 3D meshes. LATO represents a mesh as a Vertex Displacement Field (VDF) anchored on surface, incorporating a sparse voxel Variational Autoencoder (VAE) to compress this explicit signal into a structured, topology-aware voxel latent. To decapsulate the mesh, the VAE decoder progressively subdivides and prunes latent voxels to instantiate precise vertex locations. In the end, a dedicated connection head queries the voxel latent to predict edge connectivity between vertex pairs directly, allowing mesh topology to be recovered without isosurface extraction or heuristic meshing. For generative modeling, LATO adopts a two-stage flow matching process, first synthesizing the structure voxels and subsequently refining the voxel-wise topology features. Compared to prior isosurface/triangle-based diffusion models and autoregressive generation approaches, LATO generates meshes with complex geometry, well-formed topology while being highly efficient in inference.
Figures & tables
| Method | CD(L2) | CD(L1) | HD | NC |
|---|---|---|---|---|
| MeshGPT | 0.042/0.050 | 0.061/0.069 | 0.070/0.096 | 0.824/0.831 |
| PivotMesh | /0.129 | /0.175 | /0.263 | /0.614 |
| MeshCraft | 0.150/0.243 | 0.212/0.327 | 0.282/0.299 | 0.531/0.625 |
| Ours | 0.042/0.040 | 0.061/0.056 | 0.065/0.092 | 0.847/0.834 |
| Method | CD(L2) | HD | NC |
|---|---|---|---|
| MeshAnythingv2 | 0.108/0.066 | 0.227/0.137 | 0.696/0.766 |
| MeshSilkSong | 0.062/0.052 | 0.145/0.101 | 0.784/0.818 |
| FastMesh | 0.064/0.048 | 0.110/0.102 | 0.757/0.813 |
| BPT | 0.059/0.052 | 0.107/0.088 | 0.811/0.824 |
| DeepMesh | 0.051/0.046 | 0.092/0.089 | 0.828/0.827 |
| Ours | 0.043/0.044 | 0.084/0.081 | 0.832/0.835 |
| Method | CD(L2) | CD(L1) | HD | NC |
|---|---|---|---|---|
| w/o | 0.040 | 0.057 | 0.076 | 0.832 |
| w/o | 0.043 | 0.061 | 0.092 | 0.822 |
| 0.040 | 0.056 | 0.078 | 0.832 | |
| w/ | 0.042 | 0.059 | 0.082 | 0.827 |
| w/ | 0.041 | 0.058 | 0.081 | 0.832 |
| Ours(Full model) | 0.039 | 0.056 | 0.075 | 0.837 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Generation Type | Method | Point-0 | Point-1 | Point-2 | Point-3 | Point-4 |
|---|---|---|---|---|---|---|
| Autoregressive | MeshAnythingv2 | (13.65, 460) | (22.87, 661) | (39.84, 1211) | (50.31, 1612) | (70.86, 2001) |
| MeshSilkSong | (42.23, 638) | (117.0, 1807) | (180.3, 2896) | (219.2, 3558) | (299.9, 4283) | |
| FastMesh | (5.289, 4001) | (7.636, 6787) | (10.66, 9475) | (16.09, 11426) | (19.02, 14666) | |
| BPT | (36.85, 623) | (81.25, 1404) | (109.4, 1995) | (164.2, 3190) | (251.8, 4029) | |
| DeepMesh | (147.5, 3526) | (241.2, 5355) | (415.8, 9242) | (484, 12084) | (565.7, 13737) | |
| Flow-based | Ours | ( 5.470 , 265) | ( 5.031 , 2702) | ( 5.298 , 5262) | ( 4.857 , 9803) | ( 9.873 , 14809) |
3D Mesh Generation
3D mesh generation creates and edits connected 3D surfaces for digital content, reconstruction, animation, and simulation.
See all 83 papers