Building real-time digital twin instances with Function+Data Flow: user evaluation and extension for iterative pipelines
Organizations: College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore. · CNRS, IPAL Lab, France.
Abstract
Digital twins (DTs) increasingly leverage artificial intelligence (AI) and machine learning (ML) pipelines, both to build real-time DTs from high-fidelity simulations and to instantiate them with historical data. However, engineering these pipelines remains largely ad-hoc: pipelines are hard to specify, validate, and reuse, with scarce dedicated tooling. Function+Data Flow (FDF) addresses this by defining a visual domain-specific language (DSL) that represents functions (ML models) explicitly, enabling their composition and reuse. We implemented FDF in DesCartes Builder, an integrated modeling environment supporting FDF-based DT synthesis and validation. In this paper, we report on an empirical user study evaluating whether FDF and DesCartes Builder can make AI-based DT development more accessible and reliable. Participants implemented a representative real-time DT prototype within DesCartes Builder, and we measured perceived usability and feature adequacy through quantitative and qualitative measures. Our results indicate that DesCartes Builder and FDF achieve a good level of usability across a broad range of potential users, and particularly for the intended audience of domain experts. The study additionally surfaces concrete strengths and areas for improvement of both the tool and the underlying FDF framework. Informed by these findings, we propose H-FDF, a Hierarchical extension of FDF supporting iterative and modular pipelines, enabling the formal specification of more complex DT pipelines such as dual training. Our findings suggest that integrated, model-driven platforms are a promising direction to transform AI-based DT engineering into a disciplined modeling practice.
Figures & tables
| ID | Short label (positive only) |
| Intended frequency of use | |
| System simplicity | |
| Ease of use | |
| User independence | |
| Functions well integrated | |
| Design consistency |
| Tool | SUS Score | Reference |
| Simulink | 76.4 | Ferrari et al. (2021) |
| UPPAAL | 61.7 | Ferrari et al. (2021) |
| Excel | 56.5 | Kortum and Bangor (2013) |
| Extremo | 70.0 | Mora Segura, Ángel and De Lara, Juan and Wimmer, Manuel (2024) |
| DesCartes Builder | 68.9 | De Conto et al. (2024) ; de Conto et al. (2025) |
| Group ( ) | Mean (SD) | 95% CI |
| Technical (15) | 72.8 (12.1) | [66.1, 79.5] |
| Low-technical (10) | 63.0 (17.9) | [50.2, 75.8] |
| Total (25) | 68.9 (15.2) | [62.6, 75.2] |
| Note: Welch’s . | ||
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| ID | Short label (positive only) | Full SUS item (positive/negative version) |
| Intended frequency of use | I think that I will use DesCartes Builder rather than other methods. | |
| System simplicity | I found DesCartes Builder unnecessarily complex. | |
| Ease of use | I thought DesCartes Builder was easy to use. | |
| User independence | I think that I would need the support of a technical person to be able to use DesCartes Builder . | |
| Functions well integrated | I found the various functions in DesCartes Builder were well integrated. | |
| Design consistency | I thought there was too much inconsistency in DesCartes Builder . |