A Directed Graph Model and Experimental Framework for Design and Study of Time-Dependent Text Visualisation
Organizations: Monash University
Abstract
Exponential growth in the quantity of digital news, social media, and other textual sources makes it difficult for humans to keep up with rapidly evolving narratives about world events. Various visualisation techniques have been touted to help people to understand such discourse by exposing relationships between texts (such as news articles) as topics and themes evolve over time. Arguably, the understandability of such visualisations hinges on the assumption that people will be able to easily interpret the relationships in such visual network structures. To test this assumption, we begin by defining an abstract model of time-dependent text visualisation based on directed graph structures. From this model we distill motifs that capture the set of possible ways that texts can be linked across changes in time. We also develop a controlled synthetic text generation methodology that leverages the power of modern LLMs to create fictional, yet structured sets of time-dependent texts that fit each of our patterns. Therefore, we create a clean user study environment (n=30) for participants to identify patterns that best represent a given set of synthetic articles. We find that it is a challenging task for the user to identify and recover the predefined motif. We analyse qualitative data to map an unexpectedly rich variety of user rationales when divergences from expected interpretation occur. A deeper analysis also points to unexpected complexities inherent in the formation of synthetic datasets with LLMs that undermine the study control in some cases. Furthermore, analysis of individual decision-making in our study hints at a future where text discourse visualisation may need to dispense with a one-size-fits-all approach and, instead, should be more adaptable to the specific user who is exploring the visualisation in front of them.
Figures & tables
| Domain | Story Context Element | Narrative Data Topology | Evaluation | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Entity | Event | Topic | Thread | Tree | Map | Case Study | User Study | Ql/Qt | ||
| 1 ThemeRiver [ 9 ] | News, Speeches | ✓ | ✓ | ✓ | ✓ | Ql | ||||
| 2 TextFlow [ 5 ] | Publications, News | ✓ | ✓ | ✓ | Ql | |||||
| 3 CloudLines [ 14 ] | News | ✓ | ✓ | ✓ | Ql | |||||
| 4 EventRiver [ 20 ] | News | ✓ | ✓ | ✓ | ✓ | ✓ | Ql/Qt | |||
| 5 Metro Map [ 28 , 30 ] | News | ✓ | ✓ | ✓ | ✓ | Ql | ||||
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| ID | Entities | Topic | Factual statement |
|---|---|---|---|
| V1 | Red | Journey | Red departs her home for Grandma’s cottage carrying a basket of food through the woods. |
| V2 | Wolf | Journey | The Wolf watches Red from the bushes near the dark forest entrance to plan his hunt. |
| V3 | Red, Wolf | Journey | Red stops to chat with the Wolf on the wooded path because he seems friendly. |
| V4 | Wolf, Red | Deception | The Wolf encourages Red to pick wild flowers to delay the girl from reaching the cottage. |
| V5 | Wolf | Deception | The Wolf eats Grandma and dons her nightcap at the cottage to trick the girl. |
| V6 | Hunter, Wolf | Rescue | The Hunter tracks the Wolf across the forest floor after hearing a suspicious disturbance. |
Data Visualization
Data visualization studies how visual representations help people explore, interpret, communicate, and reason about data.
See all 120 papers