Steering Generative Models for Accessibility: EasyRead Image Generation
Organizations: Department of Computer Science, ETH Zurich, Switzerland · Unicef Digital Impact Division, Valencia, Spain · ETH AI Center, ETH Zurich, Switzerland
Abstract
EasyRead pictograms are simple, visually clear images that represent specific concepts and support comprehension for people with intellectual disabilities, low literacy, or language barriers. The large-scale production of EasyRead content has traditionally been constrained by the cost and expertise required to manually design pictograms. In contrast, automatic generation of such images could significantly reduce production time and cost, enabling broader accessibility across digital and printed materials. However, modern diffusion-based image generation models tend to produce outputs that exhibit excessive visual detail and lack stylistic stability across random seeds, limiting their suitability for clear and consistent pictogram generation. This challenge highlights the need for methods specifically tailored to accessibility-oriented visual content. In this work, we present a unified pipeline for generating EasyRead pictograms by fine-tuning a Stable Diffusion model using LoRA adapters on a curated corpus that combines augmented samples from multiple pictogram datasets. Since EasyRead pictograms lack a unified formal definition, we introduce an EasyRead score to benchmark pictogram quality and consistency. Our results demonstrate that diffusion models can be effectively steered toward producing coherent EasyRead-style images, indicating that generative models can serve as practical tools for scalable and accessible pictogram production.
Figures & tables
| EasyRead design principle | Property description | Metric (score) | Metric description |
|---|---|---|---|
| Low visual clutter | Few colors and minimal visual noise | Palette Complexity ( ) | Color simplicity |
| Simple geometry | Clear shapes with smooth outlines | Edge Density ( ) | Fine-grained line detail |
| Clear focus | One visually dominant object | Saliency Concentration ( ) | Concentration of visual attention |
| Strong separation | Foreground clearly distinct from background | Foreground–Background Contrast ( ) | Perceptual foreground–background separation |
| Stable layout | Main content centered and well sized | Centering Error ( ) | Alignment with the image center |
| Consistent strokes | Uniform and readable outline thickness | Relative Stroke Thickness ( ) | Outline consistency and readability |
| Model | ERS | CLIP |
|---|---|---|
| SD v1.5 (GT) | ||
| Ours (LoRA) |
| GT (SD v1.5) | Ours (LoRA) | Global Symbols | Nano Banana Pro | Prompt (without sks token) |
|---|---|---|---|---|
| The skyline of New York City at night; background color: black; skin color: black; hair color: blonde | ||||
| A mom reading to a happy child; background color: red; skin color: black; hair color: blonde | ||||
| A firefighter on a ladder extinguishing a fire; background color: yellow; skin color: white; hair color: brown |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Scene Description | Background | Skin | Hair |
|---|---|---|---|
| The skyline of NYC at night | Red | White | Blonde |
| A person watering a houseplant | Green | Black | Brown |
| A child brushing their teeth | Blue | Asian | Dark Brown |
| A doctor listening to heartbeat | Yellow | Mulatto | Gray |
| A firefighter climbing a ladder | Black | Aztec | Dark Gray |
| A teacher writing on a chalkboard | White | White | Red |
| Prompt (without sks token) | Generation 1 | Generation 2 | Generation 3 | Generation 4 | Generation 5 |
|---|---|---|---|---|---|
| A street market with food stands; background color: red; skin color: mulatto; hair color: black | |||||
| A person taking a photograph; background color: white; skin color: asian; hair color: red | |||||
| A soccer player kicking a ball; background color: green; skin color: asian; hair color: darkBrown | |||||
| A cup of coffee on a table; background color: green; skin color: white; hair color: darkGray | |||||
| A police officer directing traffic; background color: white; skin color: mulatto; hair color: darkBrown | |||||
| A doctor listening to a patient’s heartbeat; background color: yellow; skin color: mulatto; hair color: gray |
Image Generation
Image generation studies models that create or edit images from text, examples, layouts, and other structured controls.
See all 463 papers