cs.CVDec 27, 2024

Paleoinspired Vision: From Exploring Colour Vision Evolution to Inspiring Camera Design

Authors: Yijie Lu, Zhimin Zong, Junjie Zhang, Shenghan Su, Zeyun Zhao, Ziteng Cui, Yan Pu, Jing Lu, 

Organizations: The University of Florida · The University of Tokyo · Institute of Vertebrate Paleontology and Paleoanthropology · RIKEN AIP, The University of Tokyo

Abstract

The evolution of colour vision is captivating, as it reveals the adaptive strategies of extinct species while simultaneously inspiring innovations in modern imaging technology. In this study, we present a simplified model of visual transduction in the retina, introducing a novel opsin layer. We quantify evolutionary pressures by measuring machine vision recognition accuracy on colour images shaped by specific opsins. Building on this, we develop an evolutionary conservation optimisation algorithm to reconstruct the spectral sensitivity of opsins, enabling mutation-driven adaptations to more effectively spot fruits or predators. This model condenses millions of years of evolution into seconds using GPU, providing an experimental framework to test long-standing hypotheses in evolutionary biology, such as vision of early mammals, primate trichromacy from gene duplication, retention of colour blindness, blue-shift of fish rod and multiple rod opsins with bioluminescence. Beyond validating existing paleontological hypotheses, our model further enables speculative explorations of hypothetical species, such as organisms with visual systems adapted to Martian conditions. These constitute our contributions to AI for life science and neuroscience. Besides, the principles derived from these biological studies can translate into practical engineering solutions. In practice, our findings suggest a minimalist yet effective approach to task-specific camera filter design, optimising the spectral response function to meet application-driven demands. Code repository: https://github.com/luyijie-research/PaleVision.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Bio-inspired Color Constancy: From Gray Anchoring Theory to Gray Pixel Methods

    Apr 22, 2026Kai-Fu Yang, Fu-Ya Luo, Yong-Jie LiColor Constancy

  2. Programmable Silicon Retina on Pixel Processor Array

    Jun 6, 2026Maciej Lewandowski, Prince Philip, Alexandre Marcireau +3Event-Based VisionVideo Saliency Prediction

  3. Evolutionary Architecture Search for Chlorophyll-aa Prediction in Lakes using Sentinel-2

    Oct 7, 2026Kursat Komurcu, Linas PetkeviciusNeural Architecture SearchRemote Sensing