A personal AI system needs a model of the user's goals, constraints, and ongoing commitments to plan and act on their behalf, and the quality of that model is bounded by what the system can observe. Broader observation does not by itself improve assistance because a bounded system must select and compress information for the task at hand. We argue that this observation bottleneck has a cooperative structure: the system builds a partial model of the user's changing life, the user evaluates its actions, and the user's consent and control shape what it can observe next. Useful and inspectable behavior can give users a reason to maintain or expand the observation channel, while failures can lead them to correct, narrow, revoke, or abandon it. We use the term cooperative observation for this feedback loop among usefulness, trust, and future access, and propose it as a framework for personal intelligence. We report a preliminary single-subject account from Organizm, a prototype used over six months, and outline evaluation directions for measuring how observation quality shapes personal AI.
Figures & tables
Figure 1. Cooperative observation as a recurring loop. User evaluation affects the next observation channel, so observability is partly earned through usefulness, trust, and control. A circular four-node diagram with warm user nodes and cool system nodes, labeled with O_t, H_t, A_t, and R_t, plus a dashed purple feedback arc for channel updates.
Figure 2. Observation-channel spectrum for personal AI. Later phases can broaden the observation stream through more continuous modalities that rely less on self-report, while also increasing privacy, consent, and autonomy risks. A four-card spectrum in green, blue, purple, and rose, each with an observation benefit and a central limitation or risk, connected left to right beneath a gradient bar indicating broader, more continuous observation with less reliance on self-report.
Figure 3. The prototype couples agent personas to matching information tiers. Higher levels preserve abstraction, while lower levels keep current observations close to action. Two color-framed vertical columns of four tiers each, linked horizontally, with upward summary flow and downward priority flow between the columns.
Month
Jan
Feb
Mar
Apr
May
Jun
Daily logs
24
9
12
21
31
30
Table 1. Daily log files per month in the single-subject Organizm deployment (2026).