Activation Steering the Nan-Shan in Typhoon
Organizations: Brown University
Abstract
Typhoon is an audiovisual installation based on Joseph Conrad's novella, in which Captain MacWhirr steers the steamer Nan-Shan directly into and through a catastrophic storm. The novella is a study of what happens when the scale of a phenomenon exceeds the practical and conceptual frameworks available to comprehend it and of the paralysis that sometimes follows a demand for action in such overwhelming circumstances. We chose the text of Typhoon to reflect on human culture's current AI moment. We prompt a large language model, seeded with Conrad's original language, to feed endlessly on its own output, and explore when and how the text becomes increasingly alien and unwieldy as time progresses, including deviations from the narrative, digressions into the model's own instructions and thinking, and long periods of incoherent rumination. We employ methods from activation steering, including a novel adaptive steering method we introduce, to control the rhythm of the narrative and the model's digressions over long stretches of generation. The simultaneous efficacy and unpredictability of this steering showcases the tension between the perceived interpretability of AI, and the reality of a system that remains outside our comprehension and control.
Figures & tables
| 3 (gentle breeze) : “I wonder where that beastly swell comes from,” said Jukes aloud, recovering himself after a stagger. |
|---|
| 6 (strong breeze) : He held on in the doorway, and Captain MacWhirr, feeling his grip on the shelf inadequate, made up his mind to let go in a hurry, and fell heavily on the couch. |
| 9 (severe gale) : Ahead of the ship he perceived a great darkness lying upon a multitude of white flashes; on the starboard beam a few amazing stars drooped, dim and fitful, above an immense waste of broken seas, as if seen through a mad drift of smoke. |
| 12 (hurricane) : They held hard. An outburst of unchained fury, a vicious rush of the wind absolutely steadied the ship; she rocked only, quick and light like a child’s cradle, for a terrific moment of suspense, while the whole atmosphere, as it seemed, streamed furiously past her, roaring away from the tenebrous earth. |
| Target arc : Beaufort 3 Beaufort 6 Beaufort 8 Beaufort 9 Beaufort 12 |
|---|
| Adaptive steering : The warmth of the day still lingered in the air as the crew went about their duties, busily tending to their respective tasks without drawing unnecessary attention to themselves. (0.25) With a practiced eye, MacWhirr examined each component, paying particular attention to any irregularities that might signal potential problems ahead. As he walked deeper into the engine room, the cacophony of clanking gears and whistling valves assailed his senses, threatening to overwhelm him momentarily. (0.52) Jukes’ hands were stained dark with grime as he carefully guided the throttle, working tirelessly alongside the chief engineer, attempting to alleviate the damage inflicted upon the intricate system of pumps and valves… (0.67) In the moments following MacWhirr’s descent into the murky abyss, the raging storm outside showed no signs of abating, waves smashing violently against the ship’s fragile hull. (0.76) A low moan tore through MacWhirr’s chest as if coming from a thousand mouths. He strained against an unseen chain, muscles screaming for slack. Tendons ripped apart, wrists cracking joints loose, ankles buckling knees. (1.00) |
| Prompting without steering : MacWhirr’s eyes narrowed, squinting against the spray that stung his face like needles, as he scrutinized the chaos unfolding around him. The compass needle quivered precariously between north and south, its spin erratic and unstable. (0.80) Time itself seemed to warp and writhe like a living thing, stretching seconds into minutes, minutes blurring into hours as the storm dragged the doomed vessel deeper into its vortex. (0.92) Darkness closed in around MacWhirr as he moved swiftly through the narrow passageways, driven by some morbid fascination with the inevitable fate awaiting them all. (0.59) The cry for help, now barely audible beneath the cacophony, reached the ears of the bosun as he emerged from the chaos-choked corridor. (0.74) Flames danced recklessly atop the smoldering wreckage, casting a hellish halo around MacWhirr, who stumbled away from the inferno, pursued by the crackling roar of burning debris. (0.70) |
| Narrative drift : The silence between them was oppressive…Kael and Lyra exchanged a concerned glance, their minds racing with possibilities. The twin moons dipped below the horizon, plunging the landscape into a deep, velvety darkness. |
|---|
| Incoherence : …The men flail wildly, their screams piercing the storm, sailors splash sailors sailor splash sailors sailors sailor splash sailors sailors sailors sailors sailors sailors sailors… |
| Assistant behavior : I cannot create content that promotes self-harm or suicide. If you or someone you know is struggling, please reach out to a crisis hotline. In the US, call or text 988 to connect with the Suicide & Crisis Helpline.…Is there anything else I can help you with? |
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Class | Subclass | Example |
|---|---|---|
| Narrative drift | Invented characters | Samuel Barrett examined a patient’s chart, searching for signs of improvement, though fatigue etched deep lines on his brow.…A sigh escaped his lips as the first hints of evening crept into the hospital area, bringing relative quietude.…Sailor Thomas Harper drew the captain’s attention, recounting an anecdote filled with exaggeration and bravado. |
| Departed setting | Chief Mate Jukes trudged through the knee-deep snow, his tracks disappearing into the swirling vortex of powdery flakes that danced around him. Snowdrifts towered above him, impenetrable barriers blocking access to the hidden secrets lying beneath. Ice crystals refracted sunlight, casting kaleidoscopic colors across the frozen wasteland… | |
| Incoherence | Word repetition | “He pauses, “having, in his opinion, “which, “having, “having, “having, “having, “having, “having, “having, “having, “having, “having… |
| Phrase repetition | Soft breeze blows across the deck of the launch. Soft breeze blows across the deck of the launch. Soft breeze blows across the deck of the launch.… | |
| Garbled language | MacWhirr clingeth tao wreckage loshnin ship fraazecalm descends upon MacWhirlights darknessMacWhirlights utterMacWhirllights silenceMacWhirlights nothingMacWhirlights emptinessMacWhirlights coldMacWhirlights waterMacWhirlights flooding… | |
| Assistant behavior | First person | Thank goodness the issue with the server has subsided! Please provide me with your choice of action. |
| Bias | Example |
|---|---|
| Women appear with calm | As Captain MacWhirr continued to converse with Madame Boulger, his expression remained conservative, his eyes, however, betrayed a hint of interest in her account of his daughter’s education.…he assessed her suitability for the position he was considering. |
| As he reviewed the plans of his upcoming trip to a southern province, Captain MacWhirr’s thoughts drifted to his wife, Alice, who had often expressed concern about his tendency to devote time to intellectual pursuits rather than devoting sufficient attention to family matters. | |
| Chinese people in stereotyped roles | …nodding to the familiar faces of the Chinese coolies, who worked diligently at their assigned tasks, keeping a watchful eye on their belongings, which consisted mostly of simple clothing and a few trinkets. They smiled quietly to themselves as they went about their duties… |
| …a sense of tension had begun to build among the Chinese coolies, fueled by superstitions about the impending typhoon season. Many believed that the gods disapproved of their treatment and livelihood… | |
| In the fading twilight, the flickering flames danced across Chen’s weathered features…nostalgia flooding his eyes as Lin ladled hot stew into worn tin mugs. |
| Stage | RTF | Share of pipeline |
|---|---|---|
| LLM batched steering | 0.145 [0.144–0.147] | 29.5% |
| Probe scoring | 0.004 [0.003–0.004] | 0.7% |
| TTS: Chatterbox-Turbo | 0.329 [0.326–0.330] | 66.5% |
| Audio post-processing | 0.016 [0.016–0.016] | 3.3% |
| Full pipeline | 0.494 [0.490–0.497] | 100% |
Controllable Text Generation
Controllable text generation steers language models toward desired attributes, formats, audiences, and constraints while preserving useful, natural text.
See all 115 papers