The Screenless Sight Codex

Concept Atlas

The atlas is a brainstorming map for expanding the encyclopedia. It crosses four dimensions:

target: screen, eye, retina, nerve, cortex, perception, memory
carrier: electrons, photons, fields, sound, touch, chemistry, symbols
representation: pixels, features, events, symbols, scenes, meaning, cues
medium: glass, optics, tissue, tool, trained perception, memory scaffold

Carrier-To-Target Matrix

Carrier Screen Eye Retina Optic Nerve Cortex Perception Memory
Electrons Scanned beam Not practical directly Electrode stimulation Nerve interface Cortical array Learned phosphenes Cue-triggered recall through experience
Visible light Projection Retinal projection Photoreceptors/optogenetics Indirect Indirect or optogenetic research Normal visual imagery Photo and imagery cues
Infrared Device sensing Eye-safe display research Conversion needed Local transducer needed Local transducer needed Hidden assistive sensing Context cueing
UV Phosphor excitation Hazardous route Avoid direct tissue route Not preferred Not preferred Display conversion only Not relevant directly
Magnetic field Beam deflection Tracking or actuation Local converter Possible modulation TMS/phosphenes Low-symbol cueing Far-edge cue concept
RF Communication/power Wearable link Local receiver Local receiver Local receiver Assistive data link Cue ecosystem
Ultrasound Haptics or projection aid Not standard Speculative Speculative Focused neuromodulation Cue/modulation Far-edge timing/cue research
Touch Tactile display Wearable cue Bypass Bypass Learned interpretation Sensory substitution Recall anchors
Sound Audio display Bypass Bypass Bypass Learned interpretation Sensory substitution Music/narrative cues
Chemical state Phosphor-like analogy Tear film/sensing Optogenetics/drug state Neuromodulation research Neuromodulation research Mood/context effects Consolidation research
Symbols UI display Near-eye overlay Phosphene font Nerve code Cortical glyphs Semantic interface Memory tags

Representation Spectrum

Representation Description Best Fit
Raw pixels Full color/brightness grid. Normal displays and high-resolution optics.
Luminance map Brightness only. Early prosthetic vision and low-bandwidth displays.
Edge map Boundaries and contours. Navigation, reading, object finding.
Motion map Direction and speed of changes. Hazard awareness and peripheral cues.
Depth map Distance and surface layout. Mobility and reaching.
Salience map What deserves attention. AI-assisted cueing.
Object list Named things in the scene. Semantic interfaces and screen readers.
Scene graph Objects, surfaces, paths, relations. Scene skeleton and navigation.
Symbol set Learned glyphs or icons. Phosphene font, tactile language, cross-modal HUD.
Narrative cue Short verbal or symbolic memory prompt. Memory lantern and recall tools.
Affective cue Emotion or urgency tag. Memory, safety alerts, attention guidance.

Medium-Removal Matrix

This matrix helps keep the project focused on removing unnecessary middle media. The question is not only “what carries the signal?” but “what can be left out because the user can learn to complete it?”

Remove Or Compress Keep Instead Candidate Project
Wall screen Retinal projection, wearable cue, sound, touch, or symbol Screenless optical route or cross-modal HUD.
Full image frame Edge, motion, depth, and event cues Perceptual codec bench or event-first interface.
Photoreal texture Action-relevant geometry Scene skeleton navigator.
Static pixel map Traced shape or learned glyph Phosphene font trainer.
One-size-fits-all mapping Personal percept map Closed-loop cue diary.
Passive observation Active scanning and sensorimotor control Head-coupled substitution or artificial fovea.
Hidden AI judgment Cue plus confidence state Semantic interface with uncertainty grammar.
Direct memory claim Voluntary cue and recall scaffold Memory-safe cue companion.

Historical Reapplication Lens

The same move appears throughout media history:

remove a familiar medium
preserve the useful information
invent or improve the transducer
teach the receiver to interpret the new form

Radio removed the wire. Television removed the still image surface by scanning and rebuilding it. Radar removed visible light from detection. The transistor removed hot vacuum tubes from amplification and switching. Image sensors removed chemistry from photography. Sensory substitution removes the assumption that visual information must arrive through the eye.

The atlas uses that pattern to ask what else can be removed without losing the thing that matters: useful perception.

Idea Bank

Optical And Near-Eye

  1. Adaptive retinal projector that corrects for the user’s eye optics.
  2. Foveated retinal scanner that only paints the attended region in detail.
  3. Peripheral motion halo that shows motion direction without central clutter.
  4. Edge-only low-vision overlay that strengthens object boundaries.
  5. Depth contour overlay for stairs, curbs, shelves, and table edges.
  6. Text-locator overlay that highlights where readable text exists.
  7. Transparent semantic subtitles for signs, objects, and hazards.
  8. Eye-motion-assisted display that uses saccades as part of scanning.

Retina And Prosthesis

  1. Retina-matched encoder that emphasizes contrast, edges, and motion.
  2. Photoreceptor replacement mode for remaining retinal circuits.
  3. Ganglion-cell vocabulary built around stable output patterns.
  4. Phosphene calibration diary that tracks percept drift over time.
  5. Retinal icon mode for arrows, stop cues, and object category marks.
  6. Hybrid residual-vision enhancer that adds only missing features.
  7. Disease-specific encoder profiles for different retinal degeneration states.
  8. Low-power symbol mode for fatigue reduction.

Cortex And Neural Representation

  1. Cortical handwriting for letters and outlines.
  2. Cortical constellation maps for object classes.
  3. V1 peripheral warning field for approaching motion.
  4. Motion-area cueing for direction and flow.
  5. Cortical confidence code using pulse style or repetition.
  6. Neural shadow-mask algorithms for reducing percept overlap.
  7. Population-symbol display using distributed activation patterns.
  8. Retinotopic address bus separating location, feature, and urgency.

Cross-Modal

  1. Tactile compass belt for direction and obstacles.
  2. Fingertip edge reader for object outlines.
  3. Tongue-display scene map.
  4. Spatial audio object radar.
  5. Musical depth map.
  6. Haptic text-line follower.
  7. Audio plus tactile confidence grammar.
  8. Cross-modal training game for artificial vision fluency.

Semantic And AI-Assisted

  1. Scene skeleton narrator.
  2. Five-cue compression mode for fast decisions.
  3. Object permanence buffer that remembers static objects after detection.
  4. User-priority filter that learns what the user cares about.
  5. Confidence-visible labels.
  6. Question-answer vision mode: “what is in front of me?”
  7. Task mode switching for walking, reading, cooking, workshop, and social use.
  8. Privacy-preserving face cue that reports presence without identity unless allowed.

Memory And Imagery

  1. Memory lantern cards with image, sound, place, and narrative anchors.
  2. Recall constellation map for groups of related memories.
  3. Dream rehearsal deck for voluntary pre-sleep imagery.
  4. Visual imagination sketchpad linked to narration.
  5. Confidence tracker that separates vividness from accuracy.
  6. Context restoration playlists for recall.
  7. Emotion-tagged image atlas.
  8. Semantic diary that compresses events into cues rather than recordings.

Frontier Transducers

  1. Biological phosphor layer.
  2. Optogenetic symbol channel.
  3. RF-powered local optical cue.
  4. Magnetoelectric local converter.
  5. Ultrasound-gated perceptual symbol.
  6. Acoustic holographic cue field.
  7. Molecular state display with slow persistent cues.
  8. Injectable but removable transducer concept.

Hybrid Architectures

  1. Retinal projection plus audio semantic labels.
  2. Cortical phosphene font plus tactile direction belt.
  3. Event camera plus retinal prosthesis encoder.
  4. Depth camera plus tactile obstacle map.
  5. Near-eye display plus memory lantern journal.
  6. AI scene skeleton plus phosphene arrows.
  7. Optical low-vision overlay plus spoken uncertainty.
  8. Foveated prosthesis plus cross-modal peripheral alerts.

Perception-As-Medium Seeds

  1. Five-cue room codec that compresses a scene into only the cues needed to answer navigation questions.
  2. Active scan trainer where the user moves a cursor, camera, or head pointer and learns how cue changes map to objects.
  3. Transparent tool score that measures how quickly a cue disappears into the user’s action rather than staying as a distracting signal.
  4. Confidence grammar shared across visual, audio, and tactile outputs.
  5. Object memory buffer that keeps static but important objects available after the event stream stops firing.
  6. Perceptual bandwidth budget that ranks every cue by usefulness per bit.
  7. Task-first mode switcher that changes the cue language for walking, reading, cooking, workshop work, and social orientation.
  8. Perception-as-medium field notebook for logging what a cue became after practice, not only what the device emitted.

How To Expand An Idea

For each atlas idea, create a scenario page with: