Simstim (recorded full-sensory experience)
Recording one person's entire sensory and affective experience and replaying it into another person's nervous system, so the audience inhabits the performer's body.
In shortSimstim (recorded full-sensory experience), from Neuromancer (William Gibson, 1984), is at technology readiness level 2 of 9 (technology concept formulated) at its weakest link. Held back by In-vivo recording of a whole brain at single-neuron resolution and Cross-brain neural code alignment. Science status: consistent with known physics; key effects unproven at scale. Estimated new funding to unlock: $114B–563B (a floor; some parts are priced only to early research).
Case rides Molly's simstim feed, receiving her vision, hearing, touch and pain in real time while unable to control her body.
Closest todayPartial decoding of viewed and recalled video from fMRI; intracortical microstimulation that evokes touch and phosphenes.
Dependency stack
- Capturing a full experience means reading sensory and limbic activity across the whole brain, not one cortical patch
- Optical methods cannot penetrate a human skull or image below ~1 mm of tissue
- Channel count, heat dissipation and uplink bandwidth for ~86 billion neurons
- Displaced tissue volume and vascular damage scale with the number of inserted probes
plausibleTRL 2- Whole-brain coverage needs sensors orders of magnitude smaller than current shanks
✕3 blockers›
- No scheme to individually power and address millions of untethered sub-cellular devices
- Egress bandwidth; nanoparticles can stimulate but cannot yet report spikes off-board
- Clearance, aggregation and long-term toxicity of persistent intraparenchymal devices
plausibleTRL 3- Non-surgical delivery requires crossing from blood into brain parenchyma
✕3 blockers›
- Receptor targeting is species-specific; capsids binding human TfR1 often fail in macaque
- Pre-existing anti-AAV immunity excludes a large fraction of patients and blocks redosing
- Dose needed for brain-wide coverage drives liver toxicity and manufacturing cost
TRL 4- Designed capsid and shuttle proteins are the main route to receptor-specific transcytosis
✕1 blocker›
- Designing catalysis and conformational dynamics
TRL 6
- Devices resident in tissue for decades must not provoke encapsulation
✕3 blockers›
- Micromotion between rigid device and pulsating tissue drives chronic inflammation
- Thin-film encapsulation (polyimide, parylene, SiC) eventually admits water and fails
- Electrode charge-injection limits and corrosion under years of continuous stimulation
TRL 4
- Recording must remain stable for the duration of a life, not monthsTRL 4
- Electrode arrays are today's only route to single-neuron recording in humans
✕2 blockers›
- Tissue response degrades signal over years
- Channel count and wireless bandwidth
TRL 6- Channel count is limited by wireless data and power budget
✕3 blockers›
- Tissue heating caps implant power at a few hundred milliwatts, which bounds radio and compute
- Raw broadband neural data exceeds the link, forcing on-implant spike detection and compression
- Battery or wireless-power lifetime versus the decades a permanent interface implies
TRL 5- Implant power density sets what telemetry and on-board compute are affordable
✕2 blockers›
- Cycle life of lithium-metal anodes
- Thermal runaway safety
TRL 6
- The performer's codes must be translated into the viewer's brain's own representations
- Idiosyncratic coding; functional alignment currently needs both people to view the same long stimulus set
- No measurement of whether an aligned pattern evokes the same subjective content
- Channel capacity; achieved brain-to-brain bit rates are of order bits per minute
plausibleTRL 2- Alignment is composed of a decoder in one brain and an encoder in the other
✕3 blockers›
- Models are subject-specific; decoders do not transfer across brains without recalibration
- Non-invasive signals are slow and spatially coarse; invasive coverage is a few square centimetres
- Encoding (write) models are far behind decoding; we cannot specify the activity for an arbitrary percept
TRL 3- Fast, fine-grained signals needed for anything beyond coarse category decodingTRL 6
- Deep generative and language models supply the latent spaces that brain activity is mapped onto
✕2 blockers›
- Reliability and calibration over long horizons
- Continual learning after deployment
TRL 7- Training and inference compute
✕2 blockers›
- Grid power and interconnection queues
- Advanced-node chip and HBM memory supply
TRL 8
- Playback requires writing all modalities into the recipient simultaneously
✕4 blockers›
- Simultaneous stimulation and recording on the same tissue; stimulation artifact swamps spikes
- Coverage; immersive vision alone implies millions of controllable sites across V1
- Suppressing the real senses so the artificial stream is not in conflict with them
- Total implant power and heat once millions of channels are driven
plausibleTRL 3- Translating a synthetic scene into the activity patterns that evoke itTRL 3
- The write path for each sensory modality
✕4 blockers›
- Channel count and spatial resolution; phosphenes are coarse and do not tile a visual field
- Charge-density safety limits cap how often and how strongly tissue can be driven
- Stimulation artifacts blind the recording channels needed for closed-loop control
- No model specifies the pattern for an arbitrary complex percept
TRL 5- Stimulation needs the same dense chronic arrays as recordingTRL 6
- A full sensorium is a multi-gigabit bidirectional streamTRL 5
- Dense chronic coverage of multiple cortical areasTRL 6
- Simstim carries the performer's emotions, which must be measurable to record
✕3 blockers›
- Biomarkers do not generalize across people; each requires weeks of intracranial mapping
- Ground truth is subjective self-report, so the mapping cannot be validated objectively
- Emotion is not a small set of dials; no evidence that discrete states like "ersatz dread" are separately addressable
plausibleTRL 4 - Streaming and storing a whole-sensorium recordingTRL 5
Who could unlock it
- Across several requirements:
- Paradromics 2
- Alipasha VaziriResearcher, The Rockefeller UniversityLight beads microscopy recorded up to 1 million neurons across mouse dorsal cortex (Neuron 2024)
- Mikhail ShapiroResearcher, CaltechDevelops ultrasound and acoustic reporter genes for deep, noninvasive brain-activity readout
- Arbor Neuroscience (formerly Forest Neurotech)ProgramConvergent Research FRO founded 2023 by Caltech scientists to build whole-brain ultrasound sensing and modulation, backed by Eric and Wendy Schmidt
- Neuropixels consortium (HHMI Janelia, imec)ProgramDense silicon probes that record thousands of neurons per animal; the standard tool for large-scale electrophysiology
- Alexander HuthResearcher, University of Texas at AustinTransferred semantic language decoders to new participants using functional alignment on stories or silent movies (Current Biology 2025)
- James HaxbyResearcher, Dartmouth CollegeDeveloped hyperalignment, the standard method for mapping fMRI representations between individuals
- Uri HassonResearcher, Princeton UniversityShowed speaker and listener brain activity couple during natural communication
- Jean-Rémi KingResearcher, Meta FAIRLeads Meta's brain-decoding team, including functional alignment of visual semantics across subjects and Brain2Qwerty MEG decoding (2025-2026)
- Robert GauntResearcher, University of Pittsburgh Rehab Neural Engineering LabsLeads the Pittsburgh ICMS program that showed biomimetic stimulation produces more natural touch in humans (J. Neural Eng. 2025)
- Eduardo FernándezResearcher, Miguel Hernández University of ElcheImplanted 96-channel arrays in visual cortex of blind volunteers who recognised letters and shapes (JCI 2021)
- NeuralinkStartupRaised $650M Series E in 2025; has human motor-BCI participants and FDA Breakthrough designations for vision and speech restoration
- ParadromicsStartupFirst long-term Connexus implant in June 2026; participant used it for real-time speech, with sensory feedback on the roadmap
- Katherine ScangosResearcher, UCSF Dolby Family Center for Mood DisordersLed the 2021 n-of-1 study that found a personalized amygdala gamma biomarker and used it to trigger closed-loop stimulation for depression
- Helen MaybergResearcher, Icahn School of Medicine at Mount SinaiHer group used a sensing DBS device to identify a recording-based biomarker tracking recovery from treatment-resistant depression (NIH-reported, 2023)
- Sameer ShethResearcher, Baylor College of MedicineRuns intracranial-recording-guided DBS trials for depression at Baylor and co-founded Motif Neurotech (PI of its 2026 RESONATE study)
- UCSF Closed-Loop DBS ProgramAcademic labMulti-subject program mapping personalized iEEG mood biomarkers before chronic closed-loop DBS, with a sham-controlled phase
Beyond engineering
- Consent and ownership of a recording made inside someone's body
- Reliving another person's pain and trauma without the ability to opt out mid-feed