NEvo: AI-Generated Videos Designed to Maximize Specific Brain Region Activity
AI-generated videos to maximally drive a target brain region
I present NEvo, a new system using neural-guided evolutionary synthesis to create videos that precisely target and maximize activity in specific brain regions. By combining deep learning with evolutionary algorithms, we generate content optimized for neural responses, opening new frontiers in neuroscience and personalized media experiences.
We are no longer just watching videos; we are engineering visual stimuli to hijack the brain's attention mechanisms with surgical precision.
- aubanel
This is the absolutely horrific next stage for social media platforms:
- They're already well able to surface the most addictive short video for a specific user out of millions of real videos.
- But these millions of real videos are just darts thrown into the space of "videos that could hook the user", in the end even the best-selected of them is not perfect.
- Now, behold! AI allows to generate the perfect video to surgically hit all the switches in the viewer's brain and turn it into a zombie hooked for days on end.
Let's hope our regulations hit these "social networks" hard enough so that never dare deploy this kind of technology.
- jrmg
I’ll leave it to other comments to discuss the societal and moral implications of being able to do this (which, I agree, ick…). On a practical level:
We train an encoding model, a “digital twin”, that predicts how each visual region responds to any video. Now we can ask: which video would make a chosen region light up the most? NEvo searches for that video automatically, using the twin’s prediction as its reward.
I only scanned the paper, so maybe I missed it, but is there any confirmation that this ‘digital twin’ works? Like, do the generated videos actually cause the same patterns as in the ‘digital twin’ brain model in real humans in an MRI machine? My instinct is to be skeptical that it’s possible to reliably create a video -> brain activation prediction model.
- Unearned5161
This is very similar to last week with that mind reading startup thing. Please read the paper before commenting.
This is a tool to help researchers in figuring out what different parts of the brain are actually for with less experimenter bias contamination of “well we think maybe it’s about this so let’s show it video of x to see”.
The essence runs on having someone sit in a scanner for a couple hours watching all sorts of things, and then feeding that to a model that will then build its own representation of said data and try different things on it until it’s found what makes a certain part sing in the model.
The purpose is a generalized understanding of brain function, more or less the same way we’ve been doing it all these years. Expose brain to something, record it somehow, see if brains reaction in the recording helps you understand more about who we are and what cognition is.
- ajb
An anecdote, but some reason to think that overworking part of your brain is a bad idea:
I had an Aunt who had dementia. This is obviously a terrible outlook. But her and my Uncle seemed to be doing okay. My Uncle was an ultra-competent guy, highly stable, the person you could rely on; and had been his whole adult life. So it was shocking when he had a mental breakdown and became manic. There was probably something physical going on, but what was also going on was that he had wanted my aunt to be able to live normally for as long as possible, so had been covering everything - for a year or more he'd had to be alert 7 days a week in case my aunt tried to cook on the gas stove or something like that, at which she was no longer safe. So the risk-alert part of his brain had been constantly overworked.
I appreciate that this is scientific research, but there are definitely companies out there that will try to row-hammer everyone's brain if this sort of thing is not heavily controlled.
- ben_w
As others on Telegram have said: automated search for visual superstimuli likely leads to bad outcomes.
https://en.wikipedia.org/wiki/Supernormal_stimulus
https://en.wikipedia.org/wiki/BLIT_(short_story)
Also: one of the V3A animations reminds me loosely of things I saw when I was a kid, at night, shortly before I slept (though my experience then was more circular).
- _qua
I can imagine truly horrifying images coming out of this. Many people who have spent a lot of time online have come across unfortunate gore images that they may have seen for only a fraction of a second that they wish they could unsee. One can imagine the brain is able to see much worse.
- uniqueuid
Among my secret research ideas, this is the most dangerous and morally wrong one.
If future generations of researchers will wonder why IRB reviews became mandatory for computer science, studies like this will be the answer.
Seriously, some people don't seem to realize the point at which they are becoming Fritz Haber.
- nullbio
This is already happening at scale by the social media feed algorithms. We don't need generated content to accomplish this. In a sea of user created content, plenty of it is already at peak activation.