DECODING YOUR THOUGHTS

It would be amazing to record your thoughts with a computer, would it not? The continuing efforts of researchers at UC Berkeley are making that possibility more feasible every year. Their latest experiment involves reconstructing videos based on fMRI readings. First a subject is shown various movie trailers while their brain is scanned. A computer correlates patterns in the fMRI data with visual patterns in the trailers. For part two of the experiment, the subject watches movie trailers while being scanned again. This time, however, the computer analyzes millions of seconds of YouTube videos to find clips that closely match the brain scan data. The matching clips are overlapped into a single video that very roughly resembles what the subject was viewing.

So far the clarity of the reconstructed videos is extremely limited. But the scientists' work is still quite astonishing. They can create videos of what people see just by scanning their brains! In the future this should result in the ability to create videos just by imagining them and clicking record on a computer. That would create quite a stir on YouTube. Recording dreams would fulfill a longtime wish for many. Perhaps within the next few decades there will be a slim headset that one puts on before going to bed. In the morning, a nearby computer has wirelessly received the brain activity information and generated an easily watched video file. After watching your own dream with the benefit of wakefulness, you might upload it to YouTube, email it to your psychiatrist, or just file it away for later viewing.

There are still a few obstacles to get through before we can do all that. First of all, MRI machines take up most of a room, and being scanned by one is like laying in a coffin. Researchers at the University of Toronto are working on using ultrasound headsets to scan brain activity, but sonic waves are not yet as capable as magnetic ones. Another limitation is that fMRI and ultrasound collect data on blood flow in the brain, not the electric and chemical signals between neurons. This is an indirect way of scanning thoughts, and it will always mean a delay between when a thought occurs and when the equipment actually detects it. An ideal setup would be a headset that can scan for the signals between neurons instead of measuring blood flow. 

UPDATE (09-29-11): Swiss and Japanese researchers are working on cars that can read a driver's thoughts, such as knowing that a right turn is coming up.