The image encoder builds a rich set of representations of the image independently of the brain.
The brain encoder then learns to align MEG signals to these image embeddings.
Finally, the image decoder generates a plausible image based on these brain representations.
The second study focuses on understanding how the brain transforms thoughts into language.
While the technology shows promise, several challenges remain before it can be applied in clinical configs.
