Synesthesia is a fascinating phenomenon of the mind, occurring when multiple senses seemingly “join” together. One of the more common forms is grapheme-color synesthesia, in which people see letters and numbers as having their own colors. For example, a person may see the number one as red, or seven as oddly chartreuse.
Neuroengineers at Columbia University have successfully converted human neural activity into synthesized speech. Led by Dr. Nima Mesgarani, their method involved training a deep-learning algorithm to interpret and synthesize the neural patterns of test subjects. Doing so, they were able to “reconstruct the words a person hears with unprecedented clarity.”