Cortical Spatio-temporal Dynamics Underlying Phonological Target Detection in Humans

Authors:

• Edward F. Chang

• Erik Edwards

• Srikantan S. Nagarajan

• Noa Fogelson

• Sarang S. Dalal

• Ryan T. Canolty

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2011

DOI: 10.1162/jocn.2010.21466

PubMed: 20465359

View PDF

Abstract:

Selective processing of task-relevant stimuli is critical for goal-directed behavior. We used electrocorticography to assess the spatio-temporal dynamics of cortical activation during a simple phonological target detection task, in which subjects press a button when a prespecified target syllable sound is heard. Simultaneous surface potential recordings during this task revealed a highly ordered temporal progression of high gamma (HG, 70-200 Hz) activity across the lateral hemisphere in less than 1 sec. The sequence demonstrated concurrent regional sensory processing of speech syllables in the posterior superior temporal gyrus (STG) and speech motor cortex, and then transitioned to sequential task-dependent processing from prefrontal cortex (PFC), to the final motor response in the hand sensorimotor cortex. STG activation was modestly enhanced for target over nontarget sounds, supporting a selective gain mechanism in early sensory processing, whereas PFC was entirely selective to targets, supporting its role in guiding response behavior. These results reveal that target detection is not a single cognitive event, but rather a process of progressive target selectivity that involves large-scale rapid parallel and serial processing in sensory, cognitive, and motor structures to support goal-directed human behavior.

Single-trial speech suppression of auditory cortex activity in humans.

Authors:

• Adeen Flinker

• Edward F. Chang

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Nathan E. Crone

• Robert T. Knight

Date: 2010

PubMed: 21148003

View PDF

Abstract:

The human auditory cortex is engaged in monitoring the speech of interlocutors as well as self-generated speech. During vocalization, auditory cortex activity is reported to be suppressed, an effect often attributed to the influence of an efference copy from motor cortex. Single-unit studies in non-human primates have demonstrated a rich dynamic range of single-trial auditory responses to self-speech consisting of suppressed, nonsuppressed and excited auditory neurons. However, human research using noninvasive methods has only reported suppression of averaged auditory cortex responses to self-generated speech. We addressed this discrepancy by recording electrocorticographic activity from neurosurgical subjects performing auditory repetition tasks. We observed that the degree of suppression varied across different regions of auditory cortex, revealing a variety of suppressed and nonsuppressed responses during vocalization. Importantly, single-trial high-gamma power (γ(High), 70-150 Hz) robustly tracked individual auditory events and exhibited stable responses across trials for suppressed and nonsuppressed regions.

Categorical speech representation in human superior temporal gyrus

Authors:

• Edward F. Chang

• Jochem W. Rieger

• Keith Johnson

• Mitchel S. Berger

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2010

PubMed: 20890293

View PDF

Abstract:

Speech perception requires the rapid and effortless extraction of meaningful phonetic information from a highly variable acoustic signal. A powerful example of this phenomenon is categorical speech perception, in which a continuum of acoustically varying sounds is transformed into perceptually distinct phoneme categories. We found that the neural representation of speech sounds is categorically organized in the human posterior superior temporal gyrus. Using intracranial high-density cortical surface arrays, we found that listening to synthesized speech stimuli varying in small and acoustically equal steps evoked distinct and invariant cortical population response patterns that were organized by their sensitivities to critical acoustic features. Phonetic category boundaries were similar between neurometric and psychometric functions. Although speech-sound responses were distributed, spatially discrete cortical loci were found to underlie specific phonetic discrimination. Our results provide direct evidence for acoustic-to–higher order phonetic level encoding of speech sounds in human language receptive cortex.

Categorical speech representation in human superior temporal gyrus

Authors:

• Edward F. Chang

• Jochem W. Rieger

• Keith Johnson

• Mitchel S. Berger

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2010

PubMed: 20890293

View PDF

Abstract:

Speech perception requires the rapid and effortless extraction of meaningful phonetic information from a highly variable acoustic signal. A powerful example of this phenomenon is categorical speech perception, in which a continuum of acoustically varying sounds is transformed into perceptually distinct phoneme categories. We found that the neural representation of speech sounds is categorically organized in the human posterior superior temporal gyrus. Using intracranial high-density cortical surface arrays, we found that listening to synthesized speech stimuli varying in small and acoustically equal steps evoked distinct and invariant cortical population response patterns that were organized by their sensitivities to critical acoustic features. Phonetic category boundaries were similar between neurometric and psychometric functions. Although speech-sound responses were distributed, spatially discrete cortical loci were found to underlie specific phonetic discrimination. Our results provide direct evidence for acoustic-to–higher order phonetic level encoding of speech sounds in human language receptive cortex.

Sub-centimeter language organization in the human temporal lobe

Authors:

• Adeen Flinker

• Edward F. Chang

• Nicholas M. Barbaro

• Mitchel S. Berger

• Robert T. Knight

Date: 2010

DOI: 10.1016/j.bandl.2010.09.009

PubMed: 20961611

View PDF

Abstract:

The human temporal lobe is well known to be critical for language comprehension. Previous physiological research has focused mainly on non-invasive neuroimaging and electrophysiological techniques with each approach requiring averaging across many trials and subjects. The results of these studies have implicated extended anatomical regions in peri-sylvian cortex in speech perception. These non-invasive studies typically report a spatially homogenous functional pattern of activity across several centimeters of cortex. We examined the spatiotemporal dynamics of word processing using electrophysiological signals acquired from high-density electrode arrays (4mm spacing) placed directly on the human temporal lobe. Electrocorticographic (ECoG) activity revealed a rich mosaic of language activity, which was functionally distinct at four mm separation. Cortical sites responding specifically to word and not phoneme stimuli were surrounded by sites that responded to both words and phonemes. Other sub-regions of the temporal lobe responded robustly to self-produced speech and minimally to external stimuli while surrounding sites at 4mm distance exhibited an inverse pattern of activation. These data provide evidence for temporal lobe specificity to words as well as self-produced speech. Furthermore, the results provide evidence that cortical processing in the temporal lobe is not spatially homogenous over centimeters of cortex. Rather, language processing is supported by independent and spatially distinct functional sub-regions of cortex at a resolution of at least 4mm.

Spatiotemporal imaging of cortical activation during verb generation and picture naming

Authors:

• Erik Edwards

• Srikantan S. Nagarajan

• Sarang S. Dalal

• Ryan T. Canolty

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2010

DOI: 10.1016/j.neuroimage.2009.12.035.

PubMed: 20026224

View PDF

Abstract:

One hundred and fifty years of neurolinguistic research has identified the key structures in the human brain that support language. However, neither the classic neuropsychological approaches introduced by Broca (1861) and Wernicke (1874), nor modern neuroimaging employing PET and fMRI has been able to delineate the temporal flow of language processing in the human brain. We recorded the electrocorticogram (ECoG) from indwelling electrodes over left hemisphere language cortices during two common language tasks, verb generation and picture naming. We observed that the very high frequencies of the ECoG (high-gamma, 70–160 Hz) track language processing with spatial and temporal precision. Serial progression of activations is seen at a larger timescale, showing distinct stages of perception, semantic association/selection, and speech production. Within the areas supporting each of these larger processing stages, parallel (or “incremental”) processing is observed. In addition to the traditional posterior vs. anterior localization for speech perception vs. production, we provide novel evidence for the role of premotor cortex in speech perception and of Wernicke’s and surrounding cortex in speech production. The data are discussed with regards to current leading models of speech perception and production, and a “dual ventral stream” hybrid of leading speech perception models is given.

Cortical spatiotemporal dynamics underlying phonological target detection in humans

Authors:

• Edward F. Chang

• Erik Edwards

• Srikantan S. Nagarajan

• Noa Fogelson

• Sarang S. Dalal

• Ryan T. Canolty

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2010

DOI: 10.1162/jocn.2010.21466

PubMed: 20465359

View PDF

Abstract:

Selective processing of task-relevant stimuli is critical for goal-directed behavior. We used electrocorticography to assess the spatio-temporal dynamics of cortical activation during a simple phonological target detection task, in which subjects press a button when a prespecified target syllable sound is heard. Simultaneous surface potential recordings during this task revealed a highly ordered temporal progression of high gamma (HG, 70–200 Hz) activity across the lateral hemisphere in less than 1 sec. The sequence demonstrated concurrent regional sensory processing of speech syllables in the posterior superior temporal gyrus (STG) and speech motor cortex, and then transitioned to sequential task-dependent processing from prefrontal cortex (PFC), to the final motor response in the hand sensorimotor cortex. STG activation was modestly enhanced for target over nontarget sounds, supporting a selective gain mechanism in early sensory processing, whereas PFC was entirely selective to targets, supporting its role in guiding response behavior. These results reveal that target detection is not a single cognitive event, but rather a process of progressive target selectivity that involves large-scale rapid parallel and serial processing in sensory, cognitive, and motor structures to support goal-directed human behavior.

Cortical representation of ipsilateral arm movements in monkey and man

Authors:

• Karunesh Ganguly

• Lavi Secundo

• Gireeja Ranade

• Amy Orsborn

• Edward F. Chang

• Dragan F. Dimitrov

• Johnathan D. Wallis

• Nicholas M. Barbaro

• Robert T. Knight

• Jose M. Carmena

Date: 2009

DOI: 10.1523/JNEUROSCI.2471-09.2009

PubMed: 19828809

View PDF

Abstract:

A fundamental organizational principle of the primate motor system is cortical control of contralateral limb movements. Motor areas also appear to play a role in the control of ipsilateral limb movements. Several studies in monkeys have shown that individual neurons in primary motor cortex (M1) may represent, on average, the direction of movements of the ipsilateral arm. Given the increasing body of evidence demonstrating that neural ensembles can reliably represent information with a high temporal resolution, here we characterize the distributed neural representation of ipsilateral upper limb kinematics in both monkey and man. In two macaque monkeys trained to perform center-outreaching movements, we found thatthe ensemble spiking activity in M1 could continuously representipsilateral limb position. Interestingly, this representation was more correlated with joint angles than hand position. Using bilateral electromyography recordings, we excluded the possibility that postural or mirror movements could exclusively account for these findings. In addition, linear methods could decode limb position from cortical field potentials in both monkeys. We also found that M1 spiking activity could control a biomimetic brain–machine interface reflecting ipsilateral kinematics. Finally, we recorded cortical field potentials from three human subjects and also consistently found evidence of a neural representation for ipsilateral movement parameters. Together, our results demonstrate the presence of a high-fidelity neural representation for ipsilateral movement and illustrates that it can be successfully incorporated into a brain–machine interface.

Localization of neurosurgically implanted electrodes via photograph–MRI–radiograph coregistration

Authors:

• Sarang S. Dalal

• Erik Edwards

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Robert T. Knight

• Srikantan S. Nagarajan

Date: 2008

DOI: 10.1016/j.jneumeth.2008.06.028

PubMed: 18657573

View PDF

Abstract:

Intracranial electroencephalography (iEEG) is clinically indicated for medically refractory epilepsy and is a promising approach for developing neural prosthetics. These recordings also provide valuable data for cognitive neuroscience research. Accurate localization of iEEG electrodes is essential for evaluating specific brain regions underlying the electrodes that indicate normal or pathological activity, as well as for relating research findings to neuroimaging and lesion studies. However, electrodes are frequently tucked underneath the edge of a craniotomy, inserted via a burr hole, or placed deep within the brain, where their locations cannot be verified visually or with neuronavigational systems. We show that one existing method, registration of postimplant computed tomography (CT) with preoperative magnetic resonance imaging (MRI), can result in errors exceeding 1 cm. We present a novel method for localizing iEEG electrodes using routinely acquired surgical photographs, X-ray radiographs, and magnetic resonance imaging scans. Known control points are used to compute projective transforms that link the different image sets, ultimately allowing hidden electrodes to be localized, in addition to refining the location of manually registered visible electrodes. As the technique does not require any calibration between the different image modalities, it can be applied to existing image databases. The final result is a set of electrode positions on the patient’s rendered MRI yielding locations relative to sulcal and gyral landmarks on individual anatomy, as well as MNI coordinates. We demonstrate the results of our method in eight epilepsy patients implanted with electrode grids spanning the left hemisphere.

Five-dimensional neuroimaging: localization of the time-frequency dynamics of cortical activity

Authors:

• Sarang S. Dalal

• Adrian G. Guggisberg

• Erik Edwards

• Kensuke Sekihara

• Anne M. Findlay

• Ryan T. Canolty

• Mitchel S. Berger

• Robert T. Knight

• Nicholas M. Barbaro

• Heidi E. Kirsch

• Srikantan S. Nagarajan

Date: 2008

DOI: 10.1016/j.neuroimage.2008.01.023

PubMed: 18356081

View PDF

Abstract:

The spatiotemporal dynamics of cortical oscillations across human brain regions remain poorly understood because of a lack of adequately validated methods for reconstructing such activity from noninvasive electrophysiological data. In this paper, we present a novel adaptive spatial filtering algorithm optimized for robust source time– frequency reconstruction from magnetoencephalography (MEG) and electroencephalography (EEG) data. The efficacy of the method is demonstrated with simulated sources and is also applied to real MEG data from a self-paced finger movement task. The algorithm reliably reveals modulations both in the beta band (12–30 Hz) and high gamma band (65–90 Hz) in sensorimotor cortex. The performance is validated by both across-subjects statistical comparisons and by intracranial electrocorticography (ECoG) data from two epilepsy patients. Inter- estingly, we also reliably observed high frequency activity (30–300 Hz) in the cerebellum, although with variable locations and frequencies across subjects. The proposed algorithm is highly parallelizable and runs efficiently on modern high-performance computing clusters. This method enables the ultimate promise of MEG and EEG for five- dimensional imaging of space, time, and frequency activity in the brain and renders it applicable for widespread studies of human cortical dynamics during cognition.

Spatiotemporal dynamics of word processing in the human brain

Authors:

• Ryan T. Canolty

• Maryam Soltani

• Sarang S. Dalal

• Erik Edwards

• Nina F. Dronkers

• Srikantan S. Nagarajan

• Heidi E. Kirsch

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2007

PubMed: 18982128

View PDF

Abstract:

We examined the spatiotemporal dynamics of word processing by recording the electrocorticogram (ECoG) from the lateral frontotemporal cortex of neurosurgical patients chronically implanted with subdural electrode grids. Subjects engaged in a target detection task where proper names served as infrequent targets embedded in a stream of task-irrelevant verbs and nonwords. Verbs described actions related to the hand (e.g, throw) or mouth (e.g., blow), while unintelligible nonwords were sounds which matched the verbs in duration, intensity, temporal modulation, and power spectrum. Complex oscillatory dynamics were observed in the delta, theta, alpha, beta, low, and high gamma (HG) bands in response to presentation of all stimulus types. HG activity (80-200 Hz) in the ECoG tracked the spatiotemporal dynamics of word processing and identified a network of cortical structures involved in early word processing. HG was used to determine the relative onset, peak, and offset times of local cortical activation during word processing. Listening to verbs compared to nonwords sequentially activates first the posterior superior temporal gyrus (post-STG), then the middle superior temporal gyrus (mid-STG), followed by the superior temporal sulcus (STS). We also observed strong phase-locking between pairs of electrodes in the theta band, with weaker phase-locking occurring in the delta, alpha, and beta frequency ranges. These results provide details on the first few hundred milliseconds of the spatiotemporal evolution of cortical activity during word processing and provide evidence consistent with the hypothesis that an oscillatory hierarchy coordinates the flow of information between distinct cortical regions during goal-directed behavior.

Spatial localization of cortical time-frequency dynamics

Authors:

• Sarang S. Dalal

• Adrian G. Guggisberg

• Erik Edwards

• Kensuke Sekihara

• Anne M. Findlay

• Ryan T. Canolty

• Robert T. Knight

• Nicholas M. Barbaro

• Heidi E. Kirsch

• Srikantan S. Nagarajan

Date: 2007

PubMed: 18003115

View PDF

Abstract:

The spatiotemporal dynamics of cortical oscillations across human brain regions remain poorly understood because of a lack of adequately validated methods for reconstructing such activity from noninvasive electrophysiological data. We present a novel adaptive spatial filtering algorithm optimized for robust source time-frequency reconstruction from magnetoencephalography (MEG) and electroencephalography (EEG) data. The efficacy of the method is demonstrated with real MEG data from a self-paced finger movement task. The algorithm reliably reveals modulations both in the beta band (12-30 Hz) and a high gamma band (65-90 Hz) in sensorimotor cortex. The performance is validated by both across-subjects statistical comparisons and by intracranial electrocorticography (ECoG) data from two epilepsy patients. We also revealed observed high gamma activity in the cerebellum. The proposed algorithm is highly parallelizable and runs efficiently on modern high performance computing clusters. This method enables non-invasive five-dimensional imaging of space, time, and frequency activity in the brain and renders it applicable for widespread studies of human cortical dynamics.

High Gamma Power is Phase-Locked to Theta Oscillations in Human Neocortex

Authors:

• Ryan T. Canolty

• Erik Edwards

• Sarang S. Dalal

• Maryam Soltani

• Srikantan S. Nagarajan

• Heidi E. Kirsch

• Mitchel S. Berger

• Nicholas M. Barbaro

• Robert T. Knight

Date: 2006

PubMed: 16973878

View PDF

Abstract:

We observed robust coupling between the high- and low-frequency bands of ongoing electrical activity in the human brain. In particular, the phase of the low-frequency theta (4 to 8 hertz) rhythm modulates power in the high gamma (80 to 150 hertz) band of the electrocorticogram, with stronger modulation occurring at higher theta amplitudes. Furthermore, different behavioral tasks evoke distinct patterns of theta/high gamma coupling across the cortex. The results indicate that transient coupling between low- and high-frequency brain rhythms coordinates activity in distributed cortical areas, providing a mechanism for effective communication during cognitive processing in humans.