150 Psychologie
Refine
Year of publication
Document Type
- Preprint (112) (remove)
Has Fulltext
- yes (112)
Is part of the Bibliography
- no (112) (remove)
Keywords
- Deutschland (2)
- collaboration script (2)
- natural scenes (2)
- neuronal populations (2)
- primary visual cortex (2)
- referential communication (2)
- stimulus encoding (2)
- visual attention (2)
- Adjustment (1)
- Adulthood (1)
- Anpassung (1)
- Aufsatzsammlung (1)
- College Students (1)
- College Teachers (1)
- Computational model (1)
- Computer Mediated Communication (1)
- Computervermittelte Kommunikation (1)
- Cortical column (1)
- Die kluge Bauerntochter (1)
- Erwachsenenalter (1)
- Frankfurt am Main (1)
- Germany (1)
- Grimm, Jacob (1)
- Grimm, Wilhelm (1)
- Hochschuldidaktik (1)
- Hochschullehrer (1)
- Hypercolumn (1)
- Language (1)
- Lehrer-Schüler-Interaktion (1)
- Lehrerbildung (1)
- Lehrermerkmale (1)
- Liebesbrief (1)
- Märchen (1)
- Neural map (1)
- Object recognition (1)
- Optimal wiring (1)
- Orientation preference (1)
- Pinwheel (1)
- Praxis (1)
- Scene context effects (1)
- Schüler- und Studierendeneinstellungen (1)
- Sprache (1)
- Student Attitudes (1)
- Studentenschaft (1)
- Studienverhalten (1)
- Studierende (Anfangssemester) (1)
- Studium (1)
- Teacher Characteristics (1)
- Teacher Student Interaction (1)
- Tiefenpsychologie (1)
- Viewpoint dependence (1)
- Visual cortex (1)
- Zweierbeziehung (1)
- change blindness (1)
- cognitive demands (1)
- episodic memory (1)
- functional connectivity (1)
- general cognitive ability (1)
- machine learning (1)
- prediction error (1)
- predictive modelling (1)
- predictive processing (1)
- remote collaboration (1)
- resting state (1)
- shared application (1)
- time pressure (1)
Institute
- Ernst Strüngmann Institut (48)
- Psychologie (44)
- MPI für Hirnforschung (32)
- Frankfurt Institute for Advanced Studies (FIAS) (22)
- Medizin (10)
- MPI für empirische Ästhetik (7)
- Starker Start ins Studium: Qualitätspakt Lehre (5)
- Informatik (3)
- Biowissenschaften (1)
- Deutsches Institut für Internationale Pädagogische Forschung (DIPF) (1)
Generating predictions about environmental regularities, relying on these predictions, and updating these predictions when there is a violation from incoming sensory evidence are considered crucial functions of our cognitive system for being adaptive in the future. The violation of a prediction can result in a prediction error (PE) which affects subsequent memory processing. In our preregistered studies, we examined the effects of different levels of PE on episodic memory. Participants were asked to generate predictions about the associations between sequentially presented cue-target pairs, which were violated later with individual items in three PE levels, namely low, medium, and high PE. Hereafter, participants were asked to provide old/new judgments on the items with confidence ratings, and to retrieve the paired cues. Our results indicated a better recognition memory for low PE than medium and high PE levels, suggesting a memory congruency effect. On the other hand, there was no evidence of memory benefit for high PE level. Together, these novel and coherent findings strongly suggest that high PE does not guarantee better memory.
From early to middle childhood, brain regions that underlie memory consolidation undergo profound maturational changes. However, there is little empirical investigation that directly relates age-related differences in brain structural measures to the memory consolidation processes. The present study examined system-level memory consolidations of intentionally studied object-location associations after one night of sleep (short delay) and after two weeks (long delay) in normally developing 5-to-7-year-old children (n = 50) and young adults (n = 39). Behavioural differences in memory consolidation were related to structural brain measures. Our results showed that children, in comparison to young adults, consolidate correctly learnt object-location associations less robustly over short and long delay. Moreover, using partial least squares correlation method, a unique multivariate profile comprised of specific neocortical (prefrontal, parietal, and occipital), cerebellar, and hippocampal subfield structures was found to be associated with variation in short-delay memory consolidation. A different multivariate profile comprised of a reduced set of brain structures, mainly consisting of neocortical (prefrontal, parietal, and occipital), and selective hippocampal subfield structures (CA1-2 and subiculum) was associated with variation in long-delay memory consolidation. Taken together, the results suggest that multivariate structural pattern of unique sets of brain regions are related to variations in short- and long-delay memory consolidation across children and young adults.
RESEARCH HIGHLIGHTS
* Short- and long-delay memory consolidation is less robust in children than in young adults
* Short-delay brain profile comprised of hippocampal, cerebellar, and neocortical brain regions
* Long-delay brain profile comprised of neocortical and selected hippocampal brain regions.
* Brain profiles differ between children and young adults.
From early to middle childhood, brain regions that underlie memory consolidation undergo profound maturational changes. However, there is little empirical investigation that directly relates age-related differences in brain structural measures to the memory consolidation processes. The present study examined system-level memory consolidations of intentionally studied object-location associations after one night of sleep (short delay) and after two weeks (long delay) in normally developing 5-to-7-year-old children (n = 50) and young adults (n = 39). Behavioural differences in memory consolidation were related to structural brain measures. Our results showed that children, in comparison to young adults, consolidate correctly learnt object-location associations less robustly over short and long delay. Moreover, using partial least squares correlation method, a unique multivariate profile comprised of specific neocortical (prefrontal, parietal, and occipital), cerebellar, and hippocampal subfield structures was found to be associated with variation in short-delay memory consolidation. A different multivariate profile comprised of a reduced set of brain structures, mainly consisting of neocortical (prefrontal, parietal, and occipital), and selective hippocampal subfield structures (CA1-2 and subiculum) was associated with variation in long-delay memory consolidation. Taken together, the results suggest that multivariate structural pattern of unique sets of brain regions are related to variations in short- and long-delay memory consolidation across children and young adults.
RESEARCH HIGHLIGHTS
Short- and long-delay memory consolidation is less robust in children than in young adults
* Short-delay brain profile comprised of hippocampal, cerebellar, and neocortical brain regions
* Long-delay brain profile comprised of neocortical and selected hippocampal brain regions.
* Brain profiles differ between children and young adults.
Memory consolidation tends to be less robust in childhood than adulthood. However, little is known about the corresponding functional differences in the developing brain that may underlie age-related differences in retention of memories over time. This study examined system-level memory consolidation of object-scene associations after learning (immediate delay), one night of sleep (short delay), as well as two weeks (long delay) in 5-to-7-year-old children (n = 49) and in young adults (n = 39), as a reference group with mature consolidation systems. Particularly, we characterized how functional neural activation and reinstatement of neural patterns change over time, assessed by functional magnetic resonance imaging combined with representational similarity analysis (RSA). Our results showed that memory consolidation in children was less robust and strong (i.e., more forgetting) compared to young adults. Contrasting correctly retained remote versus recent memories across time delay, children showed less upregulation in posterior parahippocampal gyrus, lateral occipital cortex, and cerebellum than adults. In addition, both children and adults showed decrease in scene-specific neural reinstatement over time, indicating time-related decay of detailed differentiated memories. At the same time, we observed more generic gist-like neural reinstatement in medial-temporal and prefrontal brain regions uniquely in children, indicating qualitative difference in memory trace in children. Taken together, 5-to-7-year-old children, compared to young adults, show less robust memory consolidation, possibly due to difficulties in engaging in differentiated neural reinstatement in neocortical mnemonic regions during retrieval of remote memories, coupled with relying more on gist-like generic neural reinstatement.
Memory consolidation tends to be less robust in childhood than adulthood. However, little is known about the corresponding functional differences in the developing brain that may underlie age-related differences in retention of memories over time. This study examined system-level memory consolidation of object-scene associations after learning (immediate delay), one night of sleep (short delay), as well as two weeks (long delay) in 5-to-7-year-old children (n = 49) and in young adults (n = 39), as a reference group with mature consolidation systems. Particularly, we characterized how functional neural activation and reinstatement of neural patterns change over time, assessed by functional magnetic resonance imaging combined with representational (dis)similarity analysis (RSA). Our results showed that memory consolidation in children was less robust (i.e., more forgetting) compared to young adults. For correctly retained remote memories, young adults showed increased neural activation from short to long delay in neocortical (parietal, prefrontal and occipital) and cerebellar brain regions, while children showed increased neural activation in prefrontal and decrease in neural activity in parietal brain regions over time. In addition, there was an overall attenuated scene-specific memory reinstatement of neural patterns in children compared to young adults. At the same time, we observed category-based reinstatement in medial-temporal, neocortical (prefrontal and parietal), and cerebellar brain regions only in children. Taken together, 5-to-7-year-old children, compared to young adults, show less robust memory consolidation, possibly due to difficulties in engaging in differentiated neural reinstatement in neocortical mnemonic regions during retrieval of remote memories, coupled with relying more on gist-like, category-based neural reinstatement.
Efficient processing of visual environment necessitates the integration of incoming sensory evidence with concurrent contextual inputs and mnemonic content from our past experiences. To delineate how this integration takes place in the brain, we studied modulations of feedback neural patterns in non-stimulated areas of the early visual cortex in humans (i.e., V1 and V2). Using functional magnetic resonance imaging and multivariate pattern analysis, we show that both, concurrent contextual and time-distant mnemonic information, coexist in V1/V2 as feedback signals. The extent to which mnemonic information is reinstated in V1/V2 depends on whether the information is retrieved episodically or semantically. These results demonstrate that our stream of visual experience contains not just information from the visual surrounding, but also memory-based predictions internally generated in the brain.
Human functional brain connectivity can be temporally decomposed into states of high and low cofluctuation, defined as coactivation of brain regions over time. Rare states of particularly high cofluctuation have been shown to reflect fundamentals of intrinsic functional network architecture and to be highly subject-specific. However, it is unclear whether such network-defining states also contribute to individual variations in cognitive abilities – which strongly rely on the interactions among distributed brain regions. By introducing CMEP, a new eigenvector-based prediction framework, we show that as few as 16 temporally separated time frames (< 1.5% of 10min resting-state fMRI) can significantly predict individual differences in intelligence (N = 263, p < .001). Against previous expectations, individual’s network-defining time frames of particularly high cofluctuation do not predict intelligence. Multiple functional brain networks contribute to the prediction, and all results replicate in an independent sample (N = 831). Our results suggest that although fundamentals of person-specific functional connectomes can be derived from few time frames of highest connectivity, temporally distributed information is necessary to extract information about cognitive abilities. This information is not restricted to specific connectivity states, like network-defining high-cofluctuation states, but rather reflected across the entire length of the brain connectivity time series.
Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1,000 short (3s) naturalistic video clips of visual events across ten human subjects. We use the videos’ extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.
Understanding effects of emotional valence and stress on children’s memory is important for educational and legal contexts. This study disentangles the effects of emotional content of to-be-remembered information (i.e., items differing in emotional valence and arousal), stress exposure, and associated cortisol secretion on children’s memory. We also examine whether girls’ memory is more affected by stress induction. 143 6-to-7-year-old children were randomly allocated to the Trier Social Stress Test for Children (n = 103) or a control condition (n = 40). 25 minutes after stressor onset, children incidentally encoded 75 objects varying in emotional valence (crossed with arousal) together with neutral scene backgrounds. We found that response-bias corrected memory was worse for low arousing negative items than neutral and positive items, with the latter two categories not being different from each other. Whilst boys’ memory was largely unaffected by stress, girls in the stress condition showed worse memory for negative items, especially the low arousing ones, than girls in the control condition. Girls, compared to boys, reported higher subjective stress increases following stress exposure, and had higher cortisol stress responses. Whilst a higher cortisol stress response was associated with better emotional memory in girls in the stress condition, boys’ memory was not associated with their cortisol secretion. Taken together, our study suggests that 6-to-7-year-old children, more so girls, show memory suppression for negative information. Girls’ memory for negative information, compared to boys, is also more strongly modulated by stress experience and the associated cortisol response.
Rhythmic neural spiking and attentional sampling arising from cortical receptive field interactions
(2018)
Summary: Growing evidence suggests that distributed spatial attention may invoke theta (3-9 Hz) rhythmic sampling processes. The neuronal basis of such attentional sampling is however not fully understood. Here we show using array recordings in visual cortical area V4 of two awake macaques that presenting separate visual stimuli to the excitatory center and suppressive surround of neuronal receptive fields elicits rhythmic multi-unit activity (MUA) at 3-6 Hz. This neuronal rhythm did not depend on small fixational eye movements. In the context of a distributed spatial attention task, during which the monkeys detected a spatially and temporally uncertain target, reaction times (RT) exhibited similar rhythmic fluctuations. RTs were fast or slow depending on the target occurrence during high or low MUA, resulting in rhythmic MUA-RT cross-correlations at at theta frequencies. These findings suggest that theta-rhythmic neuronal activity arises from competitive receptive field interactions and that this rhythm may subserve attentional sampling.
Highlights:
* Center-surround interactions induce theta-rhythmic MUA of visual cortex neurons
* The MUA rhythm does not depend on small fixational eye movements
* Reaction time fluctuations lock to the neuronal rhythm under distributed attention
Can prediction error explain predictability effects on the N1 during picture-word verification?
(2024)
Do early effects of predictability in visual word recognition reflect prediction error? Electrophysiological research investigating word processing has demonstrated predictability effects in the N1, or first negative component of the event-related potential (ERP). However, findings regarding the magnitude of effects and potential interactions of predictability with lexical variables have been inconsistent. Moreover, past studies have typically used categorical designs with relatively small samples and relied on by-participant analyses. Nevertheless, reports have generally shown that predicted words elicit less negative-going (i.e., lower amplitude) N1s, a pattern consistent with a simple predictive coding account. In our preregistered study, we tested this account via the interaction between prediction magnitude and certainty. A picture-word verification paradigm was implemented in which pictures were followed by tightly matched picture-congruent or picture-incongruent written nouns. The predictability of target (picture-congruent) nouns was manipulated continuously based on norms of association between a picture and its name. ERPs from 68 participants revealed a pattern of effects opposite to that expected under a simple predictive coding framework.
The hippocampal-dependent memory system and striatal-dependent memory system modulate reinforcement learning depending on feedback timing in adults, but their contributions during development remain unclear. In a 2-year longitudinal study, 6-to-7-year-old children performed a reinforcement learning task in which they received feedback immediately or with a short delay following their response. Children’s learning was found to be sensitive to feedback timing modulations in their reaction time and inverse temperature parameter, which quantifies value-guided decision-making. They showed longitudinal improvements towards more optimal value-based learning, and their hippocampal volume showed protracted maturation. Better delayed model-derived learning covaried with larger hippocampal volume longitudinally, in line with the adult literature. In contrast, a larger striatal volume in children was associated with both better immediate and delayed model-derived learning longitudinally. These findings show, for the first time, an early hippocampal contribution to the dynamic development of reinforcement learning in middle childhood, with neurally less differentiated and more cooperative memory systems than in adults.
The hippocampal-dependent memory system and striatal-dependent memory system modulate reinforcement learning depending on feedback timing in adults, but their contributions during development remain unclear. In a 2-year longitudinal study, 6-to-7-year-old children performed a reinforcement learning task in which they received feedback immediately or with a short delay following their response. Children’s learning was found to be sensitive to feedback timing modulations in their reaction time and inverse temperature parameter, which quantifies value-guided decision-making. They showed longitudinal improvements towards more optimal value-based learning, and their hippocampal volume showed protracted maturation. Better delayed model-derived learning covaried with larger hippocampal volume longitudinally, in line with the adult literature. In contrast, a larger striatal volume in children was associated with both better immediate and delayed model-derived learning longitudinally. These findings show, for the first time, an early hippocampal contribution to the dynamic development of reinforcement learning in middle childhood, with neurally less differentiated and more cooperative memory systems than in adults.
The hippocampal-dependent memory system and striatal-dependent memory system modulate reinforcement learning depending on feedback timing in adults, but their contributions during development remain unclear. In a 2-year longitudinal study, 6-to-7-year-old children performed a reinforcement learning task in which they received feedback immediately or with a short delay following their response. Children’s learning was found to be sensitive to feedback timing modulations in their reaction time and inverse temperature parameter, which quantifies value-guided decision-making. They showed longitudinal improvements towards more optimal value-based learning, and their hippocampal volume showed protracted maturation. Better delayed model-derived learning covaried with larger hippocampal volume longitudinally, in line with the adult literature. In contrast, a larger striatal volume in children was associated with both better immediate and delayed model-derived learning longitudinally. These findings show, for the first time, an early hippocampal contribution to the dynamic development of reinforcement learning in middle childhood, with neurally less differentiated and more cooperative memory systems than in adults.
The hippocampal-dependent memory system and striatal-dependent memory system modulate reinforcement learning depending on feedback timing in adults, but their contributions during development remain unclear. In a 2-year longitudinal study, 6-to-7-year-old children performed a reinforcement learning task in which they received feedback immediately or with a short delay following their response. Children’s learning was found to be sensitive to feedback timing modulations in their reaction time and inverse temperature parameter, which quantifies value-guided decision-making. They showed longitudinal improvements towards more optimal value-based learning, and their hippocampal volume showed protracted maturation. Better delayed model-derived learning covaried with larger hippocampal volume longitudinally, in line with the adult literature. In contrast, a larger striatal volume in children was associated with both better immediate and delayed model-derived learning longitudinally. These findings show, for the first time, an early hippocampal contribution to the dynamic development of reinforcement learning in middle childhood, with neurally less differentiated and more cooperative memory systems than in adults.
Metacognition plays a pivotal role in human development. The ability to realize that we do not know something, or meta-ignorance, emerges after approximately five years of age. We aimed at identifying the brain systems that underlie the developmental emergence of this ability in a preschool sample.
Twenty-four children aged between five and six years answered questions under three conditions of a meta-ignorance task twice. In the critical partial knowledge condition, an experimenter first showed two toys to a child, then announced that she would place one of them in a box behind a screen, out of sight from the child. The experimenter then asked the child whether or not she knew which toy was in the box.
Children who answered correctly both times to the metacognitive question in the partial knowledge condition (n=9) showed greater cortical thickness in a cluster within left medial orbitofrontal cortex than children who did not (n=15). Further, seed-based functional connectivity analyses of the brain during resting state revealed that this region is functionally connected to the medial orbitofrontal gyrus, posterior cingulate gyrus and precuneus, and mid- and inferior temporal gyri.
This finding suggests that the default mode network, critically through its prefrontal regions, supports introspective processing. It leads to the emergence of metacognitive monitoring allowing children to explicitly report their own ignorance.
Spontaneous brain activity builds the foundation for human cognitive processing during external demands. Neuroimaging studies based on functional magnetic resonance imaging (fMRI) identified specific characteristics of spontaneous (intrinsic) brain dynamics to be associated with individual differences in general cognitive ability, i.e., intelligence. However, fMRI research is inherently limited by low temporal resolution, thus, preventing conclusions about neural fluctuations within the range of milliseconds. Here, we used resting-state electroencephalographical (EEG) recordings from 144 healthy adults to test whether individual differences in intelligence (Raven’s Advanced Progressive Matrices scores) can be predicted from the complexity of temporally highly resolved intrinsic brain signals. We compared different operationalizations of brain signal complexity (multiscale entropy, Shannon entropy, Fuzzy entropy, and specific characteristics of microstates) regarding their relation to intelligence. The results indicate that associations between brain signal complexity measures and intelligence are of small effect sizes (r ~ .20) and vary across different spatial and temporal scales. Specifically, higher intelligence scores were associated with lower complexity in local aspects of neural processing, and less activity in task-negative brain regions belonging to the defaultmode network. Finally, we combined multiple measures of brain signal complexity to show that individual intelligence scores can be significantly predicted with a multimodal model within the sample (10-fold cross-validation) as well as in an independent sample (external replication, N = 57). In sum, our results highlight the temporal and spatial dependency of associations between intelligence and intrinsic brain dynamics, proposing multimodal approaches as promising means for future neuroscientific research on complex human traits.
Significance Statement Spontaneous brain activity builds the foundation for intelligent processing - the ability of humans to adapt to various cognitive demands. Using resting-state EEG, we extracted multiple aspects of temporally highly resolved intrinsic brain dynamics to investigate their relationship with individual differences in intelligence. Single associations were of small effect sizes and varied critically across spatial and temporal scales. However, combining multiple measures in a multimodal cross-validated prediction model, allows to significantly predict individual intelligence scores in unseen participants. Our study adds to a growing body of research suggesting that observable associations between complex human traits and neural parameters might be rather small and proposes multimodal prediction approaches as promising tool to derive robust brain-behavior relations despite limited sample sizes.
Adaptive threshold estimation procedures sample close to a subject’s perceptual threshold by dynamically adapting the stimulation based on the subject’s performance. Yet, perceptual thresholds not only depend on the observers’ sensory capabilities but also on any bias in terms of their expectations and response preferences, thus distorting the precision of the threshold estimates. Using the framework of signal detection theory (SDT), independent estimates of both, an observer’s sensitivity and internal processing bias can be delineated from threshold estimates. While this approach is commonly available for estimation procedures engaging the method of constant stimuli (MCS), correction procedures for adaptive methods (AM) are only scarcely applied. In this article, we introduce a new AM that takes individual biases into account, and that allows for a bias-corrected assessment of subjects’ sensitivity. This novel AM is validated with simulations and compared to a typical MCS-procedure, for which the implementation of bias correction has been previously demonstrated.
Comparing AM and MCS demonstrates the viability of the presented AM. Besides its feasibility, the results of the simulation reveal both, advantages, and limitations of the proposed AM. The procedure has considerable practical implications, in particular for the design of shaping procedures in sensory training experiments, in which task difficulty has to be constantly adapted to an observer’s performance, to improve training efficiency.
In a dynamic environment, the already limited information that human working memory can maintain needs to be constantly updated to optimally guide behaviour. Indeed, previous studies showed that working memory representations are continuously being transformed during delay periods leading up to a response. This goes hand-in-hand with the removal of task-irrelevant items. However, does such removal also include veridical, original stimuli, as they were prior to transformation? Here we aimed to assess the neural representation of task-relevant transformed representations, compared to the no-longer-relevant veridical representations they originated from. We applied multivariate pattern analysis to electroencephalographic data during maintenance of orientation gratings with and without mental rotation. During maintenance, we perturbed the representational network by means of a visual impulse stimulus, and were thus able to successfully decode veridical as well as imaginary, transformed orientation gratings from impulse-driven activity. On the one hand, the impulse response reflected only task-relevant (cued), but not task-irrelevant (uncued) items, suggesting that the latter were quickly discarded from working memory. By contrast, even though the original cued orientation gratings were also no longer task-relevant after mental rotation, these items continued to be represented next to the rotated ones, in different representational formats. This seemingly inefficient use of scarce working memory capacity was associated with reduced probe response times and may thus serve to increase precision and flexibility in guiding behaviour in dynamic environments.
We explore the potential of optically-pumped magnetometers (OPMs) to infer the laminar origins of neural activity non-invasively. OPM sensors can be positioned closer to the scalp than conventional cryogenic MEG sensors, opening an avenue to higher spatial resolution when combined with high-precision forward modelling. By simulating the forward model projection of single dipole sources onto OPM sensor arrays with varying sensor densities and measurement axes, and employing sparse source reconstruction approaches, we find that laminar inference with OPM arrays is possible at relatively low sensor counts at moderate to high signal-to-noise ratios (SNR). We observe improvements in laminar inference with increasing spatial sampling densities and number of measurement axes. Surprisingly, moving sensors closer to the scalp is less advantageous than anticipated - and even detrimental at high SNRs. Biases towards both the superficial and deep surfaces at very low SNRs and a notable bias towards the deep surface when combining empirical Bayesian beamformer (EBB) source reconstruction with a whole-brain analysis pose further challenges. Adequate SNR through appropriate trial numbers and shielding, as well as precise co-registration, is crucial for reliable laminar inference with OPMs.
An important question concerning inter-areal communication in the cortex is whether these interactions are synergistic, i.e. brain signals can either share common information (redundancy) or they can encode complementary information that is only available when both signals are considered together (synergy). Here, we dissociated cortical interactions sharing common information from those encoding complementary information during prediction error processing. To this end, we computed co-information, an information-theoretical measure that distinguishes redundant from synergistic information among brain signals. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics encoded redundant and synergistic information during auditory prediction error processing. In both tasks, we observed multiple patterns of synergy across the entire cortical hierarchy with distinct dynamics. The information conveyed by ERPs and BB signals was highly synergistic even at lower stages of the hierarchy in the auditory cortex, as well as between auditory and frontal regions. Using a brain-constrained neural network, we simulated the spatio-temporal patterns of synergy and redundancy observed in the experimental results and further demonstrated that the emergence of synergy between auditory and frontal regions requires the presence of strong, long-distance, feedback and feedforward connections. These results indicate that the distributed representations of prediction error signals across the cortical hierarchy can be highly synergistic.
An important question concerning inter-areal communication in the cortex is whether these interactions are synergistic, i.e. convey information beyond what can be performed by isolated signals. In other words, any two signals can either share common information (redundancy) or they can encode complementary information that is only available when both signals are considered together (synergy). Here, we dissociated cortical interactions sharing common information from those encoding complementary information during prediction error processing. To this end, we computed co-information, an information-theoretical measure that distinguishes redundant from synergistic information among brain signals. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks, and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics exhibit redundancy and synergy for auditory prediction error signals. We observed multiple patterns of redundancy and synergy across the entire cortical hierarchy with distinct dynamics. The information conveyed by ERPs and BB signals was highly synergistic even at lower stages of the hierarchy in the auditory cortex, as well as between lower and higher areas in the frontal cortex. These results indicate that the distributed representations of prediction error signals across the cortical hierarchy can be highly synergistic.
An important question concerning inter-areal communication in the cortex, is whether these interactions are synergistic, i.e. convey information beyond what can be performed by isolated signals. Here, we dissociated cortical interactions sharing common information from those encoding complementary information during prediction error processing. To this end, we computed co-information, an information-theoretical measure that distinguishes redundant from synergistic information among brain signals. We analyzed auditory and frontal electrocorticography (ECoG) signals in three common awake marmosets and investigated to what extent event-related-potentials (ERP) and broadband (BB) dynamics exhibit redundancy and synergy in auditory prediction error signals. We observed multiple patterns of redundancy and synergy across the entire cortical hierarchy with distinct dynamics. The information conveyed by ERPs and BB signals was highly synergistic even at lower stages of the hierarchy in the auditory cortex, as well as between lower and higher areas in the frontal cortex. These results indicate that the distributed representations of prediction error signals across the cortical hierarchy can be highly synergistic.
Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. Here, we hypothesized that attentional and contextual top-down signals interact in V1, in a manner that primarily benefits the representation of natural visual stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes but, critically, not by synthetic stimuli in which higher-order statistical regularities were eliminated. Population analysis revealed that neuronal responses converged to a low dimensional subspace for natural but not for synthetic images. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the dominant low dimensional subspace, suggesting an alignment between the attentional and natural stimulus variance. The alignment was pronounced for late evoked responses but not for early transient responses of V1 neurons, supporting the notion that top-down feedback was required. We argue that attention and perception share top-down pathways, which mediate hierarchical interactions optimized for natural vision.
Context information supports serial dependence of multiple visual objects across memory episodes
(2019)
Visual perception operates in an object-based manner, by integrating associated features via attention. Working memory allows a flexible access to a limited number of currently relevant objects, even when they are occluded or physically no longer present. Recently, it has been shown that we compensate for small changes of an object’s feature over memory episodes, which can support its perceptual stability. This phenomenon was termed ‘serial dependence’ and has mostly been studied in situations that comprised only a single relevant object. However, since we are typically confronted with situations where several objects have to be perceived and held in working memory, the central question of how we selectively create temporal stability of several objects has remained unsolved. As different objects can be distinguished by their accompanying context features, like their color or temporal position, we tested whether serial dependence is supported by the congruence of context features across memory episodes. Specifically, we asked participants to remember the motion directions of two sequentially presented colored dot fields per trial. At the end of a trial one motion direction was cued for continuous report either by its color (Experiment 1) or serial position (Experiment 2). We observed serial dependence, i.e., an attractive bias of currently toward previously memorized objects, between current and past motion directions that was clearly enhanced when items had the same color or serial position across trials. This bias was particularly pronounced for the context feature that was used for cueing and for the target of the previous trial. Together, these findings demonstrate that coding of current object representations depends on previous representations, especially when they share similar content and context features. Apparently the binding of content and context features is not completely erased after a memory episode, but it is carried over to subsequent episodes. As this reflects temporal dependencies in natural settings, the present findings reveal a mechanism that integrates corresponding bundles of content and context features to support stable representations of individualized objects over time.
We present a model for the autonomous learning of active binocular vision using a recently developed biome-chanical model of the human oculomotor system. The model is formulated in the Active Efficient Coding (AEC) framework, a recent generalization of classic efficient coding theories to active perception. The model simultaneously learns how to efficiently encode binocular images and how to generate accurate vergence eye movements that facilitate efficient encoding of the visual input. In order to resolve the redundancy problem arising from the actuation of the eyes through antagonistic muscle pairs, we consider the metabolic costs associated with eye movements. We show that the model successfully learns to trade off vergence accuracy against the associated metabolic costs, producing high fidelity vergence eye movements obeying Sherrington’s law of reciprocal innervation.
Anticipating future events is a key computational task for neuronal networks. Experimental evidence suggests that reliable temporal sequences in neural activity play a functional role in the association and anticipation of events in time. However, how neurons can differentiate and anticipate multiple spike sequences remains largely unknown. We implement a learning rule based on predictive processing, where neurons exclusively fire for the initial, unpredictable inputs in a spiking sequence, leading to an efficient representation with reduced post-synaptic firing. Combining this mechanism with inhibitory feedback leads to sparse firing in the network, enabling neurons to selectively anticipate different sequences in the input. We demonstrate that intermediate levels of inhibition are optimal to decorrelate neuronal activity and to enable the prediction of future inputs. Notably, each sequence is independently encoded in the sparse, anticipatory firing of the network. Overall, our results demonstrate that the interplay of self-supervised predictive learning rules and inhibitory feedback enables fast and efficient classification of different input sequences.
Representational Similarity Analysis (RSA) is an innovative approach used to compare neural representations across individuals, species and computational models. Despite its popularity within neuroscience, psychology and artificial intelligence, this approach has led to difficult-to-reconcile and contradictory findings, particularly when comparing primate visual representations with deep neural networks (DNNs). Here, we demonstrate how such contradictory findings could arise due to incorrect inferences about mechanism when comparing complex systems processing high-dimensional stimuli. In a series of studies comparing computational models, primate cortex and human cortex we find two problematic phenomena: a “mimic effect”, where confounds in stimuli can lead to high RSA-scores between provably dissimilar systems, and a “modulation effect”, where RSA- scores become dependent on stimuli used for testing. Since our results bear on a number of influential findings, we provide recommendations to avoid these pitfalls and sketch a way forward to a more solid science of representation in cognitive systems.
Some pitfalls of measuring representational similarity using Representational Similarity Analysis
(2022)
A core challenge in cognitive and brain sciences is to assess whether different biological systems represent the world in a similar manner. Representational Similarity Analysis (RSA) is an innovative approach that addresses this problem by looking for a second-order isomorphisim in neural activation patterns. This innovation makes it easy to compare latent representations across individuals, species and computational models, and accounts for its popularity across disciplines ranging from artificial intelligence to computational neuroscience. Despite these successes, using RSA has led to difficult-to-reconcile and contradictory findings, particularly when comparing primate visual representations with deep neural networks (DNNs): even though DNNs have been shown to learn and behave in vastly different ways to humans, comparisons based on RSA have shown striking similarities in some studies. Here, we demonstrate some pitfalls of using RSA and explain how contradictory findings can arise due to false inferences about representational similarity based on RSA-scores. In a series of studies that capture increasingly plausible training and testing scenarios, we compare neural representations in computational models, primate cortex and human cortex. These studies reveal two problematic phenomena that are ubiquitous in current research: a “mimic effect”, where confounds in stimuli can lead to high RSA-scores between provably dissimilar systems, and a “modulation effect”, where RSA-scores become dependent on stimuli used for testing. Since our results bear on a number of influential findings, such as comparisons made between human visual representations and those of primates and DNNs, we provide recommendations to avoid these pitfalls and sketch a way forward to a more solid science of representation in cognitive systems.
The pitfalls of measuring representational similarity using representational similarity analysis
(2022)
A core challenge in cognitive and brain sciences is to assess whether different biological systems represent the world in a similar manner. Representational Similarity Analysis (RSA) is an innovative approach to address this problem and has become increasingly popular across disciplines ranging from artificial intelligence to computational neuroscience. Despite these successes, RSA regularly uncovers difficult-to-reconcile and contradictory findings. Here, we demonstrate the pitfalls of using RSA and explain how contradictory findings arise due to false inferences about representational similarity based on RSA-scores. In a series of studies that capture increasingly plausible training and testing scenarios, we compare neural representations in computational models, primate cortex and human cortex. These studies reveal two problematic phenomena that are ubiquitous in current research: a “mimic” effect, where confounds in stimuli can lead to high RSA-scores between provably dissimilar systems, and a “modulation effect”, where RSA-scores become dependent on stimuli used for testing. Since our results bear on a number of influential findings and the inferences drawn by current practitioners in a wide range of disciplines, we provide recommendations to avoid these pitfalls and sketch a way forward to a more solid science of representation in cognitive systems.
The pitfalls of measuring representational similarity using representational similarity analysis
(2022)
A core challenge in neuroscience is to assess whether diverse systems represent the world similarly. Representational Similarity Analysis (RSA) is an innovative approach to address this problem and has become increasingly popular across disciplines from machine learning to computational neuroscience. Despite these successes, RSA regularly uncovers difficult-to-reconcile and contradictory findings. Here we demonstrate the pitfalls of using RSA to infer representational similarity and explain how contradictory findings arise and support false inferences when left unchecked. By comparing neural representations in primate, human and computational models, we reveal two problematic phenomena that are ubiquitous in current research: a “mimic” effect, where confounds in stimuli can lead to high RSA scores between provably dissimilar systems, and a “modulation effect”, where RSA-scores become dependent on stimuli used for testing. Since our results bear on existing findings and inferences, we provide recommendations to avoid these pitfalls and sketch a way forward.
Objects that are congruent with a scene are recognised more efficiently than objects that are incongruent. Further, semantic integration of incongruent objects elicits a stronger N300/N400 EEG component. Yet, the time course and mechanisms of how contextual information supports access to semantic object information is unclear. We used computational modelling and EEG to test how context influences semantic object processing. Using representational similarity analysis, we established that EEG patterns dissociated between objects in congruent or incongruent scenes from around 300 ms. By modelling semantic processing of objects using independently normed properties, we confirm that the onset of semantic processing of both congruent and incongruent objects is similar (∼150 ms). Critically, after ∼275 ms, we discover a difference in the duration of semantic integration, lasting longer for incongruent compared to congruent objects. These results constrain our understanding of how contextual information supports access to semantic object information.
Objects that are congruent with a scene are recognised more efficiently than objects that are incongruent. Further, semantic integration of incongruent objects elicits a stronger N300/N400 EEG component. Yet, the time course and mechanisms of how contextual information supports access to semantic object information is unclear. We used computational modelling and EEG to test how context influences semantic object processing. Using representational similarity analysis, we established that EEG patterns dissociated between objects in congruent or incongruent scenes from around 300 ms. By modelling semantic processing of objects using independently normed properties, we confirm that the onset of semantic processing of both congruent and incongruent objects is similar (∼150 ms). Critically, after ∼275 ms, we discover a difference in the duration of semantic integration, lasting longer for incongruent compared to congruent objects. These results constrain our understanding of how contextual information supports access to semantic object information.
Attention selects relevant information regardless of whether it is physically present or internally stored in working memory. Perceptual research has shown that attentional selection of external information is better conceived as rhythmic prioritization than as stable allocation. Here we tested this principle using information processing of internal representations held in working memory. Participants memorized four spatial positions that formed the endpoints of two objects. One of the positions was cued for a delayed match-non-match test. When uncued positions were probed, participants responded faster to uncued positions located on the same object as the cued position than to those located on the other object, revealing object-based attention in working memory. Manipulating the interval between cue and probe at a high temporal resolution revealed that reaction times oscillated at a theta rhythm of 6 Hz. Moreover, oscillations showed an anti-phase relationship between memorized but uncued positions on the same versus other object as the cued position, suggesting that attentional prioritization fluctuated rhythmically in an object-based manner. Our results demonstrate the highly rhythmic nature of attentional selection in working memory. Moreover, the striking similarity between rhythmic attentional selection of mental representations and perceptual information suggests that attentional oscillations are a general mechanism of information processing in human cognition. These findings have important implications for current, attention-based models of working memory.
Can prediction error explain predictability effects on the N1 during picture-word verification?
(2023)
Do early effects of predictability in visual word recognition reflect prediction error? Electrophysiological research investigating word processing has demonstrated predictability effects in the N1, or first negative component of the event-related potential (ERP). However, findings regarding the magnitude of effects and potential interactions of predictability with lexical variables have been inconsistent. Moreover, past studies have typically used categorical designs with relatively small samples and relied on by-participant analyses. Nevertheless, reports have generally shown that predicted words elicit less negative-going (i.e., lower amplitude) N1s, a pattern consistent with a simple predictive coding account. In our preregistered study, we tested this account via the interaction between prediction magnitude and certainty. A picture-word verification paradigm was implemented in which pictures were followed by tightly matched picture-congruent or picture-incongruent written nouns. The predictability of target (picture-congruent) nouns was manipulated continuously based on norms of association between a picture and its name. ERPs from 68 participants revealed a pattern of effects opposite to that expected under a simple predictive coding framework.
Selective attention implements preferential routing of attended stimuli, likely through increasing the influence of the respective synaptic inputs on higher-area neurons. As the inputs of competing stimuli converge onto postsynaptic neurons, presynaptic circuits might offer the best target for attentional top-down influences. If those influences enabled presynaptic circuits to selectively entrain postsynaptic neurons, this might explain selective routing. Indeed, when two visual stimuli induce two gamma rhythms in V1, only the gamma induced by the attended stimulus entrains gamma in V4. Here, we modeled induced responses with a Dynamic Causal Model for Cross-Spectral Densities and found that selective entrainment can be explained by attentional modulation of intrinsic V1 connections. Specifically, local inhibition was decreased in the granular input layer and increased in the supragranular output layer of the V1 circuit that processed the attended stimulus. Thus, presynaptic attentional influences and ensuing entrainment were sufficient to mediate selective routing.
Selective attention implements preferential routing of attended stimuli, likely through increasing the influence of the respective synaptic inputs on higher-area neurons. As the inputs of competing stimuli converge onto postsynaptic neurons, presynaptic circuits might offer the best target for attentional top-down influences. If those influences enabled presynaptic circuits to selectively entrain postsynaptic neurons, this might lead to selective routing. Indeed, when two visual stimuli induce two gamma rhythms in V1, only the gamma induced by the attended stimulus entrains gamma in V4. Here, we modeled this selective entrainment with a Dynamic Causal Model for Cross-Spectral Densities and found that it can be explained by attentional modulation of intrinsic V1 connections. Specifically, local inhibition was decreased in the granular input layer and increased in the supragranular output layer of the V1 circuit that processed the attended stimulus. Thus, presynaptic attentional influences and ensuing entrainment were sufficient to mediate selective routing.
Successful consolidation of associative memories relies on the coordinated interplay of slow oscillations and sleep spindles during non-rapid eye movement (NREM) sleep, enabling the transfer of labile information from the hippocampus to permanent memory stores in the neocortex. During senescence, the decline of the structural and functional integrity of the hippocampus and neocortical regions is paralleled by changes of the physiological events that stabilize and enhance associative memories during NREM sleep. However, the currently available evidence is inconclusive if and under which circumstances aging impacts memory consolidation. By tracing the encoding quality of single memories in individual participants, we demonstrate that previous learning determines the extent of age-related impairments in memory consolidation. Specifically, the detrimental effects of aging on memory maintenance were greatest for mnemonic contents of medium encoding quality, whereas memory gain of weakly encoded memories did not differ by age. Using multivariate techniques, we identified profiles of alterations in sleep physiology and brain structure characteristic for increasing age. Importantly, while both ‘aged’ sleep and ‘aged’ brain structure profiles were associated with reduced memory maintenance, inter-individual differences in neither sleep nor structural brain integrity qualified as the driving force behind age differences in sleep-dependent consolidation in the present study.
Precise slow oscillation-spindle coupling promotes memory consolidation in younger and older adults
(2018)
Memory consolidation during sleep relies on the precisely timed interaction of rhythmic neural events. Here, we investigate differences in slow oscillations (SO) and sleep spindles (SP) and their coupling across the adult human lifespan and ask whether observed alterations relate to the ability to retain associative memories across sleep. We demonstrate that the fine-tuned SO–SP coupling that is present in younger adults diffuses with advanced age and shifts both in time and frequency. Crucially, we show that the tight precision of SO–SP coupling promotes memory consolidation in younger and older adults, and that brain integrity in source regions for the generation of SOs and SPs reinforces this beneficial SO–SP coupling in old age. Our results reveal age-related differences in SO–SP coupling in healthy elderly individuals. Furthermore, they broaden our understanding of the conditions and the functional significance of SO–SP coupling across the entire adult lifespan.
Many cross-sectional findings suggest that volumes of specific hippocampal subfields increase in middle childhood and early adolescence. In contrast, a small number of available longitudinal studies observed decreased volumes in most subfields over this age range. Further, it remains unknown whether structural changes in development are associated with corresponding gains in children’s memory. Here we report cross-sectional age differences in children’s hippocampal subfield volumes together with longitudinal developmental trajectories and their relationships with memory performance. In two waves, 109 healthy participants aged 6 to 10 years (wave 1: MAge=7.25, wave 2: MAge=9.27) underwent high-resolution magnetic resonance imaging to assess hippocampal subfield volumes, and completed cognitive tasks assessing hippocampus dependent memory processes. We found that cross-sectional age-associations and longitudinal developmental trends in hippocampal subfield volumes were highly discrepant, both by subfields and in direction. Further, volumetric changes were largely unrelated to changes in memory, with the exception that increase in subiculum volume was associated with gains in spatial memory. Importantly, the observed longitudinal patterns of brain-cognition coupling could not be inferred from cross-sectional findings. We discuss potential sources of these discrepancies. This study underscores that children’s structural brain development and its relationship to cognition cannot be inferred from cross-sectional age comparisons.
Highlights
The subiculum undergoes volumetric increase between 6-10 years of age
Change across two years in CA1-2 and DG-CA3 was not observed in this age window
Change across two years did not reflect age differences spanning two years
Cross-sectional and longitudinal slopes in stark contrast for hippocampal subfields
Longitudinal brain-cognition coupling cannot be inferred from cross-sectional data
Age-related memory decline is associated with changes in neural functioning but little is known about how aging affects the quality of information representation in the brain. Whereas a long-standing hypothesis of the aging literature links cognitive impairments to less distinct neural representations in old age, memory studies have shown that high similarity between activity patterns benefits memory performance for the respective stimuli. Here, we addressed this apparent conflict by investigating between-item representational similarity in 50 younger (19–27 years old) and 63 older (63–75 years old) human adults (male and female) who studied scene-word associations using a mnemonic imagery strategy while electroencephalography was recorded. We compared the similarity of spatiotemporal frequency patterns elicited during encoding of items with different subsequent memory fate. Compared to younger adults, older adults’ memory representations were more similar to each other but items that elicited the most similar activity patterns early in the encoding trial were those that were best remembered by older adults. In contrast, young adults’ memory performance benefited from decreased similarity between earlier and later periods in the encoding trials, which might reflect their better success in forming unique memorable mental images of the joint picture–word pair. Our results advance the understanding of the representational properties that give rise to memory quality as well as how these properties change in the course of aging.
We studied oscillatory mechanisms of memory formation in 48 younger and 51 older adults in an intentional associative memory task with cued recall. While older adults showed lower memory performance than young adults, we found subsequent memory effects (SME) in alpha/beta and theta frequency bands in both age groups. Using logistic mixed effect models, we investigated whether interindividual differences in structural integrity of key memory regions could account for interindividual differences in the strength of the SME. Structural integrity of inferior frontal gyrus (IFG) and hippocampus was reduced in older adults. SME in the alpha/beta band were modulated by the cortical thickness of IFG, in line with its hypothesized role for deep semantic elaboration. Importantly, this structure–function relationship did not differ by age group. However, older adults were more frequently represented among the participants with low cortical thickness and consequently weaker SME in the alpha band. Thus, our results suggest that differences in the structural integrity of the IFG contribute not only to interindividual, but also to age differences in memory formation.
Dual coding theories of knowledge suggest that meaning is represented in the brain by a double code, which comprises language-derived representations in the Anterior Temporal Lobe and sensory-derived representations in perceptual and motor regions. This approach predicts that concrete semantic features should activate both codes, whereas abstract features rely exclusively on the linguistic code. Using magnetoencephalography (MEG), we adopted a temporally resolved multiple regression approach to identify the contribution of abstract and concrete semantic predictors to the underlying brain signal. Results evidenced early involvement of anterior-temporal and inferior-frontal brain areas in both abstract and concrete semantic information encoding. At later stages, occipito-temporal regions showed greater responses to concrete compared to abstract features. The present findings shed new light on the temporal dynamics of abstract and concrete semantic representations in the brain and suggest that the concreteness of words processed first with a transmodal/linguistic code, housed in frontotemporal brain systems, and only after with an imagistic/sensorimotor code in perceptual and motor regions.
The knowledge that brain functional connectomes are both unique and reliable has enabled behaviourally relevant inferences at a subject level. However, it is unknown whether such “fingerprints” persist under altered states of consciousness. Ayahuasca is a potent serotonergic psychedelic which elicits a widespread dysregulation of functional connectivity. Used communally in religious ceremonies, its shared use may highlight relevant novel interactions between mental state and FC inherency. Using 7T fMRI, we assessed resting-state static and dynamic FCs for 21 Santo Daime members after collective ayahuasca intake in an acute, within-subject study. Here, connectome fingerprinting revealed a shared functional space, accompanied by a spatiotemporal reallocation of keypoint edges. Importantly, we show that interindividual differences in higher-order FCs motifs are relevant to experiential phenotypes, given that they can predict perceptual drug effects. Collectively, our findings offer an example as to how individualised connectivity markers can be used to trace a subject’s functional connectome across altered states of consciousness.
The traditional view on coding in the cortex is that populations of neurons primarily convey stimulus information through the spike count. However, given the speed of sensory processing, it has been hypothesized that sensory encoding may rely on the spike-timing relationships among neurons. Here, we use a recently developed method based on Optimal Transport Theory called SpikeShip to study the encoding of natural movies by high-dimensional ensembles of neurons in visual cortex. SpikeShip is a generic measure of dissimilarity between spike train patterns based on the relative spike-timing relations among all neurons and with computational complexity similar to the spike count. We compared spike-count and spike-timing codes in up to N > 8000 neurons from six visual areas during natural video presentations. Using SpikeShip, we show that temporal spiking sequences convey substantially more information about natural movies than population spike-count vectors when the neural population size is larger than about 200 neurons. Remarkably, encoding through temporal sequences did not show representational drift both within and between blocks. By contrast, population firing rates showed better coding performance when there were few active neurons. Furthermore, the population firing rate showed memory across frames and formed a continuous trajectory across time. In contrast to temporal spiking sequences, population firing rates exhibited substantial drift across repetitions and between blocks. These findings suggest that spike counts and temporal sequences constitute two different coding schemes with distinct information about natural movies.
Human language relies on hierarchically structured syntax to facilitate efficient and robust communication. The correct processing of syntactic information is essential for successful communication between speakers. As an abstract level of language, syntax has often been studied separately from the physical form of the speech signal, thus often masking the interactions that can promote better syntactic processing in the human brain. We analyzed a MEG dataset to investigate how acoustic cues, specifically prosody, interact with syntactic operations. We examined whether prosody enhances the cortical encoding of syntactic representations. We decoded left-sided dependencies directly from brain activity and evaluated possible modulations of the decoding by the presence of prosodic boundaries. Our findings demonstrate that prosodic boundary presence improves the representation of left-sided dependencies, indicating the facilitative role of prosodic cues in processing abstract linguistic features. This study gives neurobiological evidence for the boosting of syntactic processing via interaction with prosody.
The development of binocular vision is an active learning process comprising the development of disparity tuned neurons in visual cortex and the establishment of precise vergence control of the eyes. We present a computational model for the learning and self-calibration of active binocular vision based on the Active Efficient Coding framework, an extension of classic efficient coding ideas to active perception. Under normal rearing conditions, the model develops disparity tuned neurons and precise vergence control, allowing it to correctly interpret random dot stereogramms. Under altered rearing conditions modeled after neurophysiological experiments, the model qualitatively reproduces key experimental findings on changes in binocularity and disparity tuning. Furthermore, the model makes testable predictions regarding how altered rearing conditions impede the learning of precise vergence control. Finally, the model predicts a surprising new effect that impaired vergence control affects the statistics of orientation tuning in visual cortical neurons.
Mounting evidence suggests that perception depends on a largely-feedforward brain network. However, the discrepancy between (i) the latency of the corresponding feedforward responses (150-200 ms) and (ii) the time it takes human subjects to recognize brief images (often >500 ms) suggests that recurrent neuronal activity is critical to visual processing. Here, we use magneto-encephalography to localize, track and decode the feedforward and recurrent responses elicited by brief presentations of variably-ambiguous letters and digits. We first confirm that these stimuli trigger, within the first 200 ms, a feedforward response in the ventral and dorsal cortical pathways. The subsequent activity is distributed across temporal, parietal and prefrontal cortices and leads to a slow and incremental cascade of representations culminating in action-specific motor signals. We introduce an analytical framework to show that these brain responses are best accounted for by a hierarchy of recurrent neural assemblies. An accumulation of computational delays across specific processing stages explains subjects’ reaction times. Finally, the slow convergence of neural representations towards perceptual categories is quickly followed by all-or-none motor decision signals. Together, these results show how recurrent processes generate, over extended time periods, a cascade of hierarchical decisions that ultimately predicts subjects’ perceptual reports.
Several studies have probed perceptual performance at different times after a self-paced motor action and found frequency-specific modulations of perceptual performance phase-locked to the action. Such action-related modulation has been reported for various frequencies and modulation strengths. In an attempt to establish a basic effect at the population level, we had a relatively large number of participants (n=50) perform a self-paced button press followed by a detection task at threshold, and we applied both fixed- and random-effects tests. The combined data of all trials and participants surprisingly did not show any significant action-related modulation. However, based on previous studies, we explored the possibility that such modulation depends on the participant’s internal state. Indeed, when we split trials based on performance in neighboring trials, then trials in periods of low performance showed an action-related modulation at ≈17 Hz. When we split trials based on the performance in the preceding trial, we found that trials following a “miss” showed an action-related modulation at ≈17 Hz. Finally, when we split participants based on their false-alarm rate, we found that participants with no false alarms showed an action-related modulation at ≈17 Hz. All these effects were significant in random-effects tests, supporting an inference on the population. Together, these findings indicate that action-related modulations are not always detectable. However, the results suggest that specific internal states such as lower attentional engagement and/or higher decision criterion are characterized by a modulation in the beta-frequency range.
Several recent studies investigated the rhythmic nature of cognitive processes that lead to perception and behavioral report. These studies used different methods, and there has not yet been an agreement on a general standard. Here, we present a way to test and quantitatively compare these methods. We simulated behavioral data from a typical experiment and analyzed these data with several methods. We applied the main methods found in the literature, namely sine-wave fitting, the Discrete Fourier Transform (DFT) and the Least Square Spectrum (LSS). DFT and LSS can be applied both on the averaged accuracy time course and on single trials. LSS is mathematically equivalent to DFT in the case of regular, but not irregular sampling - which is more common. LSS additionally offers the possibility to take into account a weighting factor which affects the strength of the rhythm, such as arousal. Statistical inferences were done either on the investigated sample (fixed-effect) or on the population (random-effect) of simulated participants. Multiple comparisons across frequencies were corrected using False-Discovery-Rate, Bonferroni, or the Max-Based approach. To perform a quantitative comparison, we calculated Sensitivity, Specificity and D-prime of the investigated analysis methods and statistical approaches. Within the investigated parameter range, single-trial methods had higher sensitivity and D-prime than the methods based on the averaged-accuracy-time-course. This effect was further increased for a simulated rhythm of higher frequency. If an additional (observable) factor influenced detection performance, adding this factor as weight in the LSS further improved Sensitivity and D-prime. For multiple comparison correction, the Max-Based approach provided the highest Specificity and D-prime, closely followed by the Bonferroni approach. Given a fixed total amount of trials, the random-effect approach had higher D-prime when trials were distributed over a larger number of participants, even though this gave less trials per participant. Finally, we present the idea of using a dampened sinusoidal oscillator instead of a simple sinusoidal function, to further improve the fit to behavioral rhythmicity observed after a reset event.