Papers with lists of covered subtopics

• Leamy, D.J., Kocijan, J., Domijan, K. et al. An exploration of EEG features during recovery following stroke – implications for BCI-mediated neurorehabilitation therapy. J NeuroEngineering Rehabil 11, 9 (2014).
  url
  [Shana Dupanloup]

  • Kapandji finger opposition test
  • FBCSP
    • Common Spatial Patterns (CSP) algorithm
    • Marginal Relevance (MRelv)
    • Gaussian Process classification (GPC)

• W. Yi, S. Qiu, X. Fan, L. Zhang and D. Ming, Evaluation of mental workload associated with time pressure in rapid serial visual presentation tasks, in IEEE Transactions on Cognitive and Developmental Systems, doi: 10.1109/TCDS.2021.3061564.url
  [Florijan Reetz]

  • evaluate mental workload under time pressure
  • Rapid Serial Visual Presentation Tasks (RSVP)
  • explore influence of mental workload on target detection performance
  • Rating Scale Mental Effort (RSME) value
    • Standard Stress Scale
  • Correlation analysis

• Pereira, F., & Botvinick, M. (2012). A systematic approach to extracting semantic information from functional MRI data. In: Advances in Neural Information Processing Systems (pp. 2267-2275). pdf
  [Brandon Llanque]

  • functional Magnetic Resonance Imaging
  • Curse of dimensionality
  • Using clustering and classifiers to reduce voxel count
    • LDA
    • SVM

• Pedro R. A. S. Bassi and Romis Attux FBDNN: Filter Banks and Deep Neural Networks for Portable and Fast Brain-Computer Interfaces arXiv preprint arXiv:2109.02165v2. 2021 Nov 6. url
  [Facundo Perez Talamonti]

  • BCI - specific
    • Steady State Visually Evoked Potential
    • User-independent BCI
    • Portable BCI
  • Machine Learning - tools
    • Canonical Correlation Analysis
    • Filter Banks
    • Deep Neural Networks
    • Convolutional Neural Networks

• Jiang, X., Lopez, E., Stieger, J., Greco, C. M., & He, B. (2020). Effects of Long-Term Meditation Practices on Sensorimotor Rhythm Based BCI Learning. Frontiers in neuroscience, 14, 1443. Url
  Juliane Verwiebe

  • Performance measure: percent valid correct (PVC)
  • Finite impulse response filter - Hamming Window
  • Neurophysiological predictor or SMR predictor
  • Power spectral density
  • Fisher score
  • Satterthwaite approximation for degrees of freedom
  • ANOVA ratio tests

• Herff, C., Diener, L., Angrick, M., Mugler, E., Tate, M. C., Goldrick, M. A., ... & Schultz, T. (2019). Generating natural, intelligible speech from brain activity in motor, premotor, and inferior frontal cortices. Frontiers in neuroscience, 13, 1267. url
  Robert Gericke

  • hamming window
  • unit selection
  • cosine similarity
  • spectral domain
  • mel scale
  • objective intelligibility measure

• Annese, V. F., Mezzina, G., & De Venuto, D. (2016) Towards mobile health care: Neurocognitive impairment monitoring by BCI-based game. 2016 IEEE SENSORS. url
  Tianhao He

  • Providing a solution for remotely detecting cognitive diseases, such as Alzheimer’s
  • Adopting the t-RIDE (tuned Residual Iteration Decomposition) algorithm to process P300 amplitude and latency data collected by EEG
    • Iterating and selecting optimal window for computations depending on the highest amplitude
    • Using RIDE to calculate latency variables depending on the optimal window
  • Implementing a "plug and play" game, consisting of colored and geometrical shapes, with "oddball" principle
  • Using an encrypted, cloud-based platform to store, process, and analyze data for disease predictions
  • Benefits: faster, easier cognitive disorder diagnosis; and fewer burdens on centralized facilities

• Iotzov I, Parra LC. EEG can predict speech intelligibility. Journal of neural engineering. 2019 Mar 20;16(3):036008. pdf
  Mehmet Hakan Kurtoglu

  • Speech signals
    • Speech tracking
    • Amplitude envelope, signal-to-noise ratio
    • Stimulus response correlation
    • Canonical correlation analysis
  • Behavioral detection performance
    • Recall, precision, F1 score
  • Regression of visual features
  • Power analysis with bootstrapping

• Willett, F.R., Avansino, D.T., Hochberg, L.R. et al. High-performance brain-to-text communication via handwriting. Nature 593, 249–254 (2021). url
  Ali Alouane

  • Neural activity representation of handwriting movements
  • Decoding handwritting movements using recurrent neural network
    • Collecting data and calibration
    • Training methods of RNN decoder
    • Imporving decoding using temporal variety

• Fong, R.C., Scheirer, W.J. & Cox, D.D. Using human brain activity to guide machine learning. Sci Rep 8, 5397 (2018). url
  Nigel Tyrone McCray

  • FMRI data processing for machine learning algorithms
  • ROI analysis of fMRI data for visual object recognition
  • "neurally-weighted" neural networks

• Akinola et al., Accelerated Robot Learning via Human Brain Signals, 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 3799-3805, doi: 10.1109/ICRA40945.2020.9196566. url pdf
  Äantas Kesten

  • error-related potential (ErrP)
  • cross-entropy
  • PPO

• Tremmel, C., Herff, C., Sato, T., Rechowicz, K., Yamani, Y., & Krusienski, D. J. (2019). Estimating cognitive workload in an interactive virtual reality environment using EEG. Frontiers in human neuroscience, 13, 401. url
  Dennis Otrombowsky

  • VR
  • EEG
  • Discrimination of cognitive workload levels
    • n-back task

• Nierhaus, Till, Carmen Vidaurre, Claudia Sannelli, Klaus‐Robert Mueller, and Arno Villringer. Immediate brain plasticity after one hour of brain–computer interface (BCI). The Journal of physiology 599, no. 9 (2021): 2435-2451.
  Rosa Wolf

  • brain plasticity
  • BCI-tasks
    • motor-imagery tasks (MI-BCI)
    • visual-evoked potential/event-related-potentials elicited by visual task (ERP-BCI)
  • Hex-O-Speller
  • mu-band and beta-band
  • MRI-imaging
    • T1-weighted MRI
    • fMRI (resting state and functional state)
    • BOLD activity
  • MRI data analysis
    • DARTEL (Diffeomorphic Anatomical Registration through exponential lie algebra)
    • bias field correction
    • tissue probability maps
    • modulation with Jacobian determinants to preserve total amount of signal
    • t-test (paired t-test and two-sample t-test)
    • slice time correction
    • CompCor analysis
  • EEG data analyis
    • Spearman's correlation
    • AlphaSim correction
  • Functional connectivity analysis
    • eigenvector centrality mapping (ECM)
    • multiple comparison precedure based on Monte Carlo simulations
  • First general linear model (GLM)

• Si-Mohammed H, Petit J, Jeunet C, Argelaguet F, Spindler F, Evain A, Roussel N, Casiez G, Lécuyer A. Towards BCI-based interfaces for augmented reality: feasibility, design and evaluation. IEEE transactions on visualization and computer graphics. 2018 Oct 4;26(3):1608-21.
  Lorenzo Cocchia

  • Related work
    • Steady-State Visually Evoked Potential
    • Video-through AR and BCI
    • Optical See-through AR and BCI
  • Study of feasibility: compatibility between AR and BCI
    • Internal and External noise
    • Common Spatial Pattern (CSP)
    • Friedman test
    • Post-Hoc test
  • Study of a methodology to design a UI
    • Dimensions of a design space
      • Orientation, frame-of-reference, anchorage, size, explicitness
    • Wilcoxon signed rank test
  • Final prototype

• Chen, Yiyu, et al. A high-security EEG-based login system with RSVP stimuli and dry electrodes. IEEE Transactions on Information Forensics and Security 11.12 (2016): 2635-2647. url
  Clemens Lottermoser

  • rapid serial visual presentation paradigm (RSVP)
  • wet vs. dry electrodes
  • point-biserial correlation coefficient
  • Fisher’s transformation
  • two-sided z-test
  • Bonferroni-correction
  • RLDA-classification (shrinkage LDA)
  • cross-validation
  • area under the receiver operator characteristic (ROC)
  • count-min sketch method

• Dutta, S., Banerjee, T., Roy, N.D. et al. Development of a BCI-based gaming application to enhance cognitive control in psychiatric disorders. Innovations Syst Softw Eng 17, 99–107 (2021). https://doi.org/10.1007/s11334-020-00370-7 url
  Alessandro Corsini

  • Serious Games
  • Cognitive Control
  • Psychiatric Disorders
    • ADHD, Depression, Schizophrenia
    • OCD (Obsessive Compulsive Disorder)
      • YBOCS (Yale Brown Obsessive Compulsive Scale)
  • Neurofeedback Pipeline
    • FFT (Fast Fourier Transform)
    • Alpha and Beta waves

• Sussillo D, Stavisky SD, Kao JC, Ryu SI, Shenoy KV. Making brain–machine interfaces robust to future neural variability. Nature communications. 2016 Dec 13;7(1):1-3.
  Joel Tokple

  • Statistics
    • R-squared
    • Pearson Correlation
    • Paired t-test
  • BCI
    • Utah Array
    • Kalman Filter
    • Closed Loop BCI
    • Spike
    • Spike band
    • theshold crossing
  • Others
    • Recurrent Neural Network
    • Mutual Information

• Bingbing Wang, Zeju Xu, Tong Luo, Jiahui Pan, EEG-Based Closed-Loop Neurofeedback for Attention Monitoring and Training in Young Adults, Journal of Healthcare Engineering, vol. 2021, Article ID 5535810, 13 pages, 2021. url
  Leonie Lübbing

  • EEG-based attention monitoring
    • power spectral density (PSD)
    • continuous wavelet transform (CWT) algorithm/Daubechies coefficients
    • improved random forest classifier (IRF)
      • decision tree classification models
      • simple majority voting
      • grid search algorithm
      • 10-fold cross validation
  • neurofeedback attention training
    • serious games
    • attention function monitored by IRF
    • different attention mechanisms
      • sustained
      • selective
      • focus

• Poulsen AT, Kamronn S, Dmochowski J, Parra LC, Hansen LK. EEG in the classroom: Synchronised neural recordings during video presentation. Scientific Reports. 2017 url
  Jiale Cheng

  • Inter-subject correlation (ISC)
  • Orrelated component analysis (CorrCA)
  • Inter-viewing correlation, IVC
  • Visual evoked potentials (VEP)
  • Average luminance difference, ALD

• Cohen SS, Madsen J, Touchan G, Robles D, Lima SF, Henin S, Parra LC. Neural engagement with online educational videos predicts learning performance for individual students. Neurobiology of learning and memory. 2018 Nov 1;155:60-4. url pdf
  Dele Zhu

  • Neural engagement
  • Inter-subject correlation(ISC)
  • EEG as a measure of academic success
  • ISC and attention analysis

• Ki JJ, Parra LC, Dmochowski JP. Visually evoked responses are enhanced when engaging in a video game. European Journal of Neuroscience. 2020 Dec;52(12):4695-708. url pdf
  David Rölleke

  • Related Work
    • Information Flow in visual processing (Goodale & Milner 1992)
      • visual cortex
      • parietal lobe -> motor cortex
    • feedforward view on information flow from studies of visually guided action
      • visual system -> premotor center -> motor center
  • seperating somatosensory and motor related signals from EEG recordings (sham play deception)
  • stimulus-response correlation (SRC): correlation of optic flow and evoked EEG response
  • Horn-Schunck method for optic flow calculation
  • multidimensional SRC (Dmochowski et. al., 2017)
  • paired, two-tailed Wilcoxon signed-rank test for differences in SRC, self-reported engagement and alpha power
  • spatial/temporal response function

• Hu F, Wang H, Wang Q, Feng N, Chen J, Zhang T. Acrophobia quantified by EEG based on CNN incorporating Granger causality. International Journal of Neural Systems. 2021 Mar 23;31(03):2050069. url pdf
  Lukas Beinlich

  • Matches EEG-Data to self assesed level of Visual Height Intolerance(VHI) collected from VR-Experiments
    • used to predict level of VHI for therapy in new patients
  • Granger Causality (Functional Brain Networks)
    • Tries to determine how much a time series forecasts another
  • Convolutional Neural Network
    • convolutional Layer
    • max-Pooling
    • Softmax activation function for classification
    • Batch Normalization and Dropout-layer
  • Other methods (briefly mentioned):
    • Power Spectrum Density
    • Support Vector Machines (very short)

• Zhao DG, Vasilyev AN, Kozyrskiy BL, Melnichuk EV, Isachenko AV, Velichkovsky BM, Shishkin SL. A passive BCI for monitoring the intentionality of the gaze-based moving object selection. Journal of Neural Engineering. 2021 Mar 4;18(2):026001. url
  Yosra Griri

  • Not discussed in the lecture:
    - The anticipation-related component from EEG, the E-wave.
  • Related papers/topics:
    - Passive detection of feedback expectation Nuzhdin Y O et al
    - Oculomotor inhibition reflects temporal expectationsAmit R et al
    - the effect of dynamic stimuli on response preparation and CNV amplitude Linssen A M et al
    - gaze-based selection of moving items, e.g. in video games
    - EEG preprocessing .. low pass filtering, segmentation

• Zhang J, Idaji MJ, Villringer A, Nikulin VV. Neuronal biomarkers of Parkinson's disease are present in healthy aging. NeuroImage. 2021 Nov 1;243:118512. url pdf
  Kim Schwarz

  • Resting State Multichannel EEG
  • Parkinson
  • Aging
  • PAC
  • Beta Oscillations
  • Kullback_leibler based modulation index method
  • Inverse Modeling
  • Statistical testing

• Kosti MV, Georgiadis K, Adamos DA, Laskaris N, Spinellis D, Angelis L. Towards an affordable brain computer interface for the assessment of programmers’ mental workload. International Journal of Human-Computer Studies. 2018 Jul 1;115:52-66. url pdf
  Piet Lennart Wagner

  • Neuroscience and mental workload in Programming
  • Inexpensive mobile EEG scanner
  • Ordinal Regression
  • EEG Preprocessing of relevant Frequency bands
  • Phase Locking Value(PLV)
  • Signal Power(SP) measurements
  • Functional Connectivity measurements
  • Pattern Analysis
    • Spearmans RHO correlation
    • Wilcoxen score

• Hofmann SM, Klotzsche F, Mariola A, Nikulin V, Villringer A, Gaebler M. Decoding subjective emotional arousal from EEG during an immersive Virtual Reality experience. eLife. 2021 Oct 28;10:e64812. pdf
  Aleksandrs Koselevs

  • Heartbeat guessing task (Schandry, 1981)
  • ICA (Independent Component Analysis) decomposition
  • Spatiospectral decomposition (SSD)
  • Source Power Comodulation (SPoC)
  • Common Spatial Patterns (CSP)
  • Exact Low Resolution Tomography Analysis (eLORETA)
  • Long Short-Term Memory (LSTM) Recurrent Neural Network

tags: teaching, BCI