Distilling neural representations of data structure manipulation using fMRI and fNIRS
Abstract
Data structures permeate many aspects of software engineering, but their associated human cognitive processes are not thoroughly understood. We leverage medical imaging and insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations. In a human study involving 76 participants, we examine list, array, tree, and mental rotation tasks using both functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI). We find a nuanced relationship: data structure and spatial operations use the same focal regions of the brain but to different degrees. They are related but distinct neural tasks. In addition, more difficult computer science problems induce higher cognitive load than do problems of pure spatial reasoning. Finally, while fNIRS is less expensive and more permissive, there are some computing-relevant brain regions that only fMRI can reach.
BibTeX
@inproceedings{Huang-al:ICSE19,
author = {Yu Huang and
Xinyu Liu and
Ryan Krueger and
Tyler Santander and
Xiaosu Hu and
Kevin Leach and
Westley Weimer},
title = {Distilling neural representations of data structure manipulation using {fMRI} and {fNIRS}},
booktitle = {ICSE},
pages = {396--407},
publisher = {{IEEE} / {ACM}},
year = {2019},
}