Title:
Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines
Comments:
Cindy Skach
Luke Roberts
Reference:
Solovey, E., Girouard, A., Chauncey, K., Hirshfield, L., Sassaroli, A., Zheng, F., Fantini, S., Jacob, R. Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. UIST '09.
http://delivery.acm.org/10.1145/1630000/1622207/p157-solovey.pdf?key1=1622207&key2=5715740031&coll=DL&dl=ACM&ip=128.194.132.227&CFID=14252216&CFTOKEN=68607047
Summary:
The researchers were interested in using brain sensors for HCI, and therefore conducted 5 experiments in order to see how these sensors could be used for HCI. They claim many brain sensing mechanisms would be inappropriate for HCI due to their operation and vulnerability to disturbances, therefore the researchers chose to use functional near-infrared spectroskopy (fNIRS). Using fNIRS, they sought to test the effects of keyboard and mouse input, head movement, and facial movement of a user doing a cognitive task on the fNIRS results.
For the experiments, the user was given a time of rest as well as a time of a cognitive task on a computer. This task consisted of looking at a 7-digit number, waiting 15 seconds, and then recalling that number. The five experiments are as follows:
- No artifacts - This was to test if there was a difference that the fNIRS could pick up from doing the cognitive task and not doing the task. It was shown that there is an observed difference between these two states allowing the experimenters to continue their experiments.
- Keyboard input - Here in addition to the rest time and cognitive task, the user would type random letters using the keyboard. It was found that whether doing this continually or intermittently they were able to pinpoint the cognitive task.
- Mouse input - Here the user pointed and clicked a target on the computer. The results for this experiment were not as conclusive as the keyboard input. If a user is constantly using the mouse through both rest and the cognitive task, then the cognitive task was able to be distinguished, however if there was only intermittent clicking it could not.
- Head movement - The clicking and keyboard input here is replaced by head movement. The results were found to be exactly the same as experiment 2.
- Facial movement - Here the facial gesture of frowning was studied. It was found that if there was constant frowning then the cognitive task could not be pinpointed, but if it was intermittent then it could. They claim this to be an interesting finding.

They analyzed these results in order to extrapolate the possible use of fNIRS in HCI. A brief summary of the results are shown in Table 1. For mouse clicking, typing, hemodynamic-response, eye movement, and blinking it is acceptable to distinguish in between these tasks and a cognitive task using fNIRS. For Respiration and heartbeat, minor head movement, ambient light, and ambient noise it is appropriate using a certain correction. Forehead movement and major head movement need to be avoided or controlled.
Discussion:
This was an interesting paper being as I just finished
Obedience to Authority. I had not previously seen a paper that is simply performing an experiment to extrapolate data to a larger context, and this provided a nice break from test cases measuring user ability. The idea of using brain sensing technology for computing is an area that I think has great potential but seems by the results of this study to be too constrained to be useful for anything as of right now. Also I can see wearing an article on your head while computing isn't the most desirable thing either. Something like this could however be incorporated into headphones or something like that.
As far as further study, since this paper in a way lays the groundwork for use with this system, anything involving this technology could be studied. Concerning the constraints of the system, the researchers could further study more possible ways to control these artifacts.