EXPLORING THE POTENTIAL OF SHORT-TIME FOURIER TRANSFORMS FOR ANALYZING SKIN CONDUCTANCE AND PUPILLOMETRY IN REAL-TIME APPLICATIONS

PDF Version Also Available for Download.

Description

The development of real-time predictors of mental workload is critical for the practical application of augmented cognition to human-machine systems. This paper explores a novel method based on a short-time Fourier transform (STFT) for analyzing galvanic skin conductance (SC) and pupillometry time-series data to extract estimates of mental workload with temporal bandwidth high-enough to be useful for augmented cognition applications. We tested the method in the context of a process control task based on the DURESS simulation developed by Vincente and Pawlak (1994; ported to Java by Cosentino,& Ross, 1999). SC, pupil dilation, blink rate, and visual scanning patterns were ... continued below

Creation Information

Lew, Roger; Dyre, Brian P.; Werner, Steffen; Joe, Jeffrey C.; Wotring, Brian & Tran, Tuan September 1, 2008.

Context

This article is part of the collection entitled: Office of Scientific & Technical Information Technical Reports and was provided by UNT Libraries Government Documents Department to Digital Library, a digital repository hosted by the UNT Libraries. More information about this article can be viewed below.

Who

People and organizations associated with either the creation of this article or its content.

Publisher

Provided By

UNT Libraries Government Documents Department

Serving as both a federal and a state depository library, the UNT Libraries Government Documents Department maintains millions of items in a variety of formats. The department is a member of the FDLP Content Partnerships Program and an Affiliated Archive of the National Archives.

Contact Us

What

Descriptive information to help identify this article. Follow the links below to find similar items on the Digital Library.

Description

The development of real-time predictors of mental workload is critical for the practical application of augmented cognition to human-machine systems. This paper explores a novel method based on a short-time Fourier transform (STFT) for analyzing galvanic skin conductance (SC) and pupillometry time-series data to extract estimates of mental workload with temporal bandwidth high-enough to be useful for augmented cognition applications. We tested the method in the context of a process control task based on the DURESS simulation developed by Vincente and Pawlak (1994; ported to Java by Cosentino,& Ross, 1999). SC, pupil dilation, blink rate, and visual scanning patterns were measured for four participants actively engaged in controlling the simulation. Fault events were introduced that required participants to diagnose errors and make control adjustments to keep the simulator operating within a target range. We were interested in whether the STFT of these measures would produce visible effects of the increase in mental workload and stress associated with these events. Graphical exploratory data analysis of the STFT showed visible increases in the power spectrum across a range of frequencies directly following fault events. We believe this approach shows potential as a relatively unobtrusive, low-cost, high bandwidth measure of mental workload that could be particularly useful for the application of augmented cognition to human-machine systems.

Source

  • Human Factors and Ergonomics Society 52nd Annual Meeting,New York Marriott Marquis Times Square in midtown Manhattan,09/22/2008,09/26/2008

Language

Item Type

Identifier

Unique identifying numbers for this article in the Digital Library or other systems.

  • Report No.: INL/CON-08-14336
  • Grant Number: DE-AC07-99ID-13727
  • Office of Scientific & Technical Information Report Number: 940039
  • Archival Resource Key: ark:/67531/metadc896058

Collections

This article is part of the following collection of related materials.

Office of Scientific & Technical Information Technical Reports

What responsibilities do I have when using this article?

When

Dates and time periods associated with this article.

Creation Date

  • September 1, 2008

Added to The UNT Digital Library

  • Sept. 27, 2016, 1:39 a.m.

Description Last Updated

  • Nov. 28, 2016, 2:34 p.m.

Usage Statistics

When was this article last used?

Congratulations! It looks like you are the first person to view this item online.

Interact With This Article

Here are some suggestions for what to do next.

Start Reading

PDF Version Also Available for Download.

Citations, Rights, Re-Use

Lew, Roger; Dyre, Brian P.; Werner, Steffen; Joe, Jeffrey C.; Wotring, Brian & Tran, Tuan. EXPLORING THE POTENTIAL OF SHORT-TIME FOURIER TRANSFORMS FOR ANALYZING SKIN CONDUCTANCE AND PUPILLOMETRY IN REAL-TIME APPLICATIONS, article, September 1, 2008; [Idaho Falls, Idaho]. (digital.library.unt.edu/ark:/67531/metadc896058/: accessed September 24, 2017), University of North Texas Libraries, Digital Library, digital.library.unt.edu; crediting UNT Libraries Government Documents Department.