Eye-movements and Voice as Interface Modalities to Computer Systems

Mohsen M. Farid; Fionn Murtagh

doi:10.1117/12.463748

Eye-movements and Voice as Interface Modalities to Computer Systems

Mohsen M. Farid, Fionn Murtagh

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Citations (Scopus)

Abstract

We investigate the visual and vocal modalities of interaction with computer systems. We focus our attention on the integration of visual and vocal interface as possible replacement and/or additional modalities to enhance human-computer interaction. We present a new framework for employing eye gaze as a modality of interface. While voice commands, as means of interaction with computers, have been around for a number of years, integration of both the vocal interface and the visual interface, in terms of detecting user's eye movements through an eye-tracking device, is novel and promises to open the horizons for new applications where a hand-mouse interface provides little or no apparent support to the task to be accomplished. We present an array of applications to illustrate the new framework and eye-voice integration.

Original language	English
Title of host publication	Opto-Ireland 2002
Subtitle of host publication	Optical Metrology, Imaging, and Machine Vision
Editors	Andrew Shearer, Fionn D. Murtagh, James Mahon, Paul F. Whelan
Publisher	SPIE
Pages	115-125
Number of pages	11
Volume	4877
ISBN (Print)	0819446580, 9780819446589
DOIs	https://doi.org/10.1117/12.463748
Publication status	Published - 19 Mar 2003
Externally published	Yes
Event	Opto-Ireland 2002: Optical metrology, Imaging, and Machine Vision - Galway, Ireland Duration: 5 Sep 2002 → 6 Sep 2002 https://www.researchgate.net/publication/260899755_Opto-Ireland_2002_Optical_Metrology_Imaging_and_Machine_Vision

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Publisher	SPIE
Volume	4877
ISSN (Print)	0277-786X

Conference

Conference	Opto-Ireland 2002: Optical metrology, Imaging, and Machine Vision
Country/Territory	Ireland
City	Galway
Period	5/09/02 → 6/09/02
Internet address	https://www.researchgate.net/publication/260899755_Opto-Ireland_2002_Optical_Metrology_Imaging_and_Machine_Vision

Access to Document

10.1117/12.463748Licence: Unspecified

Cite this

Farid, M. M., & Murtagh, F. (2003). Eye-movements and Voice as Interface Modalities to Computer Systems. In A. Shearer, F. D. Murtagh, J. Mahon, & P. F. Whelan (Eds.), Opto-Ireland 2002: Optical Metrology, Imaging, and Machine Vision (Vol. 4877, pp. 115-125). (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 4877). SPIE. https://doi.org/10.1117/12.463748

@inproceedings{f48d7533c4f04c16906479a6aefcef70,

title = "Eye-movements and Voice as Interface Modalities to Computer Systems",

abstract = "We investigate the visual and vocal modalities of interaction with computer systems. We focus our attention on the integration of visual and vocal interface as possible replacement and/or additional modalities to enhance human-computer interaction. We present a new framework for employing eye gaze as a modality of interface. While voice commands, as means of interaction with computers, have been around for a number of years, integration of both the vocal interface and the visual interface, in terms of detecting user's eye movements through an eye-tracking device, is novel and promises to open the horizons for new applications where a hand-mouse interface provides little or no apparent support to the task to be accomplished. We present an array of applications to illustrate the new framework and eye-voice integration.",

keywords = "ASL-504, Eye Tracking, Graphical User Interface, Non-Haptic Devices, Visual Navigation, Visual User Interface, Vocal User Interface, Voice Commands, Eye, Visualization, Human-machine interfaces, Computing systems, Image compression, Control systems, Video, Tolerancing, Video compression, Optical tracking",

author = "Farid, {Mohsen M.} and Fionn Murtagh",

year = "2003",

month = mar,

day = "19",

doi = "10.1117/12.463748",

language = "English",

isbn = "0819446580",

volume = "4877",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

publisher = "SPIE",

pages = "115--125",

editor = "Andrew Shearer and Murtagh, {Fionn D.} and James Mahon and Whelan, {Paul F.}",

booktitle = "Opto-Ireland 2002",

address = "United States",

note = "Opto-Ireland 2002: Optical metrology, Imaging, and Machine Vision ; Conference date: 05-09-2002 Through 06-09-2002",

url = "https://www.researchgate.net/publication/260899755_Opto-Ireland_2002_Optical_Metrology_Imaging_and_Machine_Vision",

}

Farid, MM & Murtagh, F 2003, Eye-movements and Voice as Interface Modalities to Computer Systems. in A Shearer, FD Murtagh, J Mahon & PF Whelan (eds), Opto-Ireland 2002: Optical Metrology, Imaging, and Machine Vision. vol. 4877, Proceedings of SPIE - The International Society for Optical Engineering, vol. 4877, SPIE, pp. 115-125, Opto-Ireland 2002: Optical metrology, Imaging, and Machine Vision, Galway, Ireland, 5/09/02. https://doi.org/10.1117/12.463748

Eye-movements and Voice as Interface Modalities to Computer Systems. / Farid, Mohsen M.; Murtagh, Fionn.

Opto-Ireland 2002: Optical Metrology, Imaging, and Machine Vision. ed. / Andrew Shearer; Fionn D. Murtagh; James Mahon; Paul F. Whelan. Vol. 4877 SPIE, 2003. p. 115-125 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 4877).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Eye-movements and Voice as Interface Modalities to Computer Systems

AU - Farid, Mohsen M.

AU - Murtagh, Fionn

PY - 2003/3/19

Y1 - 2003/3/19

N2 - We investigate the visual and vocal modalities of interaction with computer systems. We focus our attention on the integration of visual and vocal interface as possible replacement and/or additional modalities to enhance human-computer interaction. We present a new framework for employing eye gaze as a modality of interface. While voice commands, as means of interaction with computers, have been around for a number of years, integration of both the vocal interface and the visual interface, in terms of detecting user's eye movements through an eye-tracking device, is novel and promises to open the horizons for new applications where a hand-mouse interface provides little or no apparent support to the task to be accomplished. We present an array of applications to illustrate the new framework and eye-voice integration.

AB - We investigate the visual and vocal modalities of interaction with computer systems. We focus our attention on the integration of visual and vocal interface as possible replacement and/or additional modalities to enhance human-computer interaction. We present a new framework for employing eye gaze as a modality of interface. While voice commands, as means of interaction with computers, have been around for a number of years, integration of both the vocal interface and the visual interface, in terms of detecting user's eye movements through an eye-tracking device, is novel and promises to open the horizons for new applications where a hand-mouse interface provides little or no apparent support to the task to be accomplished. We present an array of applications to illustrate the new framework and eye-voice integration.

KW - ASL-504

KW - Eye Tracking

KW - Graphical User Interface

KW - Non-Haptic Devices

KW - Visual Navigation

KW - Visual User Interface

KW - Vocal User Interface

KW - Voice Commands

KW - Eye

KW - Visualization

KW - Human-machine interfaces

KW - Computing systems

KW - Image compression

KW - Control systems

KW - Video

KW - Tolerancing

KW - Video compression

KW - Optical tracking

UR - http://www.scopus.com/inward/record.url?scp=0042232142&partnerID=8YFLogxK

U2 - 10.1117/12.463748

DO - 10.1117/12.463748

M3 - Conference contribution

AN - SCOPUS:0042232142

SN - 0819446580

SN - 9780819446589

VL - 4877

T3 - Proceedings of SPIE - The International Society for Optical Engineering

SP - 115

EP - 125

BT - Opto-Ireland 2002

A2 - Shearer, Andrew

A2 - Murtagh, Fionn D.

A2 - Mahon, James

A2 - Whelan, Paul F.

PB - SPIE

T2 - Opto-Ireland 2002: Optical metrology, Imaging, and Machine Vision

Y2 - 5 September 2002 through 6 September 2002

ER -

Eye-movements and Voice as Interface Modalities to Computer Systems

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this