test Browse by Author Names Browse by Titles of Works Browse by Subjects of Works Browse by Issue Dates of Works

Advanced Search
& Collections
Issue Date   
Sign on to:   
Receive email
My Account
authorized users
Edit Profile   
About T-Space   

T-Space at The University of Toronto Libraries >
School of Graduate Studies - Theses >
Doctoral >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1807/24905

Title: Direct Pen Input and Hand Occlusion
Authors: Vogel, Daniel
Advisor: Balakrishnan, Ravin
Department: Computer Science
Keywords: human-computer interaction
pen computing
hand occlusion
interaction techniques
human factors
graphical user interface
image processing
Issue Date: 1-Sep-2010
Abstract: We investigate, model, and design interaction techniques for hand occlusion with direct pen input. Our focus on occlusion follows from a qualitative and quantitative study of direct pen usability with a conventional graphical user interface (GUI). This study reveals overarching problems relating to poor precision, ergonomics, cognitive differences, limited input, and problems resulting from occlusion. To investigate occlusion more closely, we conduct three formal experiments to examine its area and shape, its affect on performance, and compensatory postures. We find that the shape of the occluded area varies across participants with some common characteristics. Our results provide evidence that occlusion affects target selection performance: especially for continuous tasks or when the goal is initially hidden. We observe how users contort their wrist posture during a simultaneous monitoring task, and show this can increase task time. Based on these investigations, we develop a five parameter geometric model to represent the shape of the occluded area and extend this to a user configurable, real-time version. To evaluate our model, we introduce a novel analytic testing methodology using optimization for geometric fitting and precision-recall statistics for comparison; as well as conducting a user study. To address problems with occlusion, we introduce the notion of occlusion-aware interfaces: techniques which can use our configurable model to track currently occluded regions and then counteract potential problems and/or utilize the occluded area. As a case study, we present the Occlusion-Aware Viewer: an interaction technique which displays otherwise missed previews and status messages in a non-occluded area. Within this thesis we also present a number of methodology contributions for quantitative and qualitative study design, multi-faceted study logging using synchronized video, qualitative analysis, image-based analysis, task visualization, optimization-based analytical testing, and user interface image processing.
URI: http://hdl.handle.net/1807/24905
Appears in Collections:Doctoral
Department of Computer Science - Doctoral theses

Files in This Item:

File Description SizeFormat
Vogel_Daniel_J_201006_PhD_thesis.pdfThesis12.61 MBAdobe PDF
Vogel_Daniel_J_201006_PhD_video_3_1.mp4Video 3 1. Time-lapse demonstration of study scenario7.68 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_3_2.mp4Video 3 2. Obtrusive tooltip hover visualization examples3.42 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_3_3.mp4Video 3 3. Occlusion contortion examples5.82 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_3_4.mp4Video 3 4. Button trajectory example1.34 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_3_5.mp4Video 3-5. Scrollbar trajectory examples2.94 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_3_6.mp4Video 3-6. Text selection trajectory examples5.22 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_4_1.mp4Video 4-1. Area and shape experiment demonstration4.25 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_4_2.mp4Video 4-2. Performance experiment demonstration4.79 MBVideo MPEG-4 H.264 AAC View/Open
Vogel_Daniel_J_201006_PhD_video_4_3.mp4Video 4-3. Simultaneous monitoring demonstration2.14 MBVideo MPEG-4 H.264 AACView/Open
Vogel_Daniel_J_201006_PhD_video_5_1.mp4Video 5-1. Geometric model fitting demonstration4.44 MBVideo MPEG-4 H.264 AACView/Open
Vogel_Daniel_J_201006_PhD_video_5_2.mp4 Video 5-2. Model configuration demonstration5.3 MBVideo MPEG-4 H.264 AACView/Open
Vogel_Daniel_J_201006_PhD_video_6_1.mp4Video 6-1. Occlusion-Aware Viewer demonstration8.65 MBVideo MPEG-4 H.264 AACView/Open
Vogel_Daniel_J_201006_PhD_video_6_2.mp4Video 6-2. Occlusion-Aware Viewer experiment demonstration4.51 MBVideo MPEG-4 H.264 AACView/Open
Vogel_Daniel_J_201006_PhD_video_6_3.mp4Video 6-3. Occlusion-Aware Dragging technique demonstration1.97 MBVideo MPEG-4 H.264 AACView/Open

This item is licensed under a Creative Commons License
Creative Commons

Items in T-Space are protected by copyright, with all rights reserved, unless otherwise indicated.