skip to main content
research-article
Open access

PilotAR: Streamlining Pilot Studies with OHMDs from Concept to Insight

Published: 09 September 2024 Publication History

Abstract

Pilot studies in HCI research serve as a cost-effective approach to validate potential ideas and identify impactful findings before extensive studies. Yet, the additional requirements of AR/MR, such as multi-view observations and increased multitasking, make it challenging to conduct pilot studies effectively, hindering innovations in this field. Based on interviews with 12 AR/MR researchers, we identified the key challenges associated with conducting AR/MR pilot studies with Optical See-Through Head-Mounted Displays (OST-HMDs, OHMDs), including the inability to observe and record in-context user interactions, increased task load, and difficulties with in-context data analysis and discussion. To tackle these challenges, we introduce PilotAR, a desktop-based tool designed iteratively to enhance OHMD-based AR/MR pilot studies. PilotAR facilitates data collection via live first-person and third-person views, multi-modal annotations, and flexible wizarding interfaces. It also accommodates multi-experimenter settings, streamlines the study process with configurable workflows and shortcuts, records annotated data, and eases results sharing. Formative testing, conducted using three case studies, has highlighted the significant benefits of PilotAR, as well as its potential for further development and refinement.

Supplemental Material

MP4 File - 30-second video preview
This 30-second video preview shows the PilotAR tool and its features.
MP4 File - Video figure of PilotAR tool
This video figure demonstrates the PilotAR tool, its features, and preliminary evaluations
JPG File - Thumbnail for the PilotAR tool
This image thumbnail shows the PilotAR tool interface

References

[1]
Günter Alce, Mattias Wallergård, and Klas Hermodsson. 2015. WozARd: a wizard of oz method for wearable augmented reality interaction---a pilot study. Advances in Human-Computer Interaction 2015 (June 2015). https://doi.org/10.1155/2015/271231
[2]
Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--13. https://doi.org/10.1145/3313831.3376722
[3]
Ronald T. Azuma. [n. d.]. The road to ubiquitous consumer augmented reality systems. 1, 1 ([n. d.]), 26--32. https://doi.org/10.1002/hbe2.113
[4]
Aaron Bangor, Philip T. Kortum, and James T. Miller. 2008. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 24, 6 (July 2008), 574--594. https://doi.org/10.1080/10447310802205776
[5]
Andrea Bellucci, Telmo Zarraonandia, Paloma Díaz, and Ignacio Aedo. 2021. Welicit: A Wizard of Oz Tool for VR Elicitation Studies. In Human-Computer Interaction - INTERACT 2021 (Lecture Notes in Computer Science), Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 82--91. https://doi.org/10.1007/978-3-030-85607-6_6
[6]
Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju Row-Farr. 2006. Can you see me now? ACM Transactions on Computer-Human Interaction 13, 1 (March 2006), 100--133. https://doi.org/10.1145/1143518.1143522
[7]
W. I. B. Beveridge. 2020. The art of scientific investigation.
[8]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oa
[9]
John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 7.
[10]
Jack Brookes, Matthew Warburton, Mshari Alghadier, Mark Mon-Williams, and Faisal Mushtaq. 2020. Studying human behavior with virtual reality: The Unity Experiment Framework. Behavior Research Methods 52, 2 (April 2020), 455--463. https://doi.org/10.3758/s13428-019-01242-0
[11]
Frederik Brudy, Suppachai Suwanwatcharachat, Wenyu Zhang, Steven Houben, and Nicolai Marquardt. 2018. EagleView: A Video Analysis Tool for Visualising and Querying Spatial Interactions of People and Devices. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). Association for Computing Machinery, New York, NY, USA, 61--72. https://doi.org/10.1145/3279778.3279795
[12]
Wolfgang Büschel, Anke Lehmann, and Raimund Dachselt. 2021. MIRIA: A Mixed Reality Toolkit for the In-Situ Visualization and Analysis of Spatio-Temporal Interaction Data. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3411764.3445651
[13]
Runze Cai, Nuwan Janaka, Yang Chen, Lucia Wang, Shengdong Zhao, and Can Liu. 2024. PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3613904.3642320
[14]
Scott Carter, Jennifer Mankoff, and Jeffrey Heer. 2007. Momento: support for situated ubicomp experimentation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 125--134. https://doi.org/10.1145/1240624.1240644
[15]
Kevin Chen and Haoqi Zhang. 2015. Remote Paper Prototype Testing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 77--80. https://doi.org/10.1145/2702123.2702423
[16]
C. M. Chewar, D. Scott McCrickard, and Alistair G. Sutcliffe. 2004. Unpacking critical parameters for interface design: evaluating notification systems with the IRC framework. In Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques (DIS '04). Association for Computing Machinery, New York, NY, USA, 279--288. https://doi.org/10.1145/1013115.1013155
[17]
Hyunsung Cho, Matthew L. Komar, and David Lindlbauer. 2023. RealityReplay: Detecting and Replaying Temporal Changes In Situ Using Mixed Reality. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (Sept. 2023), 90:1--90:25. https://doi.org/10.1145/3610888
[18]
N. Dahlbäck, A. Jönsson, and L. Ahrenberg. 1993. Wizard of Oz studies --- why and how. Knowledge-Based Systems 6, 4 (Dec. 1993), 258--266. https://doi.org/10.1016/0950- 7051(93)90017-N
[19]
Marco de Sá and Elizabeth Churchill. 2012. Mobile augmented reality: exploring design and prototyping techniques. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12). Association for Computing Machinery, New York, NY, USA, 221--230. https://doi.org/10.1145/2371574.2371608
[20]
Saul Delabrida, Thiago D'Angelo, and Ricardo A. Rabelo Oliveira. 2015. Fast prototyping of an AR HUD based on google cardboard API. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 1303--1306. https://doi.org/10.1145/2800835.2807928
[21]
Arindam Dey, Mark Billinghurst, Robert W. Lindeman, and J. Edward Swan. 2018. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Frontiers in Robotics and AI 5 (2018). https://doi.org/10.3389/frobt.2018.00037
[22]
Steven Dow, Jaemin Lee, Christopher Oezbek, Blair MacIntyre, Jay David Bolter, and Maribeth Gandy. 2005. Wizard of Oz interfaces for mixed reality applications. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). Association for Computing Machinery, New York, NY, USA, 1339--1342. https://doi.org/10.1145/1056808.1056911
[23]
S. Dow, B. MacIntyre, J. Lee, C. Oezbek, J.D. Bolter, and M. Gandy. 2005. Wizard of Oz support throughout an iterative design process. IEEE Pervasive Computing 4, 4 (Oct. 2005), 18--26. https://doi.org/10.1109/MPRV.2005.93 Conference Name: IEEE Pervasive Computing.
[24]
Gabriel Freitas, Marcio Sarroglia Pinho, Milene Selbach Silveira, and Frank Maurer. 2020. A Systematic Review of Rapid Prototyping Tools for Augmented Reality. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR). 199--209. https://doi.org/10.1109/SVR51698.2020.00041
[25]
Maribeth Gandy and Blair MacIntyre. 2014. Designer's augmented reality toolkit, ten years later: implications for new media authoring tools. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). Association for Computing Machinery, New York, NY, USA, 627--636. https://doi.org/10.1145/2642918.2647369
[26]
Uwe Gruenefeld, Jonas Auda, Florian Mathis, Stefan Schneegass, Mohamed Khamis, Jan Gugenheimer, and Sven Mayer. 2022. VRception: Rapid Prototyping of Cross-Reality Systems in Virtual Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3491102.3501821
[27]
Anhong Guo, Ilter Canberk, Hannah Murphy, Andrés Monroy-Hernández, and Rajan Vaish. 2019. Blocks: Collaborative and Persistent Augmented Reality Experiences. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (Sept. 2019), 83:1--83:24. https://doi.org/10.1145/3351241
[28]
Björn Hartmann, Leith Abdulla, Manas Mittal, and Scott R. Klemmer. 2007. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 145--154. https://doi.org/10.1145/1240624.1240646
[29]
Melody A. Hertzog. 2008. Considerations in determining sample size for pilot studies. Research in Nursing & Health 31, 2 (2008), 180--191. https://doi.org/10.1002/nur.20247
[30]
Sebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch, Johannes Zagermann, Niklas Elmqvist, and Harald Reiterer. 2022. ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User Studies. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1--20. https://doi.org/10.1145/3491102.3517550
[31]
Paul Israel. 2000. Edison: A Life of Invention (first edition ed.). John Wiley & Sons, New York, NY.
[32]
Yuta Itoh, Tobias Langlotz, Jonathan Sutton, and Alexander Plopski. 2021. Towards Indistinguishable Augmented Reality: A Survey on Optical See-through Head-mounted Displays. Comput. Surveys 54, 6 (July 2021), 120:1--120:36. https://doi.org/10.1145/3453157
[33]
Nuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao, Lan Lyu, Peisen Xu, Maximilian Nabokow, Silang Wang, and Yanch Ong. 2023. GlassMessaging: Towards Ubiquitous Messaging Using OHMDs. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (Sept. 2023), 100:1--100:32. https://doi.org/10.1145/3610931
[34]
Nuwan Janaka, Shengdong Zhao, David Hsu, Sherisse Tan Jing Wen, and Chun Keat Koh. 2024. TOM: A Development Platform For Wearable Intelligent Assistants. In Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing Pervasive and Ubiquitous Computing. ACM. https://doi.org/10.1145/3675094.3678382
[35]
Youn-ah Kang and John Stasko. 2008. Lightweight task/application performance using single versus multiple monitors: a comparative study. In Proceedings of Graphics Interface 2008 (GI '08). Canadian Information Processing Society, CAN, 17--24. https://dl.acm.org/doi/10.5555/1375714.1375718
[36]
Michael Kipp. 2014. ANVIL: The Video Annotation Research Tool. In The Oxford Handbook of Corpus Phonology, Jacques Durand, Ulrike Gut, and Gjert Kristoffersen (Eds.). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199571932.013.024
[37]
Veronika Krauß, Alexander Boden, Leif Oppermann, and René Reiners. 2021. Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application Development. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3411764.3445335
[38]
Jonathan Lazar. 2017. Research methods in human computer interaction (2nd edition ed.). Elsevier, Cambridge, MA.
[39]
David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--17. https://doi.org/10.1145/3173574.3173610
[40]
Minkyung Lee and Mark Billinghurst. 2008. A Wizard of Oz study for an AR multimodal interface. In Proceedings of the 10th international conference on Multimodal interfaces (ICMI '08). Association for Computing Machinery, New York, NY, USA, 249--256. https://doi.org/10.1145/1452392.1452444
[41]
Germán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2020. Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376160
[42]
Youn-Kyung Lim, Erik Stolterman, and Josh Tenenberg. 2008. The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas. ACM Transactions on Computer-Human Interaction 15, 2 (July 2008), 7:1--7:27. https://doi.org/10.1145/1375761.1375762
[43]
Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: a toolkit for rapid design exploration of augmented reality experiences. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST '04). Association for Computing Machinery, New York, NY, USA, 197--206. https://doi.org/10.1145/1029632.1029669
[44]
I. Scott MacKenzie. 2013. Human-computer interaction: an empirical research perspective (first edition ed.). Morgan Kaufmann is an imprint of Elsevier, Amsterdam.
[45]
Nicolai Marquardt, Frederico Schardong, and Anthony Tang. 2015. EXCITE: EXploring Collaborative Interaction in Tracked Environments. In Human-Computer Interaction - INTERACT 2015 (Lecture Notes in Computer Science), Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Springer International Publishing, Cham, 89--97. https://doi.org/10.1007/978-3-319-22668-2_8
[46]
Florian Müller, Joshua McManus, Sebastian Günther, Martin Schmitz, Max Mühlhäuser, and Markus Funk. 2019. Mind the Tap: Assessing Foot-Taps for Interacting with Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300707
[47]
Leon Müller, Ken Pfeuffer, Jan Gugenheimer, Bastian Pfleging, Sarah Prange, and Florian Alt. 2021. SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3411764.3445560
[48]
Michael Nebeling and Katy Madier. 2019. 360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300826
[49]
Michael Nebeling, Shwetha Rajaram, Liwei Wu, Yifei Cheng, and Jaylin Herskovitz. 2021. XRStudio: A Virtual Production and Live Streaming System for Immersive Instructional Experiences. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3411764.3445323
[50]
Michael Nebeling and Maximilian Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 333--337. https://doi.org/10.1109/ISMAR-Adjunct.2018.00098
[51]
Michael Nebeling, Maximilian Speicher, Xizi Wang, Shwetha Rajaram, Brian D. Hall, Zijian Xie, Alexander R. E. Raistrick, Michelle Aebersold, Edward G. Happ, Jiayin Wang, Yanan Sun, Lotus Zhang, Leah E. Ramsier, and Rhea Kulkarni. 2020. MRAT: The Mixed Reality Analytics Toolkit. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3313831.3376330
[52]
A. Ant Ozok. 2012. Survey Design and Implementation in HCI. In Human Computer Interaction Handbook (3 ed.). CRC Press. https://doi.org/10.1201/b11963
[53]
Michael Prilla and Lisa M. Rühmann. 2018. An Analysis Tool for Cooperative Mixed Reality Scenarios. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 31--35. https://doi.org/10.1109/ISMAR-Adjunct.2018.00026
[54]
Thibault Raffaillac and Stéphane Huot. 2022. What do Researchers Need when Implementing Novel Interaction Techniques? Proceedings of the ACM on Human-Computer Interaction 6, EICS (June 2022), 159:1--159:30. https://doi.org/10.1145/3532209
[55]
Jack Ratcliffe, Francesco Soave, Nick Bryan-Kinns, Laurissa Tokarchuk, and Ildar Farkhatdinov. 2021. Extended Reality (XR) Remote Research: a Survey of Drawbacks and Opportunities. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3411764.3445170
[56]
Alejandro Rey, Andrea Bellucci, Paloma Diaz, and Ignacio Aedo. 2021. A Tool for Monitoring and Controlling Standalone Immersive HCI Experiments. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21). Association for Computing Machinery, New York, NY, USA, 20--22. https://doi.org/10.1145/3474349.3480217
[57]
Alejandro Rey Lopez, Andrea Bellucci, Paloma Diaz Perez, and Ignacio Aedo Cuevas. 2022. IXCI:The Immersive eXperimenter Control Interface. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (AVI 2022). Association for Computing Machinery, New York, NY, USA, 1--3. https://doi.org/10.1145/3531073.3534489
[58]
Maria Rosala. 2020. The Critical Incident Technique in UX. https://www.nngroup.com/articles/critical-incident-technique/
[59]
Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is Mixed Reality?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3290605.3300767
[60]
Maximilian Speicher, Brian D. Hall, Ao Yu, Bowen Zhang, Haihua Zhang, Janet Nebeling, and Michael Nebeling. 2018. XD-AR: Challenges and Opportunities in Cross-Device Augmented Reality Application Development. Proceedings of the ACM on Human-Computer Interaction 2, EICS (June 2018), 7:1--7:24. https://doi.org/10.1145/3229089
[61]
Yuki Sugita, Keita Higuchi, Ryo Yonetani, Rie Kamikubo, and Yoichi Sato. 2018. Browsing Group First-Person Videos with 3D Visualization. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). Association for Computing Machinery, New York, NY, USA, 55--60. https://doi.org/10.1145/3279778.3279783
[62]
Lehana Thabane, Jinhui Ma, Rong Chu, Ji Cheng, Afisi Ismaila, Lorena P. Rios, Reid Robson, Marroon Thabane, Lora Giangregorio, and Charles H. Goldsmith. 2010. A tutorial on pilot studies: the what, why and how. BMC Medical Research Methodology 10, 1 (Jan. 2010), 1. https://doi.org/10.1186/1471-2288-10-1
[63]
Stefan H. Thomke. 2003. Experimentation Matters: Unlocking the Potential of New Technologies for Innovation. Harvard Business Review Press, Boston, Mass.
[64]
Khai Truong. 2017. Pilot Studies: When and how to conduct them when conducting user studies. GetMobile: Mobile Computing and Communications 20, 4 (April 2017), 8--11. https://doi.org/10.1145/3081016.3081020
[65]
Edward R. Tufte. 2013. The Visual Display of Quantitative Information. Cheshire, Conn.
[66]
Edwin R. van Teijlingen and Vanora Hundley. 2001. The importance of pilot studies. (2001). https://aura.abdn.ac.uk/handle/2164/157
[67]
Edwin R. Van Teijlingen, Anne-Marie Rennie, Vanora Hundley, and Wendy Graham. 2001. The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey. Journal of Advanced Nursing 34, 3 (2001), 289--295. https://doi.org/10.1046/j.1365-2648.2001.01757.x
[68]
Christian David Vazquez, Afika Ayanda Nyati, Alexander Luh, Megan Fu, Takako Aikawa, and Pattie Maes. 2017. Serendipitous Language Learning in Mixed Reality. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17. ACM Press, Denver, Colorado, USA, 2172--2179. https://doi.org/10.1145/3027063.3053098 00000.
[69]
Chat Wacharamanotham, Lukas Eisenring, Steve Haroz, and Florian Echtler. 2020. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--14. https://doi.org/10.1145/3313831.3376448
[70]
Maurice Waite. 2002. Concise oxford thesaurus in clair A-Z from. Oxford University Press. https://pks.pua.edu.eg/social_sciences_books/2320
[71]
Tianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Yuanzhi Cao, and Karthik Ramani. 2021. GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21). Association for Computing Machinery, New York, NY, USA, 552--567. https://doi.org/10.1145/3472749.3474769
[72]
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 13. https://doi.org/10.1145/329124.329126
[73]
Xuhai Xu, Anna Yu, Tanya R. Jonker, Kashyap Todi, Feiyu Lu, Xun Qian, João Marcelo Evangelista Belo, Tianyi Wang, Michelle Li, Aran Mun, Te-Yen Wu, Junxiao Shen, Ting Zhang, Narine Kokhlikyan, Fulton Wang, Paul Sorenson, Sophie Kim, and Hrvoje Benko. 2023. XAIR: A Framework of Explainable AI in Augmented Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1--30. https://doi.org/10.1145/3544548.3581500
[74]
Hui Ye and Hongbo Fu. 2022. ProGesAR: Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced Spaces. In CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3491102.3517689
[75]
Shengdong Zhao, Felicia Tan, and Katherine Fennedy. 2023. Heads-Up Computing Moving Beyond the Device-Centered Paradigm. Commun. ACM 66, 9 (Aug. 2023), 56--63. https://doi.org/10.1145/3571722
[76]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 493--502. https://doi.org/10.1145/1240624.1240704
[77]
Patrick H. Zimmerman, J. Elizabeth Bolhuis, Albert Willemsen, Erik S. Meyer, and Lucas P. J. J. Noldus. 2009. The Observer XT: A tool for the integration and synchronization of multimodal signals. Behavior Research Methods 41, 3 (Aug. 2009), 731--735. https://doi.org/10.3758/BRM.41.3.731

Cited By

View all
  • (2024)Towards Intelligent Wearable AssistantsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678989(618-621)Online publication date: 5-Oct-2024
  • (2024)TOM: A Development Platform For Wearable Intelligent AssistantsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678382(837-843)Online publication date: 5-Oct-2024
  • (2024)Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMDCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677554(230-234)Online publication date: 5-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 3
August 2024
1782 pages
EISSN:2474-9567
DOI:10.1145/3695755
Issue’s Table of Contents
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2024
Published in IMWUT Volume 8, Issue 3

Check for updates

Author Tags

  1. OST-HMD
  2. augmented reality
  3. evaluation
  4. heads-up computing
  5. interaction
  6. pilot
  7. smart glasses
  8. tool
  9. toolkit

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Research Foundation, Singapore
  • CityU Start-up Grant

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)147
  • Downloads (Last 6 weeks)147
Reflects downloads up to 10 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Towards Intelligent Wearable AssistantsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678989(618-621)Online publication date: 5-Oct-2024
  • (2024)TOM: A Development Platform For Wearable Intelligent AssistantsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678382(837-843)Online publication date: 5-Oct-2024
  • (2024)Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMDCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677554(230-234)Online publication date: 5-Oct-2024
  • (2024)Demonstrating TOM: A Development Platform For Wearable Intelligent AssistantsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677551(214-219)Online publication date: 5-Oct-2024
  • (2024)Demonstrating TOM: A Development Platform for Wearable Intelligent Assistants in Daily ActivitiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680445(1-6)Online publication date: 21-Sep-2024
  • (2024)"What's this?": Understanding User Interaction Behaviour with Multimodal Input Information Retrieval SystemAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680230(1-7)Online publication date: 21-Sep-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media