{"id":81,"date":"2011-09-15T15:46:06","date_gmt":"2011-09-15T15:46:06","guid":{"rendered":"https:\/\/physicality.org\/TouchIT\/?page_id=81"},"modified":"2022-08-16T08:41:10","modified_gmt":"2022-08-16T08:41:10","slug":"hybrid-devices","status":"publish","type":"page","link":"https:\/\/physicality.org\/TouchIT\/touchit-draft\/objects-things\/hybrid-devices\/","title":{"rendered":"Hybrid Devices"},"content":{"rendered":"<div class=\"ad-post-wrapper sem_context\" sem_context_url=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/objects-things\/hybrid-devices\/\"><div class=\"touchit_page_controls\"><\/div>\n<p><!-- get_post_meta(bibref_data) for 583 = Array\n(\n    [bibcites] => Array\n        (\n            [Ne68] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:1\n                                )\n\n                        )\n\n                )\n\n            [Wa76] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:2\n                                )\n\n                        )\n\n                )\n\n            [WM09] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:3\n                                )\n\n                        )\n\n                )\n\n            [Bu90] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:4\n                                )\n\n                        )\n\n                )\n\n            [BS05] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:5\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:6\n                                )\n\n                        )\n\n                    [2] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:7\n                                )\n\n                        )\n\n                )\n\n            [No98] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.6\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:8\n                                )\n\n                        )\n\n                )\n\n            [Re90] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.6\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:9\n                                )\n\n                        )\n\n                )\n\n            [DG09] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:10\n                                )\n\n                        )\n\n                )\n\n            [DG17] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:11\n                                )\n\n                        )\n\n                )\n\n            [Th08] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:12\n                                )\n\n                        )\n\n                )\n\n            [MS91] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:13\n                                )\n\n                        )\n\n                )\n\n            [Li02] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => bibcite:14\n                                )\n\n                        )\n\n                )\n\n        )\n\n    [bibitems] => Array\n        (\n            [BS05] => Array\n                (\n                    [name] => BS05\n                    [index] => 1\n                    [content] => S. Benford, H. Schn\u00e4delbach, B. Koleva, R. Anastasi, S. Greenhalgh, T. Rodden, J. Green, A. Ghali, T. Pridmore, B. Gaver, A. Boucher, B. Walker, S. Pennington, A. Schmidt, H. Gellersen &amp; A. Steed. Expected, sensed, and desired: A framework for designing sensing-based interaction (, ACM Transactions on Computer-Human Interaction, TOCHI, Volume 12 Issue 1, March 2005)\n                )\n\n            [Bu90] => Array\n                (\n                    [name] => Bu90\n                    [index] => 2\n                    [content] => <span style=\"font-family: Times New Roman,Times;\">Buxton, W. (1990). A Three-State Model of Graphical Input. In D. Diaper et al. (Eds), <em>Human-Computer Interaction &#8211; INTERACT &#8217;90<\/em>. Amsterdam: Elsevier Science Publishers B.V. (North-Holland), 449-456. <\/span>http:\/\/www.billbuxton.com\/3state.html\n                )\n\n            [DG09] => Array\n                (\n                    [name] => DG09\n                    [index] => 3\n                    [content] => A. Dix, M. Ghazali, S. Gill, J. Hare and D. Ramduny-Ellis (2009). Physigrams: Modelling Devices for Natural Interaction. Formal Aspects of Computing , Springer, 21(6):613-641, doi:10.1007\/s00165-008-0099-y http:\/\/alandix.com\/academic\/papers\/FAC-physical-2009\/\n                )\n\n            [DG17] => Array\n                (\n                    [name] => DG17\n                    [index] => 4\n                    [content] => Alan Dix and Masitah Ghazali (2017). Physigrams: Modelling Physical Device Characteristics Interaction. Chapter 9 in <em>The Handbook of Formal Methods in Human-Computer Interaction<\/em>, Springer, pp.247\u2013271. DOI: 10.1007\/978-3-319-51838-1_9\n                )\n\n            [Li02] => Array\n                (\n                    [name] => Li02\n                    [index] => 5\n                    [content] => Rodolfo Llin\u00e1s (2002). I of the Vortex: From Neurons to Self. MIT Press.\n                )\n\n            [MS91] => Array\n                (\n                    [name] => MS91\n                    [index] => 6\n                    [content] => MacKenzie, I. S., Sellen, A., &amp; Buxton, W. (1991). A comparison of input devices in elemental pointing and dragging tasks.\u00a0<i>Proceedings of the CHI `91 Conference on Human Factors in Computing Systems<\/i>, pp. 161-166. New York: ACM.\n                )\n\n            [Ne68] => Array\n                (\n                    [name] => Ne68\n                    [index] => 7\n                    [content] => Newman, W. M. 1968. A system for interactive graphical programming. In Proceedings of the April 30&#8211;May 2, 1968, Spring Joint Computer Conference (Atlantic City, New Jersey, April 30 &#8211; May 02, 1968). AFIPS &#8217;68 (Spring). ACM, New York, NY, 47-54. DOI= http:\/\/doi.acm.org\/10.1145\/1468075.1468083\n                )\n\n            [No98] => Array\n                (\n                    [name] => No98\n                    [index] => 8\n                    [content] => \u00a0 Donald A. Norman, The Design of Everyday Things. MIT Press, 1998,\u00a0 ISBN-10: 0-262-64037-6\n                )\n\n            [Re90] => Array\n                (\n                    [name] => Re90\n                    [index] => 9\n                    [content] => Reason, James (1990): Human Error. New York, NY, Cambridge University Press\n                )\n\n            [Th08] => Array\n                (\n                    [name] => Th08\n                    [index] => 10\n                    [content] => \u00a0 Thimbleby, H. (2008) <strong>\u2018<\/strong><strong>Ignorance of interaction programming is killing people\u2019 ACM Interactions,<\/strong> Volume 15 Issue 5, September + October 2008ACM, New York, NY, USA\n                )\n\n            [Wa76] => Array\n                (\n                    [name] => Wa76\n                    [index] => 11\n                    [content] => Wallace, V. L. 1976. The semantics of graphic input devices. SIGGRAPH Comput. Graph. 10, 1 (May. 1976), 61-65. DOI= http:\/\/doi.acm.org\/10.1145\/957197.804734\n                )\n\n            [WM09] => Array\n                (\n                    [name] => WM09\n                    [index] => 12\n                    [content] => Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In\u00a0Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u00a0(CHI &#8217;09). ACM, New York, NY, USA, 1083-1092. DOI: https:\/\/doi.org\/10.1145\/1518701.1518866\n                )\n\n        )\n\n    [xref_uses] => Array\n        (\n            [fg:etch-a-sketch] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:1\n                                )\n\n                        )\n\n                )\n\n            [ch:body-and-mind] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:2\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:32\n                                )\n\n                        )\n\n                )\n\n            [ch:design-lessons] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:3\n                                )\n\n                        )\n\n                )\n\n            [bx:elements.how-many-computers] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:4\n                                )\n\n                        )\n\n                )\n\n            [fg:pepper-grinder] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:5\n                                )\n\n                        )\n\n                )\n\n            [fg:power-sockets] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:6\n                                )\n\n                        )\n\n                )\n\n            [fg:microwave] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:7\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:8\n                                )\n\n                        )\n\n                )\n\n            [ch:interacting-with-physical-objects] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:9\n                                )\n\n                        )\n\n                )\n\n            [fg:augurscope] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:10\n                                )\n\n                        )\n\n                )\n\n            [fg:sensed-desired] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.5\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:11\n                                )\n\n                        )\n\n                )\n\n            [fg:feedback-loops] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.6\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:12\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:16\n                                )\n\n                        )\n\n                )\n\n            [ch:sota] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.6\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:13\n                                )\n\n                        )\n\n                )\n\n            [ch:prototyping] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.6\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:14\n                                )\n\n                        )\n\n                )\n\n            [fg:phone-states] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:15\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:18\n                                )\n\n                        )\n\n                )\n\n            [fg:light-switch-2-states] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:17\n                                )\n\n                        )\n\n                )\n\n            [fg:exposed-state] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.1\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:19\n                                )\n\n                        )\n\n                )\n\n            [fg:CD-hidden-state] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:20\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:26\n                                )\n\n                        )\n\n                )\n\n            [ch:physicality-of-things] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:21\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:22\n                                )\n\n                        )\n\n                    [2] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:33\n                                )\n\n                        )\n\n                )\n\n            [fg:dishwasher] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:23\n                                )\n\n                        )\n\n                )\n\n            [fg:computer-on-off] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:24\n                                )\n\n                        )\n\n                    [1] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.2\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:25\n                                )\n\n                        )\n\n                )\n\n            [fg:photo-viewer] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:27\n                                )\n\n                        )\n\n                )\n\n            [fg:light-switch-part-way] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.3\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:28\n                                )\n\n                        )\n\n                )\n\n            [bx:driving-backwards] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:29\n                                )\n\n                        )\n\n                )\n\n            [fg:minidisk] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:30\n                                )\n\n                        )\n\n                )\n\n            [fg:old-phone] => Array\n                (\n                    [0] => Array\n                        (\n                            [loc] => Array\n                                (\n                                    [postid] => 583\n                                    [block_id] => sc:9.7.4\n                                    [chapter] => Array\n                                        (\n                                            [slug] => hybrid-devices\n                                            [chapter] => ch:hybrid-devices\n                                            [chapnos] => 9\n                                        )\n\n                                    [slug] => xu:31\n                                )\n\n                        )\n\n                )\n\n        )\n\n    [xref_defs] => Array\n        (\n            [fg:first-mouse] => Array\n                (\n                    [name] => fg:hybrid-devices.first-mouse\n                    [postid] => 583\n                    [slug] => fg:first-mouse\n                    [local] => fg:first-mouse\n                    [global] => fg:hybrid-devices.first-mouse\n                    [value] => 9.1\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:light-pen] => Array\n                (\n                    [name] => fg:hybrid-devices.light-pen\n                    [postid] => 583\n                    [slug] => fg:light-pen\n                    [local] => fg:light-pen\n                    [global] => fg:hybrid-devices.light-pen\n                    [value] => 9.2\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:etch-a-sketch] => Array\n                (\n                    [name] => fg:hybrid-devices.etch-a-sketch\n                    [postid] => 583\n                    [slug] => fg:etch-a-sketch\n                    [local] => fg:etch-a-sketch\n                    [global] => fg:hybrid-devices.etch-a-sketch\n                    [value] => 9.3\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:pepper-grinder] => Array\n                (\n                    [name] => fg:hybrid-devices.pepper-grinder\n                    [postid] => 583\n                    [slug] => fg:pepper-grinder\n                    [local] => fg:pepper-grinder\n                    [global] => fg:hybrid-devices.pepper-grinder\n                    [value] => 9.4\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:cooker-knobs] => Array\n                (\n                    [name] => fg:hybrid-devices.cooker-knobs\n                    [postid] => 583\n                    [slug] => fg:cooker-knobs\n                    [local] => fg:cooker-knobs\n                    [global] => fg:hybrid-devices.cooker-knobs\n                    [value] => 9.5\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:power-sockets] => Array\n                (\n                    [name] => fg:hybrid-devices.power-sockets\n                    [postid] => 583\n                    [slug] => fg:power-sockets\n                    [local] => fg:power-sockets\n                    [global] => fg:hybrid-devices.power-sockets\n                    [value] => 9.6\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:microwave] => Array\n                (\n                    [name] => fg:hybrid-devices.microwave\n                    [postid] => 583\n                    [slug] => fg:microwave\n                    [local] => fg:microwave\n                    [global] => fg:hybrid-devices.microwave\n                    [value] => 9.7\n                    [type] => figure\n                    [content] => \n                )\n\n            [bx:scroll-bar] => Array\n                (\n                    [name] => bx:hybrid-devices.scroll-bar\n                    [postid] => 583\n                    [slug] => bx:scroll-bar\n                    [local] => bx:scroll-bar\n                    [global] => bx:hybrid-devices.scroll-bar\n                    [value] => 9.1\n                    [type] => box\n                    [content] => \n                )\n\n            [fg:augurscope] => Array\n                (\n                    [name] => fg:hybrid-devices.augurscope\n                    [postid] => 583\n                    [slug] => fg:augurscope\n                    [local] => fg:augurscope\n                    [global] => fg:hybrid-devices.augurscope\n                    [value] => 9.8\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:sensed-desired] => Array\n                (\n                    [name] => fg:hybrid-devices.sensed-desired\n                    [postid] => 583\n                    [slug] => fg:sensed-desired\n                    [local] => fg:sensed-desired\n                    [global] => fg:hybrid-devices.sensed-desired\n                    [value] => 9.9\n                    [type] => figure\n                    [content] => \n                )\n\n            [bx:physicality-based-digital-input] => Array\n                (\n                    [name] => bx:hybrid-devices.physicality-based-digital-input\n                    [postid] => 583\n                    [slug] => bx:physicality-based-digital-input\n                    [local] => bx:physicality-based-digital-input\n                    [global] => bx:hybrid-devices.physicality-based-digital-input\n                    [value] => 9.2\n                    [type] => box\n                    [content] => \n                )\n\n            [fg:feedback-loops] => Array\n                (\n                    [name] => fg:hybrid-devices.feedback-loops\n                    [postid] => 583\n                    [slug] => fg:feedback-loops\n                    [local] => fg:feedback-loops\n                    [global] => fg:hybrid-devices.feedback-loops\n                    [value] => 9.10\n                    [type] => figure\n                    [content] => \n                )\n\n            [sc:device-unplugged] => Array\n                (\n                    [name] => sc:hybrid-devices.device-unplugged\n                    [postid] => 583\n                    [slug] => sc:device-unplugged\n                    [local] => sc:device-unplugged\n                    [global] => sc:hybrid-devices.device-unplugged\n                    [value] => 9.7\n                    [type] => section\n                    [content] => \n                )\n\n            [fg:phone-states] => Array\n                (\n                    [name] => fg:hybrid-devices.phone-states\n                    [postid] => 583\n                    [slug] => fg:phone-states\n                    [local] => fg:phone-states\n                    [global] => fg:hybrid-devices.phone-states\n                    [value] => 9.11\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:light-switch-2-states] => Array\n                (\n                    [name] => fg:hybrid-devices.light-switch-2-states\n                    [postid] => 583\n                    [slug] => fg:light-switch-2-states\n                    [local] => fg:light-switch-2-states\n                    [global] => fg:hybrid-devices.light-switch-2-states\n                    [value] => 9.12\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:exposed-state] => Array\n                (\n                    [name] => fg:hybrid-devices.exposed-state\n                    [postid] => 583\n                    [slug] => fg:exposed-state\n                    [local] => fg:exposed-state\n                    [global] => fg:hybrid-devices.exposed-state\n                    [value] => 9.13\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:CD-hidden-state] => Array\n                (\n                    [name] => fg:hybrid-devices.CD-hidden-state\n                    [postid] => 583\n                    [slug] => fg:CD-hidden-state\n                    [local] => fg:CD-hidden-state\n                    [global] => fg:hybrid-devices.CD-hidden-state\n                    [value] => 9.14\n                    [type] => figure\n                    [content] => \n                )\n\n            [bx:infusion] => Array\n                (\n                    [name] => bx:hybrid-devices.infusion\n                    [postid] => 583\n                    [slug] => bx:infusion\n                    [local] => bx:infusion\n                    [global] => bx:hybrid-devices.infusion\n                    [value] => 9.3\n                    [type] => box\n                    [content] => \n                )\n\n            [fg:dishwasher] => Array\n                (\n                    [name] => fg:hybrid-devices.dishwasher\n                    [postid] => 583\n                    [slug] => fg:dishwasher\n                    [local] => fg:dishwasher\n                    [global] => fg:hybrid-devices.dishwasher\n                    [value] => 9.15\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:computer-on-off] => Array\n                (\n                    [name] => fg:hybrid-devices.computer-on-off\n                    [postid] => 583\n                    [slug] => fg:computer-on-off\n                    [local] => fg:computer-on-off\n                    [global] => fg:hybrid-devices.computer-on-off\n                    [value] => 9.16\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:photo-viewer] => Array\n                (\n                    [name] => fg:hybrid-devices.photo-viewer\n                    [postid] => 583\n                    [slug] => fg:photo-viewer\n                    [local] => fg:photo-viewer\n                    [global] => fg:hybrid-devices.photo-viewer\n                    [value] => 9.17\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:light-switch-part-way] => Array\n                (\n                    [name] => fg:hybrid-devices.light-switch-part-way\n                    [postid] => 583\n                    [slug] => fg:light-switch-part-way\n                    [local] => fg:light-switch-part-way\n                    [global] => fg:hybrid-devices.light-switch-part-way\n                    [value] => 9.18\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:minidisk] => Array\n                (\n                    [name] => fg:hybrid-devices.minidisk\n                    [postid] => 583\n                    [slug] => fg:minidisk\n                    [local] => fg:minidisk\n                    [global] => fg:hybrid-devices.minidisk\n                    [value] => 9.19\n                    [type] => figure\n                    [content] => \n                )\n\n            [fg:old-phone] => Array\n                (\n                    [name] => fg:hybrid-devices.old-phone\n                    [postid] => 583\n                    [slug] => fg:old-phone\n                    [local] => fg:old-phone\n                    [global] => fg:hybrid-devices.old-phone\n                    [value] => 9.20\n                    [type] => figure\n                    [content] => \n                )\n\n            [bx:driving-backwards] => Array\n                (\n                    [name] => bx:hybrid-devices.driving-backwards\n                    [postid] => 583\n                    [slug] => bx:driving-backwards\n                    [local] => bx:driving-backwards\n                    [global] => bx:hybrid-devices.driving-backwards\n                    [value] => 9.4\n                    [type] => box\n                    [content] => \n                )\n\n        )\n\n    [counters] => Array\n        (\n            [] => \n            [section] => 7\n            [subsection] => 4\n            [inner-section] => 0\n            [figure] => 20\n            [box] => 4\n        )\n\n    [elements] => Array\n        (\n            [ch:9] => Array\n                (\n                    [doc_id] => ch:9\n                    [type] => chapter\n                    [counter] => chapter\n                    [order] => 9\n                    [link_label] => 9\n                    [link_id] => ch:9\n                    [xrefs] => Array\n                        (\n                            [ch:hybrid-devices] => 1\n                        )\n\n                    [title] => Hybrid Devices\n                )\n\n            [sc:9.1] => Array\n                (\n                    [doc_id] => sc:9.1\n                    [type] => section\n                    [counter] => section\n                    [order] => 1\n                    [link_label] => 9.1\n                    [link_id] => sc:9.1\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Abstraction &#8212; software as if hardware doesn&#8217;t matter\n                )\n\n            [fg:9.1] => Array\n                (\n                    [doc_id] => fg:9.1\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 1\n                    [link_label] => 9.1\n                    [link_id] => fg:9.1\n                    [xrefs] => Array\n                        (\n                            [fg:first-mouse] => 1\n                        )\n\n                    [title] => Douglas Engelbart&#8217;s first mouse\n                    [has_caption] => 1\n                )\n\n            [fg:9.2] => Array\n                (\n                    [doc_id] => fg:9.2\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 2\n                    [link_label] => 9.2\n                    [link_id] => fg:9.2\n                    [xrefs] => Array\n                        (\n                            [fg:light-pen] => 1\n                        )\n\n                    [title] => Light pen in use\n                    [has_caption] => 1\n                )\n\n            [sc:9.2] => Array\n                (\n                    [doc_id] => sc:9.2\n                    [type] => section\n                    [counter] => section\n                    [order] => 2\n                    [link_label] => 9.2\n                    [link_id] => sc:9.2\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => The limits of hardware abstraction\n                )\n\n            [fg:9.3] => Array\n                (\n                    [doc_id] => fg:9.3\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 3\n                    [link_label] => 9.3\n                    [link_id] => fg:9.3\n                    [xrefs] => Array\n                        (\n                            [fg:etch-a-sketch] => 1\n                        )\n\n                    [title] => Etch-a-Sketch\n                    [has_caption] => 1\n                )\n\n            [sc:9.3] => Array\n                (\n                    [doc_id] => sc:9.3\n                    [type] => section\n                    [counter] => section\n                    [order] => 3\n                    [link_label] => 9.3\n                    [link_id] => sc:9.3\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Specialisation &#8212; computer-embedded devices\n                )\n\n            [sc:9.4] => Array\n                (\n                    [doc_id] => sc:9.4\n                    [type] => section\n                    [counter] => section\n                    [order] => 4\n                    [link_label] => 9.4\n                    [link_id] => sc:9.4\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => What does it do?\n                )\n\n            [fg:9.4] => Array\n                (\n                    [doc_id] => fg:9.4\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 4\n                    [link_label] => 9.4\n                    [link_id] => fg:9.4\n                    [xrefs] => Array\n                        (\n                            [fg:pepper-grinder] => 1\n                        )\n\n                    [title] => Pepper grinder\n                    [has_caption] => 1\n                )\n\n            [sc:9.5] => Array\n                (\n                    [doc_id] => sc:9.5\n                    [type] => section\n                    [counter] => section\n                    [order] => 5\n                    [link_label] => 9.5\n                    [link_id] => sc:9.5\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Mapping\n                )\n\n            [fg:9.5] => Array\n                (\n                    [doc_id] => fg:9.5\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 5\n                    [link_label] => 9.5\n                    [link_id] => fg:9.5\n                    [xrefs] => Array\n                        (\n                            [fg:cooker-knobs] => 1\n                        )\n\n                    [title] => Cooker hob knobs &#8212; note picture above each to attempt to clarify mapping\n                    [has_caption] => 1\n                )\n\n            [fg:9.6] => Array\n                (\n                    [doc_id] => fg:9.6\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 6\n                    [link_label] => 9.6\n                    [link_id] => fg:9.6\n                    [xrefs] => Array\n                        (\n                            [fg:power-sockets] => 1\n                        )\n\n                    [title] => . (i) power socket switches have clear physical correspondence, but (ii) what do these light switches do?\n                    [has_caption] => 1\n                )\n\n            [fg:9.7] => Array\n                (\n                    [doc_id] => fg:9.7\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 7\n                    [link_label] => 9.7\n                    [link_id] => fg:9.7\n                    [xrefs] => Array\n                        (\n                            [fg:microwave] => 1\n                        )\n\n                    [title] => Microwave oven control panel\n                    [has_caption] => 1\n                )\n\n            [bx:9.1] => Array\n                (\n                    [doc_id] => bx:9.1\n                    [type] => box\n                    [counter] => box\n                    [order] => 1\n                    [link_label] => 9.1\n                    [link_id] => bx:9.1\n                    [xrefs] => Array\n                        (\n                            [bx:scroll-bar] => 1\n                        )\n\n                    [title] => Why are software scroll bars on the right-hand side of the screen?\n                    [has_caption] => 1\n                )\n\n            [fg:9.8] => Array\n                (\n                    [doc_id] => fg:9.8\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 8\n                    [link_label] => 9.8\n                    [link_id] => fg:9.8\n                    [xrefs] => Array\n                        (\n                            [fg:augurscope] => 1\n                        )\n\n                    [title] => The Augurscope II, stand-mounted and hand-held (from [BS05])\n                    [has_caption] => 1\n                )\n\n            [fg:9.9] => Array\n                (\n                    [doc_id] => fg:9.9\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 9\n                    [link_label] => 9.9\n                    [link_id] => fg:9.9\n                    [xrefs] => Array\n                        (\n                            [fg:sensed-desired] => 1\n                        )\n\n                    [title] => Overlaps and gaps identified by the framework (adapted from [BS05])\n                    [has_caption] => 1\n                )\n\n            [sc:9.6] => Array\n                (\n                    [doc_id] => sc:9.6\n                    [type] => section\n                    [counter] => section\n                    [order] => 6\n                    [link_label] => 9.6\n                    [link_id] => sc:9.6\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Feedback\n                )\n\n            [bx:9.2] => Array\n                (\n                    [doc_id] => bx:9.2\n                    [type] => box\n                    [counter] => box\n                    [order] => 2\n                    [link_label] => 9.2\n                    [link_id] => bx:9.2\n                    [xrefs] => Array\n                        (\n                            [bx:physicality-based-digital-input] => 1\n                        )\n\n                    [title] => Physicality-based digital input\n                    [has_caption] => 1\n                )\n\n            [fg:9.10] => Array\n                (\n                    [doc_id] => fg:9.10\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 10\n                    [link_label] => 9.10\n                    [link_id] => fg:9.10\n                    [xrefs] => Array\n                        (\n                            [fg:feedback-loops] => 1\n                        )\n\n                    [title] => Multiple feedback loops\n                    [has_caption] => 1\n                )\n\n            [sc:9.7] => Array\n                (\n                    [doc_id] => sc:9.7\n                    [type] => section\n                    [counter] => section\n                    [order] => 7\n                    [link_label] => 9.7\n                    [link_id] => sc:9.7\n                    [xrefs] => Array\n                        (\n                            [sc:device-unplugged] => 1\n                        )\n\n                    [title] => The device unplugged\n                )\n\n            [fg:9.11] => Array\n                (\n                    [doc_id] => fg:9.11\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 11\n                    [link_label] => 9.11\n                    [link_id] => fg:9.11\n                    [xrefs] => Array\n                        (\n                            [fg:phone-states] => 1\n                        )\n\n                    [title] => (i) a nice mirror (ii) buttons to push and (iii) slide the phone in and out\n                    [has_caption] => 1\n                )\n\n            [sc:9.7.1] => Array\n                (\n                    [doc_id] => sc:9.7.1\n                    [type] => subsection\n                    [counter] => subsection\n                    [order] => 1\n                    [link_label] => 9.7.1\n                    [link_id] => sc:9.7.1\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Exposed state\n                )\n\n            [fg:9.12] => Array\n                (\n                    [doc_id] => fg:9.12\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 12\n                    [link_label] => 9.12\n                    [link_id] => fg:9.12\n                    [xrefs] => Array\n                        (\n                            [fg:light-switch-2-states] => 1\n                        )\n\n                    [title] => light switch: two states &#8212; visible even when the light bulb is broken\n                    [has_caption] => 1\n                )\n\n            [fg:9.13] => Array\n                (\n                    [doc_id] => fg:9.13\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 13\n                    [link_label] => 9.13\n                    [link_id] => fg:9.13\n                    [xrefs] => Array\n                        (\n                            [fg:exposed-state] => 1\n                        )\n\n                    [title] => Exposed state devices\n                    [has_caption] => 1\n                )\n\n            [sc:9.7.2] => Array\n                (\n                    [doc_id] => sc:9.7.2\n                    [type] => subsection\n                    [counter] => subsection\n                    [order] => 2\n                    [link_label] => 9.7.2\n                    [link_id] => sc:9.7.2\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Hidden state\n                )\n\n            [fg:9.14] => Array\n                (\n                    [doc_id] => fg:9.14\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 14\n                    [link_label] => 9.14\n                    [link_id] => fg:9.14\n                    [xrefs] => Array\n                        (\n                            [fg:CD-hidden-state] => 1\n                        )\n\n                    [title] => Volume knob on CD player &#8212; no visible state\n                    [has_caption] => 1\n                )\n\n            [bx:9.3] => Array\n                (\n                    [doc_id] => bx:9.3\n                    [type] => box\n                    [counter] => box\n                    [order] => 3\n                    [link_label] => 9.3\n                    [link_id] => bx:9.3\n                    [xrefs] => Array\n                        (\n                            [bx:infusion] => 1\n                        )\n\n                    [title] => A physicality approach to infusion pumps &#8212; some thoughts\n                    [has_caption] => 1\n                )\n\n            [fg:9.15] => Array\n                (\n                    [doc_id] => fg:9.15\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 15\n                    [link_label] => 9.15\n                    [link_id] => fg:9.15\n                    [xrefs] => Array\n                        (\n                            [fg:dishwasher] => 1\n                        )\n\n                    [title] => (i) dishwasher with exposed state, out=off, in=on (ii) TV hidden state push-back button\n                    [has_caption] => 1\n                )\n\n            [fg:9.16] => Array\n                (\n                    [doc_id] => fg:9.16\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 16\n                    [link_label] => 9.16\n                    [link_id] => fg:9.16\n                    [xrefs] => Array\n                        (\n                            [fg:computer-on-off] => 1\n                        )\n\n                    [title] => Computer on\/off button: hidden state with power light\n                    [has_caption] => 1\n                )\n\n            [sc:9.7.3] => Array\n                (\n                    [doc_id] => sc:9.7.3\n                    [type] => subsection\n                    [counter] => subsection\n                    [order] => 3\n                    [link_label] => 9.7.3\n                    [link_id] => sc:9.7.3\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Tangible transitions and tension states\n                )\n\n            [fg:9.17] => Array\n                (\n                    [doc_id] => fg:9.17\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 17\n                    [link_label] => 9.17\n                    [link_id] => fg:9.17\n                    [xrefs] => Array\n                        (\n                            [fg:photo-viewer] => 1\n                        )\n\n                    [title] => Three prototype media players\n                    [has_caption] => 1\n                )\n\n            [fg:9.18] => Array\n                (\n                    [doc_id] => fg:9.18\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 18\n                    [link_label] => 9.18\n                    [link_id] => fg:9.18\n                    [xrefs] => Array\n                        (\n                            [fg:light-switch-part-way] => 1\n                        )\n\n                    [title] => Light switch with partway states\n                    [has_caption] => 1\n                )\n\n            [sc:9.7.4] => Array\n                (\n                    [doc_id] => sc:9.7.4\n                    [type] => subsection\n                    [counter] => subsection\n                    [order] => 4\n                    [link_label] => 9.7.4\n                    [link_id] => sc:9.7.4\n                    [xrefs] => Array\n                        (\n                        )\n\n                    [title] => Natural inverse\n                )\n\n            [fg:9.19] => Array\n                (\n                    [doc_id] => fg:9.19\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 19\n                    [link_label] => 9.19\n                    [link_id] => fg:9.19\n                    [xrefs] => Array\n                        (\n                            [fg:minidisk] => 1\n                        )\n\n                    [title] => Minidisk controller\n                    [has_caption] => 1\n                )\n\n            [fg:9.20] => Array\n                (\n                    [doc_id] => fg:9.20\n                    [type] => figure\n                    [counter] => figure\n                    [order] => 20\n                    [link_label] => 9.20\n                    [link_id] => fg:9.20\n                    [xrefs] => Array\n                        (\n                            [fg:old-phone] => 1\n                        )\n\n                    [title] => Phone with slider at top left\n                    [has_caption] => 1\n                )\n\n            [bx:9.4] => Array\n                (\n                    [doc_id] => bx:9.4\n                    [type] => box\n                    [counter] => box\n                    [order] => 4\n                    [link_label] => 9.4\n                    [link_id] => bx:9.4\n                    [xrefs] => Array\n                        (\n                            [bx:driving-backwards] => 1\n                        )\n\n                    [title] => Why driving backwards is hard: expectation, magnification and control theory\n                )\n\n        )\n\n    [annotations] => Array\n        (\n            [0] => Array\n                (\n                    [postid] => 583\n                    [type] => source\n                    [loc] => Array\n                        (\n                            [postid] => 583\n                            [block_id] => sc:9.1\n                            [chapter] => Array\n                                (\n                                    [slug] => hybrid-devices\n                                    [chapter] => ch:hybrid-devices\n                                    [chapnos] => 9\n                                )\n\n                            [slug] => note:1\n                        )\n\n                    [content] =>  Michael Hicks (CC BY 2.0):\u00a0https:\/\/commons.wikimedia.org\/wiki\/File:Douglas_Engelbart%27s_prototype_mouse_-_Computer_History_Museum.jpg \n                )\n\n            [1] => Array\n                (\n                    [postid] => 583\n                    [type] => web\n                    [loc] => Array\n                        (\n                            [postid] => 583\n                            [block_id] => sc:9.5\n                            [chapter] => Array\n                                (\n                                    [slug] => hybrid-devices\n                                    [chapter] => ch:hybrid-devices\n                                    [chapnos] => 9\n                                )\n\n                            [slug] => note:2\n                        )\n\n                    [content] =>  Steve: I think I have some material on a remote control design which may be helpful here \n                )\n\n            [2] => Array\n                (\n                    [postid] => 583\n                    [type] => web\n                    [loc] => Array\n                        (\n                            [postid] => 583\n                            [block_id] => sc:9.5\n                            [chapter] => Array\n                                (\n                                    [slug] => hybrid-devices\n                                    [chapter] => ch:hybrid-devices\n                                    [chapnos] => 9\n                                )\n\n                            [slug] => note:3\n                        )\n\n                    [content] =>  is there an opportunity here (or somewhere close by to talk a bit about the light switches in our new building which adopt the physical form of a standard light switch but which are computer mediated and near impossible to operate&#8230;\n                )\n\n            [3] => Array\n                (\n                    [postid] => 583\n                    [type] => source\n                    [loc] => Array\n                        (\n                            [postid] => 583\n                            [block_id] => sc:9.6\n                            [chapter] => Array\n                                (\n                                    [slug] => hybrid-devices\n                                    [chapter] => ch:hybrid-devices\n                                    [chapnos] => 9\n                                )\n\n                            [slug] => note:4\n                        )\n\n                    [content] => https:\/\/www.flickr.com\/photos\/williamhook\/38109880456\/in\/photostream\/\n                )\n\n            [4] => Array\n                (\n                    [postid] => 583\n                    [type] => web\n                    [loc] => Array\n                        (\n                            [postid] => 583\n                            [block_id] => sc:9.6\n                            [chapter] => Array\n                                (\n                                    [slug] => hybrid-devices\n                                    [chapter] => ch:hybrid-devices\n                                    [chapnos] => 9\n                                )\n\n                            [slug] => note:5\n                        )\n\n                    [content] => \u00a0Frogger &#8211; feedforward \n                )\n\n        )\n\n    [chapter] => Array\n        (\n            [slug] => hybrid-devices\n            [chapter] => ch:hybrid-devices\n            [chapnos] => 9\n        )\n\n    [modified_time] => 1617213312\n)\n-->\n<script type=\"text\/javascript\">\nvar terms_url = \"https:\\\/\\\/physicality.org\\\/internal\\\/touchit-draft\\\/wp-content\\\/plugins\\\/bibref\\\/data\\\/terms.json\";\njQuery(function($) {\n     hiliteFromJson(terms_url,$,$(\"#content\")[0]);\n});\n<\/script>\n<a name=\"ch:hybrid-devices\" class=\"xref_label\"  xref_local=\"ch:hybrid-devices\" xref_label=\"ch:hybrid-devices\"><\/a><\/p>\n<div class=\"touchit_toc\"><ul class=\"toc_level_1\"><li class=\"toc_type_chapter toc_in_flow\"><span class=\"toc_entry_type\">chapter<\/span> <span class=\"toc_entry_label\"><a href=\"#ch:9\">9<\/a><\/span>  <span class=\"toc_entry_title\">Hybrid Devices<\/span><\/li><ul class=\"toc_level_2\"><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.1\">9.1<\/a><\/span>  <span class=\"toc_entry_title\">Abstraction &#8212; software as if hardware doesn&#8217;t matter<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.1\">9.1<\/a><\/span>  <span class=\"toc_entry_title\">Douglas Engelbart&#8217;s first mouse<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.2\">9.2<\/a><\/span>  <span class=\"toc_entry_title\">Light pen in use<\/span><\/li><\/ul><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.2\">9.2<\/a><\/span>  <span class=\"toc_entry_title\">The limits of hardware abstraction<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.3\">9.3<\/a><\/span>  <span class=\"toc_entry_title\">Etch-a-Sketch<\/span><\/li><\/ul><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.3\">9.3<\/a><\/span>  <span class=\"toc_entry_title\">Specialisation &#8212; computer-embedded devices<\/span><\/li><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.4\">9.4<\/a><\/span>  <span class=\"toc_entry_title\">What does it do?<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.4\">9.4<\/a><\/span>  <span class=\"toc_entry_title\">Pepper grinder<\/span><\/li><\/ul><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.5\">9.5<\/a><\/span>  <span class=\"toc_entry_title\">Mapping<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.5\">9.5<\/a><\/span>  <span class=\"toc_entry_title\">Cooker hob knobs &#8212; note picture above each to attempt to clarify mapping<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.6\">9.6<\/a><\/span>  <span class=\"toc_entry_title\">. (i) power socket switches have clear physical correspondence, but (ii) what do these light switches do?<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.7\">9.7<\/a><\/span>  <span class=\"toc_entry_title\">Microwave oven control panel<\/span><\/li><li class=\"toc_type_box toc_out_flow\"><span class=\"toc_entry_type\">box<\/span> <span class=\"toc_entry_label\"><a href=\"#bx:9.1\">9.1<\/a><\/span>  <span class=\"toc_entry_title\">Why are software scroll bars on the right-hand side of the screen?<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.8\">9.8<\/a><\/span>  <span class=\"toc_entry_title\">The Augurscope II, stand-mounted and hand-held (from [BS05])<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.9\">9.9<\/a><\/span>  <span class=\"toc_entry_title\">Overlaps and gaps identified by the framework (adapted from [BS05])<\/span><\/li><\/ul><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.6\">9.6<\/a><\/span>  <span class=\"toc_entry_title\">Feedback<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_box toc_out_flow\"><span class=\"toc_entry_type\">box<\/span> <span class=\"toc_entry_label\"><a href=\"#bx:9.2\">9.2<\/a><\/span>  <span class=\"toc_entry_title\">Physicality-based digital input<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.10\">9.10<\/a><\/span>  <span class=\"toc_entry_title\">Multiple feedback loops<\/span><\/li><\/ul><li class=\"toc_type_section toc_in_flow\"><span class=\"toc_entry_type\">section<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.7\">9.7<\/a><\/span>  <span class=\"toc_entry_title\">The device unplugged<\/span><\/li><ul class=\"toc_level_3\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.11\">9.11<\/a><\/span>  <span class=\"toc_entry_title\">(i) a nice mirror (ii) buttons to push and (iii) slide the phone in and out<\/span><\/li><li class=\"toc_type_subsection toc_in_flow\"><span class=\"toc_entry_type\">subsection<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.7.1\">9.7.1<\/a><\/span>  <span class=\"toc_entry_title\">Exposed state<\/span><\/li><ul class=\"toc_level_4\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.12\">9.12<\/a><\/span>  <span class=\"toc_entry_title\">light switch: two states &#8212; visible even when the light bulb is broken<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.13\">9.13<\/a><\/span>  <span class=\"toc_entry_title\">Exposed state devices<\/span><\/li><\/ul><li class=\"toc_type_subsection toc_in_flow\"><span class=\"toc_entry_type\">subsection<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.7.2\">9.7.2<\/a><\/span>  <span class=\"toc_entry_title\">Hidden state<\/span><\/li><ul class=\"toc_level_4\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.14\">9.14<\/a><\/span>  <span class=\"toc_entry_title\">Volume knob on CD player &#8212; no visible state<\/span><\/li><li class=\"toc_type_box toc_out_flow\"><span class=\"toc_entry_type\">box<\/span> <span class=\"toc_entry_label\"><a href=\"#bx:9.3\">9.3<\/a><\/span>  <span class=\"toc_entry_title\">A physicality approach to infusion pumps &#8212; some thoughts<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.15\">9.15<\/a><\/span>  <span class=\"toc_entry_title\">(i) dishwasher with exposed state, out=off, in=on (ii) TV hidden state push-back button<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.16\">9.16<\/a><\/span>  <span class=\"toc_entry_title\">Computer on\/off button: hidden state with power light<\/span><\/li><\/ul><li class=\"toc_type_subsection toc_in_flow\"><span class=\"toc_entry_type\">subsection<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.7.3\">9.7.3<\/a><\/span>  <span class=\"toc_entry_title\">Tangible transitions and tension states<\/span><\/li><ul class=\"toc_level_4\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.17\">9.17<\/a><\/span>  <span class=\"toc_entry_title\">Three prototype media players<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.18\">9.18<\/a><\/span>  <span class=\"toc_entry_title\">Light switch with partway states<\/span><\/li><\/ul><li class=\"toc_type_subsection toc_in_flow\"><span class=\"toc_entry_type\">subsection<\/span> <span class=\"toc_entry_label\"><a href=\"#sc:9.7.4\">9.7.4<\/a><\/span>  <span class=\"toc_entry_title\">Natural inverse<\/span><\/li><ul class=\"toc_level_4\"><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.19\">9.19<\/a><\/span>  <span class=\"toc_entry_title\">Minidisk controller<\/span><\/li><li class=\"toc_type_figure toc_out_flow\"><span class=\"toc_entry_type\">figure<\/span> <span class=\"toc_entry_label\"><a href=\"#fg:9.20\">9.20<\/a><\/span>  <span class=\"toc_entry_title\">Phone with slider at top left<\/span><\/li><li class=\"toc_type_box toc_out_flow\"><span class=\"toc_entry_type\">box<\/span> <span class=\"toc_entry_label\"><a href=\"#bx:9.4\">9.4<\/a><\/span>  <span class=\"toc_entry_title\">Why driving backwards is hard: expectation, magnification and control theory<\/span><\/li><\/ul><\/ul><\/ul><\/ul><\/div>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.1\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.1<\/span> <\/span> Abstraction &#8212; software as if hardware doesn&#8217;t matter<\/h2>\n<p>The computer being used to write this chapter is a laptop with a trackpad. The awkward angles needed to use the trackpad continuously lead to pains in the wrist and hands, so there is also a wireless mouse. However, when swapping between <span class=\"touchit_term\"  ix_as=\"input devices\" ix_rawcontent=\"mouse and trackpad\">mouse and trackpad<\/span> there is no need to change software, the same word processor works equally well with both. If this seems unsurprising to you, think again how different a mouse and trackpad are. It is like going to a restaurant and being given a fork instead of a soup spoon. Even more amazing, the same web pages you can use on the laptop with mouse or trackpad can also be used on the phone, clicking links using your finger alone.<\/p>\n<p>Now this seems so obvious you need to really step back to realise it is surprising at all. However, things were not always this way and the identification of <span class=\"touchit_term\"  ix_as=\"hardware abstraction\" ix_rawcontent=\"\"><\/span>abstract devices was crucial to the development of the modern user <span class=\"touchit_term\"  ix_as=\"history of\" ix_within=\"input devices\" ix_rawcontent=\"interface\">interface<\/span>.<\/p>\n<p>Early terminals had keyboards, so there was an easy first abstraction, <em>text entry<\/em>, as all had the basic alphabet and numbers. However, even here there were numerous differences, from plain keyboards to those with special keys for a particular function. \u00a0Cursor keys came slowly, so early software often had different mappings from keys and key combinations to actions. Nowadays this is virtually obsolete, partly due to keyboard standardisation and partly to increasing reliance on the mouse (or trackpad!), but its remnants can still be seen in the slightly different key mappings of Mac and Windows software.<\/p>\n<p>The origins of the <span class=\"touchit_term\"  ix_as=\"mouse\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"mouse\">mouse<\/span> date back to the early 1960s with <a rel=\"noopener noreferrer\" href=\"http:\/\/dougengelbart.org\/\" target=\"_blank\">Douglas Engelbart<\/a>&#8216;s innovative <a rel=\"noopener noreferrer\" href=\"http:\/\/www.sis.pitt.edu\/%7Espring\/arc\/\" target=\"_blank\">Augmentation Research Center<\/a>. While the mouse was used in the very first Macintosh computer in 1984, it was in fact some time before it became more widely used in personal computers, largely because most did not have graphical windows-based user interfaces but instead were based on character maps.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.1\"><\/a><!-- link_id --><a name=\"fg:first-mouse\" class=\"xref_label\"  xref_local=\"fg:first-mouse\" xref_label=\"fg:hybrid-devices.first-mouse\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-1819\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum-1024x682.jpg\" alt=\"\" width=\"750\" height=\"500\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum-1024x682.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum-400x267.jpg 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum-300x200.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum-768x512.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/Douglas_Engelbarts_prototype_mouse_-_Computer_History_Museum.jpg 1280w\" sizes=\"auto, (max-width: 750px) 100vw, 750px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.1<\/span> <\/span>   Douglas Engelbart&#8217;s first mouse<\/p><\/p>\n<p><a name=\"note:1\"><\/a><span class=\"touchit_comment touchit_source annotation\"> Michael Hicks (CC BY 2.0):\u00a0https:\/\/commons.wikimedia.org\/wiki\/File:Douglas_Engelbart%27s_prototype_mouse_-_Computer_History_Museum.jpg <\/span><\/p>\n<p><\/div>\n<p>However, before the desktop computer had become commonplace there were a variety of high-end graphical workstations for use in specialised areas such as CAD and scientific visualisation. These often needed some way to draw and to select lines and areas on screen, but they varied tremendously in the devices used to achieve this. Some had light pens which could be used to touch points on the screen directly, or draw on the screen as if it were paper. Others used tablets with &#8216;pucks&#8217;, a bit like a mouse except that the position of the puck on the tablet mapped directly to a position on the screen, whereas with the mouse it is only the movement that matters. Some CAD workstations had small joysticks, or two small thumbwheels: one controlling horizontal &#8216;x&#8217; location and one for the vertical &#8216;y&#8217; location.<\/p>\n<p>This variety of <span class=\"touchit_term\"  ix_as=\"hardware, history of\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"history of\" ix_within=\"input devices\" ix_rawcontent=\"hardware\">hardware<\/span> did not matter when computers were so specialised that software and hardware were delivered together as a package. However, in the late 1960s and early 1970s those working in computer graphics began to look for more generic ways to describe and build interactive graphical software, and identified a number of key functions, all of which could be achieved using a combination of a keyboard and some form of pointing device <span class=\"touchit_bibcite\"  bibcite=\"Ne68; Wa76\"><a name=\"bibcite:1\"><\/a><a name=\"bibcite:2\"><\/a>[<a href=\"#ref-Ne68\">Ne68<\/a>;<a href=\"#ref-Wa76\">Wa76<\/a>]<\/span>. Low-level software converted the varying signals generated by the different forms of pointing device into a uniform digital format. By the time the current windows-based operating systems (X\/Linux, macOS, Windows) were developed, they all had generic &#8216;mouse&#8217; devices, which in fact can be just about anything that generates an x&#8211;y coordinate and has the means to select through pressing a button or otherwise.<\/p>\n<p>This <span class=\"touchit_term\"  ix_as=\"hardware abstraction\" ix_rawcontent=\"abstraction away from hardware\">abstraction away from hardware<\/span> has been incredibly successful, and because of it, when laptops appeared that used alternative devices instead of the mouse &#8212; trackballs, keyboard nipples and trackpads &#8212; there was no need to develop new software, just a &#8216;driver&#8217; for the new device that made it appear to the software the same as the mouse. Likewise, direct screen devices such as styli on tablets or direct finger touch interactions are &#8216;just like a mouse&#8217; to the word processor or web browser with which you are interacting.<\/p>\n<p>This process has continued as radically new hardware capabilities have appeared. For example, both Mac OS X and Windows now provide the programmer with generic scroll wheel events. Multi-touch <span class=\"touchit_term\"  ix_as=\"touch-based devices\" ix_rawcontent=\"devices\">devices<\/span>, such as the iPhone, that use two-finger <span class=\"touchit_term\"  ix_as=\"gesture-based interfaces\" ix_rawcontent=\"gestures\">gestures<\/span> have proved challenging, since two fingers are definitely not the same as two mice (and anyway how many systems use two mice!). <span class=\"touchit_term\"  ix_rawcontent=\"Apple\">Apple<\/span>, providing both software and hardware, were in a similar position to early graphics workstation manufacturers, able to tune the software to particular hardware characteristics, whereas <span class=\"touchit_term\"  ix_rawcontent=\"Microsoft\">Microsoft<\/span> wished to provide a variant of Windows that could run on any multi-touch hardware and so had to work out new abstractions over the common features <span class=\"touchit_bibcite\"  bibcite=\"WM09\"><a name=\"bibcite:3\"><\/a>[<a href=\"#ref-WM09\">WM09<\/a>]<\/span>.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.2\"><\/a><!-- link_id --><a name=\"fg:light-pen\" class=\"xref_label\"  xref_local=\"fg:light-pen\" xref_label=\"fg:hybrid-devices.light-pen\"><\/a><a href=\"http:\/\/en.wikipedia.org\/wiki\/Light_pen\"><\/a><\/p>\n<p><a href=\"http:\/\/en.wikipedia.org\/wiki\/Light_pen\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2477\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969-1024x787.jpg\" alt=\"\" width=\"364\" height=\"280\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969-1024x787.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969-390x300.jpg 390w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969-300x231.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969-768x591.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/HypertextEditingSystemConsoleBrownUniv1969.jpg 1428w\" sizes=\"auto, (max-width: 364px) 100vw, 364px\" \/><\/a><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.2<\/span> <\/span> Light pen in use<\/p><\/p>\n<p><\/div>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.2\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.2<\/span> <\/span> The limits of hardware abstraction<\/h2>\n<p>It would be very surprising in a book about physicality if we ended up saying the precise nature of hardware doesn&#8217;t matter. Abstractions are both theoretically elegant and practically useful, and the importance and utility of suitable ways to abstract away from the specificity of devices should not be underestimated. However, there are <span class=\"touchit_term\"  ix_as=\"limitations of\" ix_within=\"hardware abstraction\" ix_rawcontent=\"limitations\">limitations<\/span>: a mouse is <em>not<\/em> the same as a trackpad (if it were there would be no reason to buy a mouse to go with the laptop), and phone keypads, TV remotes, and washing machine controls are not all the same.<\/p>\n<p>Very early on in the quest for abstractions over keyboards and pointing devices, there were voices who warned about these <span class=\"touchit_term\"  ix_as=\"limitations of\" ix_within=\"hardware abstraction\" ix_rawcontent=\"limitations\">limitations<\/span>. <span class=\"touchit_term\"  ix_as=\"Buxton, Bill\" ix_rawcontent=\"Bill Buxton\">Bill Buxton<\/span> was one of these. He pointed out differences in both the intrinsic capabilities of the then popular pointing devices and also in the ease with which different devices could be used for specific tasks.<\/p>\n<p>For the first of these, the intrinsic capabilities, Buxton showed that pointing devices differ even at a very abstract level. He distinguished three states <span class=\"touchit_bibcite\"  bibcite=\"Bu90\"><a name=\"bibcite:4\"><\/a>[<a href=\"#ref-Bu90\">Bu90<\/a>]<\/span>:<\/p>\n<ul>\n<li>State 0 &#8212; no tracking, no pointer shown on screen; e.g. a light pen or touchscreen when the pen or finger is far from the screen.<\/li>\n<li>State 1 &#8212; tracking, pointer shown on screen, but just to show you where it is; e.g. a mouse when no buttons are pressed.<\/li>\n<li>State 2 &#8212; dragging, pointer shown and something happening such as a window being moved, or a line being drawn; e.g. a mouse when the button is held down.<\/li>\n<\/ul>\n<p>A <span class=\"touchit_term\"  ix_as=\"mouse\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"mouse\">mouse<\/span> is only ever in States 1 or 2, whereas the light pens available at the time could have all three states: not in contact with the screen, so no tracking; in contact with the screen and tracking; and in contact with the screen with the button pressed for dragging. Of course you can lift a mouse off the table, but this simply leaves the cursor on the screen where it is, whereas if you lift your finger off the screen and then down somewhere else, the &#8216;pointer&#8217; jumps to the new position.<\/p>\n<p>In fact this particular difference is not too much of a problem. Most applications are designed for the mouse, and the light pen had more capability than the mouse, so unless the programmer did not deal well with sudden jumps in mouse position, all was well.<\/p>\n<p>More problematic is that many <span class=\"touchit_term\"  ix_as=\"touchscreen\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"touchscreen\" ix_rawcontent=\"touchscreens\">touchscreens<\/span>, both stylus based and finger based, only operate in States 0 and 2. When you are not in contact with the screen there is no detection of location, and when you are in contact it is treated as a &#8216;selection&#8217;. There is an argument that State 1 is only needed because the mouse is an indirect device, moved on the table top to affect the screen. You don&#8217;t need State 1 with the stylus as you can see where it is on the screen. However, State 1 allows <span class=\"touchit_term\"  ix_as=\"pixels\" ix_rawcontent=\"pixel-precision\">pixel-precision<\/span> positioning of the mouse cursor, whereas with touch-based interfaces fine positioning is very difficult (the &#8216;fat finger&#8217; problem).<\/p>\n<p>There are ways round this. For example, the <span class=\"touchit_term\"  ix_rawcontent=\"iPhone\">iPhone<\/span> adds an extra layer of interaction: if you touch and move, it is treated as State 2 dragging, but if you touch and stay still, a small magnified view is shown and movement treated as State 1 with the lifting of the finger acting as selection. However, this allows no way to perform a drag action with pixel-level <span class=\"touchit_term\"  ix_rawcontent=\"accuracy\">accuracy<\/span> for the start and end points, so the text applications all have text selections where the end points can be individually dragged.<\/p>\n<p>Even when devices are capable of the same things, it does not mean they are equivalent to use. Buxton showed this by comparing children&#8217;s drawing toys. Like the early CAD workstations, <span class=\"touchit_term\"  ix_rawcontent=\"Etch-a-Sketch\">Etch-a-Sketch<\/span> has separate knobs for horizontal and vertical movement (see Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.etch-a-sketch\" xref_postid=\"583\" touchit_value=\"9.3\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:etch-a-sketch --><a name=\"xu:1\"><\/a><a href=\"#fg:etch-a-sketch\">9.3<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.etch-a-sketch\n    [postid] => 583\n    [slug] => fg:etch-a-sketch\n    [local] => fg:etch-a-sketch\n    [global] => fg:hybrid-devices.etch-a-sketch\n    [value] => 9.3\n    [type] => figure\n    [content] => \n)\n   --><\/span>). This makes it really easy to draw the sides of a rectangle, but hard to draw a smooth diagonal line or circle. The <span class=\"touchit_term\"  ix_as=\"mouse\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"mouse\">mouse<\/span> of course has the opposite characteristics, fine for any movement, but without the precision of separate x&#8211;y controls. Indeed, in a drawing program you may have found yourself sizing boxes by separately dragging the side and top edges (x or y one at a time) instead of the corner, or using text entry boxes to give precise x and y coordinates.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.3\"><\/a><!-- link_id --><a name=\"fg:etch-a-sketch\" class=\"xref_label\"  xref_local=\"fg:etch-a-sketch\" xref_label=\"fg:hybrid-devices.etch-a-sketch\"><\/a><\/p>\n<p><a href=\"http:\/\/www.etch-a-sketch.com\/\"><\/a><a href=\"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/e\/e5\/Taj_Mahal_drawing_on_an_Etch-A-Sketch.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-1940 \" title=\"Etch-a-Sketch\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/01\/wikipedia-Taj_Mahal_drawing_on_an_Etch-A-Sketch-1024x812.jpg\" alt=\"\" width=\"335\" height=\"266\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/01\/wikipedia-Taj_Mahal_drawing_on_an_Etch-A-Sketch.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/01\/wikipedia-Taj_Mahal_drawing_on_an_Etch-A-Sketch-378x300.jpg 378w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/01\/wikipedia-Taj_Mahal_drawing_on_an_Etch-A-Sketch-300x238.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/01\/wikipedia-Taj_Mahal_drawing_on_an_Etch-A-Sketch-768x609.jpg 768w\" sizes=\"auto, (max-width: 335px) 100vw, 335px\" \/><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.3<\/span> <\/span>   Etch-a-Sketch <\/p><\/p>\n<p><\/div>\n<p>Even the mouse itself differs considerably between brands. The earliest mice often had the buttons on the sides or end whereas most modern mice have buttons on the top (or in the case of the <span class=\"touchit_term\"  ix_rawcontent=\"Apple\">Apple<\/span> mouse the whole top surface). This is fine when clicking or dragging for short distances. However, if you need to drag, say, an icon across a large display, you may have to pick up the mouse to scroll the whole distance. Doing this while gripping a button at the side or end is fine, but it is almost impossible while pushing <em>down<\/em> on the mouse button. \u00a0It is worth mentioning that early Macs had very small displays, so this issue did not arise.<\/p>\n<p>Such differences between devices affect performance. In Chapter <span class=\"touchit_xref\"   xref_label=\"ch:body-and-mind\" xref_postid=\"100\" touchit_value=\"5\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:body-and-mind --><a name=\"xu:2\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/human-body-mind\/body-and-mind\/#ch:body-and-mind\">5<\/a><!-- xref_data: Array\n(\n    [name] => ch:body-and-mind\n    [postid] => 100\n    [slug] => ch:body-and-mind\n    [local] => ch:body-and-mind\n    [global] => ch:body-and-mind\n    [value] => 5\n    [type] => chapter\n    [content] => \n)\n   --><\/span>, we described <span class=\"touchit_term\"  ix_rawcontent=\"Fitts&amp;#8217; Law\">Fitts&#8217; Law<\/span>, which predicts how long it takes to make positioning movements with a pointing device.<\/p>\n<p style=\"padding-left: 30px;\">time = A + B log ( distance \/ size )<\/p>\n<p>While any single device tends to follow the logarithmic law when comparing different distances and sizes of target, <em>between<\/em> devices the constants A and B can differ markedly, and this is used as the basis of the ISO 9241 standard to measure &#8216;non-keyboard&#8217; devices.<\/p>\n<p>The differences are even more important when considering specialised tasks. Many computer <span class=\"touchit_term\"  ix_rawcontent=\"artists\">artists<\/span> prefer to use a tablet and pen instead of a mouse, as the combination of the angle you hold the pen and the fact that there is a direct mapping between location on the tablet and screen location makes it seem more &#8216;natural&#8217;, more like a real pencil or brush.<\/p>\n<p>It is also significant, not least when comparing different &#8216;equivalent&#8217; devices, that some have different ergonomic characteristics. The reason for using an additional mouse with the laptop is to alleviate the muscle and joint strain of relying solely on the laptop trackpad.<\/p>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.3\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.3<\/span> <\/span> Specialisation &#8212; <span class=\"touchit_term\"  ix_as=\"embedded\" ix_within=\"technology\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"embedded technology\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"computer-embedded products\" ix_rawcontent=\"computer-embedded devices\">computer-embedded devices<\/span><\/h2>\n<p>While it is possible to regard computers as pretty much similar, the same cannot be said for <span class=\"touchit_term\"  ix_rawcontent=\"kitchen appliances\">kitchen appliances<\/span>. The <span class=\"touchit_term\"  ix_as=\"controls, on consumer appliances\" ix_rawcontent=\"controls\">controls<\/span> for a cooker, washing machine, dishwasher, microwave and food mixer all look different, with specialised dials and buttons for particular functions. Because the computer is &#8216;general purpose&#8217; it has a one-size-fits-all collection of devices (mouse, keyboard, screen), whereas more specialised consumer goods have controls <span class=\"touchit_term\"  ix_as=\"design for\" ix_within=\"embedded technology\" ix_rawcontent=\"designed\">designed<\/span> specifically for purpose.<\/p>\n<p>There is still a level of similarity, with individual controls on each device having recognisable buttons and dials. However, the number of controls and the way they are laid out are individual and special. The computer uses a single physical device (the mouse or trackpad) and makes it serve many purposes, often by showing virtual &#8216;buttons&#8217; on the screen. Larger consumer appliances are more likely have several buttons or dials each with a single or small number of functions. Furthermore, even the dials differ: some can be moved continuously within some range, others have a number of &#8216;clicks&#8217; relating to the number of options they control.<\/p>\n<p>While dials and buttons are generic, there are sometimes very special <span class=\"touchit_term\"  ix_rawcontent=\"controls\">controls<\/span> designed for a particular purpose, such as the steering wheel on a car. These may have a seemingly arbitrary connection to the function they perform. For example, the gear stick on a car has a particular form due to the mechanics of the gear box, but for the ordinary driver that is just the way it is. See Chapter <span class=\"touchit_xref\"   xref_label=\"ch:design-lessons\" xref_postid=\"747\" touchit_value=\"19\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:design-lessons --><a name=\"xu:3\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/theory-and-practice-of-physicality\/design-lessons-and-advice\/#ch:design-lessons\">19<\/a><!-- xref_data: Array\n(\n    [name] => ch:design-lessons\n    [postid] => 747\n    [slug] => ch:design-lessons\n    [local] => ch:design-lessons\n    [global] => ch:design-lessons\n    [value] => 19\n    [type] => chapter\n    [content] => \n)\n   --><\/span> for more about physicality and car controls.<\/p>\n<p>Other controls, however, are intimately connected with the act of using the device, for example the food mixer that turns on when you press down on it, or the digital scales that automatically turn on when you step on them. The latter can be particularly intuitive, to the extent that the user may not even think &#8216;now I&#8217;m turning this on&#8217;; it just happens at the right moment. Volkswagen-built sat navs usually show an uncluttered screen, but when a user moves to interact with it, a proximity sensor triggers to reveal a set of options. Most users don\u2019t even notice!<\/p>\n<p>Sometimes users are completely unaware of the carefully designed-in functions of a particular set of <span class=\"touchit_term\"  ix_as=\"controls, on consumer appliances\" ix_rawcontent=\"controls\">controls<\/span>. When Steve was building the kitchen we saw in Box <span class=\"touchit_xref\"   xref_label=\"bx:elements.how-many-computers\" xref_postid=\"181\" touchit_value=\"1.1\" touchit_type=\"box\"><!-- xref_xshortcode_handler: name = bx:elements.how-many-computers --><a name=\"xu:4\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/introduction\/elements-of-our-hybrid-existence\/#bx:how-many-computers\">1.1<\/a><!-- xref_data: Array\n(\n    [name] => bx:elements.how-many-computers\n    [postid] => 181\n    [slug] => bx:how-many-computers\n    [local] => bx:how-many-computers\n    [global] => bx:elements.how-many-computers\n    [value] => 1.1\n    [type] => box\n    [content] => \n)\n   --><\/span> he installed a new dishwasher. The dishwasher was of the \u2018integrated\u2019 type \u2013- designed to be hidden behind a panel &#8212; so the controls were mounted on the top edge of the door. Once it was all plumbed in, Steve switched it on, only to find that it was completely unresponsive. The very sympathetic repair man had to explain to Steve that the countertop would normally hide the panel when the door was shut, so closing the door also switched off the panel.<\/p>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.4\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.4<\/span> <\/span> What does it do?<\/h2>\n<p>It is easy to know what to do with a device that only has an on\/off button, but when faced by dozens of buttons on a remote control it may not be so obvious. Cases where it is not evident that something can be controlled at all are equally difficult.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.4\"><\/a><!-- link_id --><a name=\"fg:pepper-grinder\" class=\"xref_label\"  xref_local=\"fg:pepper-grinder\" xref_label=\"fg:hybrid-devices.pepper-grinder\"><\/a><\/p>\n<p style=\"text-align: left;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2586 \" title=\"pepper-grinder\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-768x1024.jpg\" alt=\"\" width=\"165\" height=\"220\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-768x1024.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-225x300.jpg 225w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-1152x1536.jpg 1152w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-1536x2048.jpg 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.4-pepper-grinder-IMG_2785-scaled.jpg 1920w\" sizes=\"auto, (max-width: 165px) 100vw, 165px\" \/><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.4<\/span> <\/span>   Pepper grinder\u00a0<\/p><\/p>\n<p><\/div>\n<p>Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.pepper-grinder\" xref_postid=\"583\" touchit_value=\"9.4\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:pepper-grinder --><a name=\"xu:5\"><\/a><a href=\"#fg:pepper-grinder\">9.4<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.pepper-grinder\n    [postid] => 583\n    [slug] => fg:pepper-grinder\n    [local] => fg:pepper-grinder\n    [global] => fg:hybrid-devices.pepper-grinder\n    [value] => 9.4\n    [type] => figure\n    [content] => \n)\n   --><\/span> shows a pepper grinder. A hapless guest might spend some time trying to work out what to twist to get it to grind. In fact it is an electric grinder and the metal disk on top is not decoration, but a switch that turns on the motorized grinder and a small light to boot ((The grinder is part of a pair, pepper and salt, but the makers clearly forgot the effect salt has on electrical wires; the motor still works on the salt grinder, but its light has, alas, failed.)). This highlights that there are at least three things you need to know before you can even attempt to use a device:<\/p>\n<ol>\n<li>know what the device is capable of doing, its functionality<\/li>\n<li>know what controls are available to you<\/li>\n<li>know the mapping between the controls and the functions<\/li>\n<\/ol>\n<p>The pepper grinder fails on both (2) and (3)!<\/p>\n<p>The first of these may seem most fundamental, but in fact if you can grasp (2) it is often possible to work out (1) and (3) through experimentation, albeit with potential embarrassment or damage along the way &#8212; think of the consternation of &#8216;Q&#8217; as James Bond playfully presses every button on the missile-packed sports car.<\/p>\n<p>In fact we have encountered these issues already in the form of affordances. Just as the rock of a certain height affords sitting, so also the pepper pot affords grinding pepper; however, it may lack the <span class=\"touchit_term\"  ix_as=\"perceived\" ix_within=\"affordance\" ix_rawcontent=\"perceptual affordance\">perceptual affordance<\/span> that tells you how to achieve that.<\/p>\n<p>One might think these are only issues for the newcomer to the device, such as the house guest, but they can affect even frequent users. Alan was once giving a talk about physicality and using the light switches in the room in order to illustrate a point. They were the kind that you press and the light goes on, you press again and it goes off. To illustrate that the action of pressing the light is in fact two parts, press in and then release, he pushed the switch in and held it for a few moments while talking. To his surprise and that of the rest of the people in the room the lights began to dim. What had appeared to be a simple on\/off switch was in fact a dimmer. What was particularly surprising was that none of the people at the talk, several of whom taught regularly in the room, knew of the extra functionality. A more traditional dimmer switch would use a rotating knob to control the internal electronics directly. The knob suggests that it controls something variable, and would make it more likely that the users of the room would have discovered the dimmer functionality for themselves.<\/p>\n<p>Such problems are particularly common with those flat buttons where a thin plastic sheet covers a contact below, or which operate by touch alone. Because these are easy to clean they have advantages in public areas as well as parts of the home, such as the kitchen, where hands may be dirty. However, it is common to see people pressing the sign beside the button instead of the button itself, since both are flat, plastic, and covered by many previous people&#8217;s fingermarks. This is not helped by notices that say, &#8216;press here&#8217;!<\/p>\n<p>We will return to item (2), &#8216;know what controls are available to you&#8217;, later in the chapter, but for now let&#8217;s assume you have some idea of what the device does, and can see what controls are available. You are then faced with problem (3): &#8216;what does what&#8217;, often called &#8216;mapping&#8217;.<\/p>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.5\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.5<\/span> <\/span> Mapping<\/h2>\n<p>The <span class=\"touchit_term\"  ix_as=\"mapping of functions to\" ix_within=\"controls, on consumer appliances\" ix_rawcontent=\"mapping\">mapping<\/span> between physical controls and functions has been a point of interest since the earliest days of <span class=\"touchit_term\"  ix_rawcontent=\"human&amp;#8211;computer interaction\">human&#8211;computer interaction<\/span> research. One of Don Norman&#8217;s examples is the electric cooker. There are four dials and four rings, but which dial controls which ring? Often the controls are placed in a line on the front of the cooker or above on a separate panel. The two dials on the left control the left two rings, but what about back and front? Some cookers instead place the controls alongside the rings in a line from back to front &#8212; now it is not even obvious which is left and which right. Of course, the dials each have a little image beside them, intended to make this clear, but even if you can work out what they mean do you manage to do this quickly enough when the pan is about to boil over?<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.5\"><\/a><!-- link_id --><a name=\"fg:cooker-knobs\" class=\"xref_label\"  xref_local=\"fg:cooker-knobs\" xref_label=\"fg:hybrid-devices.cooker-knobs\"><\/a><\/p>\n<p style=\"text-align: left;\"><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-586 size-large\" title=\"cooker controls\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls-1024x245.jpg\" alt=\"\" width=\"750\" height=\"179\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls-1024x245.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls-400x95.jpg 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls-300x71.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/cooker-controls.jpg 3460w\" sizes=\"auto, (max-width: 750px) 100vw, 750px\" \/><\/a><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.5<\/span> <\/span>   Cooker hob knobs &#8212; note picture above each to attempt to clarify mapping<\/p><\/p>\n<p><\/div>\n<p><span class=\"touchit_term\"  ix_as=\"physical placement of\" ix_within=\"controls, on consumer appliances\" ix_rawcontent=\"Physical placement\">Physical placement<\/span> helps users understand mapping. If controls are on or near the item they control then you at least know which device they apply to. You may sometimes get confused about which remote control is which, but you&#8217;re unlikely to go to the controls on front of the TV when you mean to turn on the HiFi. There are limits to proximity. The remote control may confuse you, but it saves you getting out of the chair. With the cooker, you could imagine having a separate dial for each ring placed right next to the ring, but of course you would burn yourself whenever you tried to use them.<\/p>\n<p>Where the things that are being controlled have some form of physical layout, reflecting this in the controls themselves can help. For example, if there is a line of lights in a room, we can organise the light switches to be in the same order (see Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.power-sockets\" xref_postid=\"583\" touchit_value=\"9.6\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:power-sockets --><a name=\"xu:6\"><\/a><a href=\"#fg:power-sockets\">9.6<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.power-sockets\n    [postid] => 583\n    [slug] => fg:power-sockets\n    [local] => fg:power-sockets\n    [global] => fg:hybrid-devices.power-sockets\n    [value] => 9.6\n    [type] => figure\n    [content] => \n)\n   --><\/span>). With the cooker, we could imagine laying out the dials in a square to reflect the layout on the hotplate, but of course this would take more space than placing them in a line.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.6\"><\/a><!-- link_id --><a name=\"fg:power-sockets\" class=\"xref_label\"  xref_local=\"fg:power-sockets\" xref_label=\"fg:hybrid-devices.power-sockets\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2588\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-1024x821.jpg\" alt=\"\" width=\"250\" height=\"200\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-1024x821.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-300x240.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-374x300.jpg 374w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-768x616.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-1536x1231.jpg 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804-2048x1642.jpg 2048w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6a-power-sockets-IMG_2804.jpg 2298w\" sizes=\"auto, (max-width: 250px) 100vw, 250px\" \/>\u00a0 \u00a0 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2589\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-633x1024.jpg\" alt=\"\" width=\"124\" height=\"200\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-633x1024.jpg 633w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-185x300.jpg 185w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-768x1242.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-950x1536.jpg 950w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-1266x2048.jpg 1266w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.6b-light-switches-IMG_2803-scaled.jpg 1583w\" sizes=\"auto, (max-width: 124px) 100vw, 124px\" \/><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.6<\/span> <\/span> . (i) power socket switches have clear physical correspondence, but (ii) what do these light switches do?<\/p><\/p>\n<p><\/div>\n<p>For more abstract functions, such as the time and power settings of a microwave oven, or channel and volume selection on a TV remote, there is no direct physical correspondence. However, physical appearance and layout can still help users to establish a mapping. Look at the microwave oven controls in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.microwave\" xref_postid=\"583\" touchit_value=\"9.7\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:microwave --><a name=\"xu:7\"><\/a><a href=\"#fg:microwave\">9.7<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.microwave\n    [postid] => 583\n    [slug] => fg:microwave\n    [local] => fg:microwave\n    [global] => fg:hybrid-devices.microwave\n    [value] => 9.7\n    [type] => figure\n    [content] => \n)\n   --><\/span>. Related controls have similar appearance and are grouped together.<\/p>\n<a name=\"note:2\"><\/a><span class=\"touchit_note touchit_web annotation\"> Steve: I think I have some material on a remote control design which may be helpful here <\/span>\n<div class=\"touchit_figure\"><a name=\"fg:9.7\"><\/a><!-- link_id --><a name=\"fg:microwave\" class=\"xref_label\"  xref_local=\"fg:microwave\" xref_label=\"fg:hybrid-devices.microwave\"><\/a><\/p>\n<p style=\"text-align: left;\"><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/microwave-controls.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2593\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.7-microwave-controls-115-1528_IMG-768x1024.jpg\" alt=\"\" width=\"225\" height=\"300\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.7-microwave-controls-115-1528_IMG-768x1024.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.7-microwave-controls-115-1528_IMG-225x300.jpg 225w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.7-microwave-controls-115-1528_IMG-1152x1536.jpg 1152w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.7-microwave-controls-115-1528_IMG.jpg 1200w\" sizes=\"auto, (max-width: 225px) 100vw, 225px\" \/><\/a><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.7<\/span> <\/span>  Microwave oven control panel\u00a0<\/p><\/p>\n<p><\/div>\n<p>There are also metaphorical positions associated with some concepts. Up, loud, large and forward are &#8216;positive&#8217;, so on a TV remote where there are arrow buttons for volume control we expect the upward pointing arrow to make the sound louder; for the channel selection up would increase the channel number and down decrease it.<\/p>\n<p>Left and right are somewhat more complex. In a dextra-oriented society, right is usually the &#8216;positive&#8217; direction, but this is complicated by <span class=\"touchit_term\"  ix_as=\"reading order\" ix_within=\"controls, on consumer appliances\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"reading order\">reading order<\/span>. In left-to-right languages such as European languages, the two agree, and in particular notices, images and controls that need to be read or operated in a sequence should flow left-to-right, but where the language flows right-to-left sequences will also flow in that direction.<\/p>\n<p>Interestingly the top-to-bottom reading order of English and other languages also causes a conflict for temporal ordering. Is forward in time up or down? You will find examples of both being used for information display, but where you want someone to use a sequence of controls in a particular order, left-to-right and top-to-bottom reading order wins (for English and European languages).<\/p>\n<p>The observant reader may notice another positioning conflict in the microwave controls in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.microwave\" xref_postid=\"583\" touchit_value=\"9.7\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:microwave --><a name=\"xu:8\"><\/a><a href=\"#fg:microwave\">9.7<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.microwave\n    [postid] => 583\n    [slug] => fg:microwave\n    [local] => fg:microwave\n    [global] => fg:hybrid-devices.microwave\n    [value] => 9.7\n    [type] => figure\n    [content] => \n)\n   --><\/span>. Along the bottom of the panel are three buttons, which add 10 minutes, 1 minute and 10 seconds respectively to the total cooking time &#8212; that is bigger to the left, the opposite to the general right=positive=bigger rule. However, this reflects the order that the digits are written in the display &#8212; when you write numbers it is the digit corresponding to the biggest unit that comes first.<\/p>\n<div class=\"touchit_box\"><a name=\"bx:9.1\"><\/a><!-- link_id --><a name=\"bx:scroll-bar\" class=\"xref_label\"  xref_local=\"bx:scroll-bar\" xref_label=\"bx:hybrid-devices.scroll-bar\"><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_box\"><span class=\"label_prefix\">Box<\/span> <span class=\"label_counter\">9.1<\/span> <\/span>   Why are software <span class=\"touchit_term\"  ix_rawcontent=\"scroll bars\">scroll bars<\/span> on the right-hand side of the screen?<br \/><\/p><\/p>\n<p>Think of the reason for using a scroll bar. You have a document or list and want to find something. So you scroll a bit, examining the document as you go until you find the required position in the text or list. Now consider your eye movement during this process. It is usually the first few characters or words that are significant in identifying whether you are at the right place. These occur on the left, so your eye has to scan constantly from the scroll bar on the right (which you are controlling with a mouse and thus need to look at) to the start of the text on the left.<\/p>\n<p>Early scroll bars in the <span class=\"touchit_term\"  ix_rawcontent=\"Smalltalk\">Smalltalk<\/span> and Interlisp environments (the direct ancestors of our current WIMP interface) had user-configurable scroll bars, which could be made to appear either side. But the default and norm was on the left. Yet the <span class=\"touchit_term\"  ix_rawcontent=\"Apple\">Apple<\/span> Lisa, then Macintosh, followed by almost all Windows interfaces, adopted Rank Xerox&#8217;s GlobalView, the <span class=\"touchit_term\"  ix_rawcontent=\"Xerox\">Xerox<\/span> Star desktop interface that had scroll bars on the right. So why did scroll bars start appearing on the right?<\/p>\n<p>The right-hand side seems &#8216;right&#8217; because for most users (those who are right-handed), to grab a scroll bar on the left or to press a button on the left would mean your hand would have to move across the screen. Of course your hand doesn&#8217;t really have to move across the screen, the mouse does, but it feels as if it would have to! But in fact, though for right-handed users of a touchscreen, light pen or stylus the right-hand side is a good idea, for users of a mouse pointer the left would be better.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2595 \" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen-293x300.png\" alt=\"\" width=\"258\" height=\"264\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen-293x300.png 293w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen-1000x1024.png 1000w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen-768x787.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen-1500x1536.png 1500w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/box9.1-hands-across-the-screen.png 1532w\" sizes=\"auto, (max-width: 258px) 100vw, 258px\" \/><\/p>\n<p><\/div>\n<p>So, as you design <span class=\"touchit_term\"  ix_as=\"physical correspondences\" ix_within=\"controls, on consumer appliances\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"physical correspondences\">physical correspondences<\/span> you need to be aware that there may be several potential correspondences and the one the user assumes may not be the one you intend. Where there is potential for confusion you can either:<\/p>\n<p style=\"padding-left: 30px;\">(a) attempt to remove one of the ambiguous correspondences by repositioning controls; for example, putting time controls vertically rather than horizontally.<\/p>\n<p style=\"padding-left: 30px;\">(b) increase the physical connection of one control so that it dominates; for example, placing time controls directly below a display to make the correspondence between digits on the display and the button order more obvious.<\/p>\n<p style=\"padding-left: 30px;\">(c) add additional labels or other decoration to disambiguate; for example, make &#8216;mins&#8217; and &#8216;secs&#8217; a little more salient, though this shift from physical to <span class=\"touchit_term\"  ix_as=\"symbols\" ix_rawcontent=\"\"><\/span>symbolic may fail when users are stressed &#8212; just like the cooker control labels when the pan is boiling over.<\/p>\n<p style=\"padding-left: 30px;\">(d) perform a user study to see whether one of the physical correspondences is the natural interpretation; in fact the time controls on the microwave appear to work without any errors, so in this case the digit order is clear.<\/p>\n<p>Even if physical correspondences have not been explicitly designed, users will often perceive them. Recall the story of the fire alarm in Chapter <span class=\"touchit_xref\"   xref_label=\"ch:interacting-with-physical-objects\" xref_postid=\"451\" touchit_value=\"8\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:interacting-with-physical-objects --><a name=\"xu:9\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/objects-things\/interacting-with-physical-objects\/#ch:interacting-with-physical-objects\">8<\/a><!-- xref_data: Array\n(\n    [name] => ch:interacting-with-physical-objects\n    [postid] => 451\n    [slug] => ch:interacting-with-physical-objects\n    [local] => ch:interacting-with-physical-objects\n    [global] => ch:interacting-with-physical-objects\n    [value] => 8\n    [type] => chapter\n    [content] => \n)\n   --><\/span>. In that case the fire alarm button was next to the door. This is a sensible position for a fire alarm, but it is also where you normally expect a light switch to be.<\/p>\n<p>All the examples so far have been of very &#8216;ordinary&#8217; interfaces. However, the same issues arise when designing more innovative interactions. The <span class=\"touchit_term\"  ix_as=\"expected, sensed, and desired framework\" ix_rawcontent=\"&amp;#8216;expected, sensed, and desired&amp;#8217; framework\">&#8216;expected, sensed, and desired&#8217; framework<\/span> was developed as part of the Equator project in order to analyse and generate mappings in novel devices <span class=\"touchit_bibcite\"  bibcite=\"BS05\"><a name=\"bibcite:5\"><\/a>[<a href=\"#ref-BS05\">BS05<\/a>]<\/span>. Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.augurscope\" xref_postid=\"583\" touchit_value=\"9.8\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:augurscope --><a name=\"xu:10\"><\/a><a href=\"#fg:augurscope\">9.8<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.augurscope\n    [postid] => 583\n    [slug] => fg:augurscope\n    [local] => fg:augurscope\n    [global] => fg:hybrid-devices.augurscope\n    [value] => 9.8\n    [type] => figure\n    [content] => \n)\n   --><\/span> shows one device analysed, the <span class=\"touchit_term\"  ix_rawcontent=\"Augurscope\">Augurscope<\/span>, which was used to view 3D virtual worlds. The user either pushes the small trolley or holds the detachable screen in their hands while walking around Nottingham Castle. When they point the screen at a location they see a reconstructed 3D view of what was there in the past.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.8\"><\/a><!-- link_id --><a name=\"fg:augurscope\" class=\"xref_label\"  xref_local=\"fg:augurscope\" xref_label=\"fg:hybrid-devices.augurscope\"><\/a><\/p>\n<p style=\"text-align: left;\"><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-590 size-large\" title=\"augurscope\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope-1024x578.jpg\" alt=\"\" width=\"750\" height=\"423\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope-1024x578.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope-400x225.jpg 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope-300x169.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/augurscope.jpg 3000w\" sizes=\"auto, (max-width: 750px) 100vw, 750px\" \/><\/a><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.8<\/span> <\/span>   The Augurscope II, stand-mounted and hand-held (from <span class=\"touchit_bibcite\"  bibcite=\"BS05\"><a name=\"bibcite:6\"><\/a>[<a href=\"#ref-BS05\">BS05<\/a>]<\/span>)\u00a0<\/p><\/p>\n<p><\/div>\n<p>The <span class=\"touchit_term\"  ix_as=\"expected, sensed, and desired framework\" ix_rawcontent=\"framework\">framework<\/span> considers three things:<\/p>\n<ul>\n<li><em>expected<\/em> &#8212; What actions is the user likely to perform on the device? For example, the device may be pointed in different directions, or used while walking around.<\/li>\n<li><em>sensed<\/em> &#8212; What manipulations of the device can the sensors embedded in the device detect? The Augurscope was equipped with a <span class=\"touchit_term\"  ix_rawcontent=\"GPS\">GPS<\/span> and an electronic compass (now common in mobile phones and other hand-held devices, but not at the time).<\/li>\n<li><em>desired<\/em> &#8212; What functionality is wanted for the device? For example, the ability to look at the scene from different directions.<\/li>\n<\/ul>\n<p>Having identified elements in these three categories one can use the analysis to look for potential matches, mismatches and opportunities. Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.sensed-desired\" xref_postid=\"583\" touchit_value=\"9.9\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:sensed-desired --><a name=\"xu:11\"><\/a><a href=\"#fg:sensed-desired\">9.9<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.sensed-desired\n    [postid] => 583\n    [slug] => fg:sensed-desired\n    [local] => fg:sensed-desired\n    [global] => fg:hybrid-devices.sensed-desired\n    [value] => 9.9\n    [type] => figure\n    [content] => \n)\n   --><\/span> shows the space of possible overlaps and gaps between these categories.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.9\"><\/a><!-- link_id --><a name=\"fg:sensed-desired\" class=\"xref_label\"  xref_local=\"fg:sensed-desired\" xref_label=\"fg:hybrid-devices.sensed-desired\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2630 \" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-1024x833.png\" alt=\"\" width=\"331\" height=\"269\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-1024x833.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-300x244.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-369x300.png 369w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-768x625.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-1536x1249.png 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired-2048x1666.png 2048w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig9.9-expected-sensed-desired.png 2385w\" sizes=\"auto, (max-width: 331px) 100vw, 331px\" \/><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.9<\/span> <\/span>   Overlaps and gaps identified by the framework (adapted from <span class=\"touchit_bibcite\"  bibcite=\"BS05\"><a name=\"bibcite:7\"><\/a>[<a href=\"#ref-BS05\">BS05<\/a>]<\/span>) <\/p><\/p>\n<p><\/div>\n<p>In the centre are the things for which the device is already catering well: desired functionality for which there is an expected user action, which can be sensed using the existing sensors. The simple act of turning the device around fits in this area: if the user is looking in one direction and can see the historic reconstruction in that direction, it is natural to turn the device to face other ways. This can be sensed using the compass and so the desired functionality of exploring the 3D reconstruction is achieved.<\/p>\n<p>Other parts of the <span class=\"touchit_term\"  ix_as=\"expected, sensed, and desired framework\" ix_rawcontent=\"framework\">framework<\/span> suggest potential problems. On the right are things that are desired and sensed but not expected. The seminar room light switch we mentioned earlier is an example of this. Part of the desired functionality was to dim the lights and this was mapped onto holding the switch down; however, this was not an expected action for the user and so it remained undiscovered until Alan&#8217;s lecture.<\/p>\n<a name=\"note:3\"><\/a><span class=\"touchit_note touchit_web annotation\"> is there an opportunity here (or somewhere close by to talk a bit about the light switches in our new building which adopt the physical form of a standard light switch but which are computer mediated and near impossible to operate&#8230;<\/span>\n<p>However, the framework can be used as an inspiration or to identify opportunities for design. At the bottom is desired functionality that is currently not supported at all in the device, while at the top are actions that are expected and sensed but for which there is no currently desired functionality: can the latter be used to offer ways of achieving the desired functionality? One of the desired, but not supported, features of the <span class=\"touchit_term\"  ix_rawcontent=\"Augurscope\">Augurscope<\/span> was to explore caves beneath the castle grounds. The Augurscope permitted &#8216;flying&#8217; above the ground (to see a <span class=\"touchit_term\"  ix_rawcontent=\"bird&amp;#8217;s eye view\">bird&#8217;s eye view<\/span> of an area) by tilting the Augurscope screen downwards, but while it may be expected that users might make the opposite upward movement and this could be sensed with the compass (top area), there was no desired function mapped to that movement. This suggests a potential way in which the unsupported cave-viewing functionality could be mapped onto the upward tilt, like &#8216;dropping&#8217; into the ground, and then reversed by a downward tilt which would &#8216;fly&#8217; back up to the surface.<\/p>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.6\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.6<\/span> <\/span> Feedback<\/h2>\n<p><span class=\"touchit_term\"  ix_rawcontent=\"Feedback\">Feedback<\/span> &#8212; letting the user know what has happened &#8212; has been another key issue since the earliest days of <span class=\"touchit_term\"  ix_rawcontent=\"human&amp;#8211;computer interaction\">human&#8211;computer interaction<\/span>. When you type on a proper keyboard you can hear that you have typed a key as you hear the <span class=\"touchit_term\"  ix_as=\"in interaction\" ix_within=\"sound\" ix_rawcontent=\"sound\">sound<\/span> it makes &#8212; the sound is natural feedback. However, in a noisy street you may not be able to hear this click of the key and so cash machines often make an additional loud beep for each key that you press. Without this feedback you may press the key again because you are unsure whether you really pressed it the first time. In some circumstances this may be fine, if the second press does nothing, or at least does no harm, but often pressing a key twice is not what is wanted at all.<\/p>\n<p>In &#8216;The Design of Everyday Things&#8217; <span class=\"touchit_bibcite\"  bibcite=\"No98\"><a name=\"bibcite:8\"><\/a>[<a href=\"#ref-No98\">No98<\/a>]<\/span>, <span class=\"touchit_term\"  ix_as=\"Norman, Donald\" ix_rawcontent=\"Don Norman\">Don Norman<\/span> suggested that <span class=\"touchit_term\"  ix_as=\"human action, seven stages of\" ix_rawcontent=\"human action\">human action<\/span> can be seen in terms of a seven-stage cycle. Four of the stages relate to the execution of an action: deciding what to do and doing it.<\/p>\n<ul>\n<li>Stage 1. establishing a <em>goal<\/em> or desired state of the world (e.g. have document secure)<\/li>\n<li>Stage 2. forming an <em>intention to act<\/em> (e.g. save the document)<\/li>\n<li>Stage 3. producing a <em>sequence of actions<\/em> (e.g. move mouse to &#8216;save&#8217; button&#8217; then click)<\/li>\n<li>Stage 4. <em> executing<\/em> the action (e.g. actually move hand and fingers)<\/li>\n<\/ul>\n<p>These stages can be used to diagnose different kinds of problem. In particular, <span class=\"touchit_term\"  ix_as=\"Reason, James\" ix_rawcontent=\"James Reason\">James Reason<\/span> <span class=\"touchit_bibcite\"  bibcite=\"Re90\"><a name=\"bibcite:9\"><\/a>[<a href=\"#ref-Re90\">Re90<\/a>]<\/span> distinguished two kinds of <span class=\"touchit_term\"  ix_rawcontent=\"human error\">human error<\/span>: 1) <span class=\"touchit_term\"  ix_special=\"bang\" ix_rawcontent=\"mistakes\">mistakes<\/span>, where the user is trying to do the wrong thing and 2) <span class=\"touchit_term\"  ix_special=\"bang\" ix_rawcontent=\"slips\">slips<\/span>, where the user is trying to do the right thing, but in some way fails to achieve it. The former are effectively failures in Stage 2 whereas the latter are failures in Stages 3 and 4.<\/p>\n<p>However, it is the second part of the cycle which is of interest here, the three stages of evaluating an action: working out whether it did what was intended.<\/p>\n<ul>\n<li>Stage 5. <em> perceiving<\/em> the state of the world (e.g. see alert box &#8216;file already exists&#8217;)<\/li>\n<li>Stage 6. <em> interpreting<\/em> the perceived state (e.g. understanding the words)<\/li>\n<li>Stage 7. <em> evaluating<\/em> the resulting situation with respect to the goals and intentions (e.g. deciding that the document needs to be stored in a different place)<\/li>\n<\/ul>\n<p>All these stages critically depend on feedback, having sufficient information available from the world (including a computer system or electronic device) to work out whether the right thing happened. As in the execution stages, failures can happen at different points. A small red light on the car dashboard may not be noticed at all (failure in Stage 5), or if noticed the driver may think it means the petrol is nearly empty whereas it in fact means the engine is seriously malfunctioning (failure in Stage 6).<\/p>\n<p>Physical objects often create <span class=\"touchit_term\"  ix_rawcontent=\"feedback\">feedback<\/span> naturally because of what they are: you lift a mug and you can feel its weight as it lifts off the table, drop it and you hear the crash as it hits the floor. However, with electronic and hybrid devices it is often necessary to add feedback explicitly for digital effects. For example, you do not hear the sound of an email squashing its way through the network cable, but software may add a sound effect.<\/p>\n<div class=\"touchit_box\"><a name=\"bx:9.2\"><\/a><!-- link_id --><a name=\"bx:physicality-based-digital-input\" class=\"xref_label\"  xref_local=\"bx:physicality-based-digital-input\" xref_label=\"bx:hybrid-devices.physicality-based-digital-input\"><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_box\"><span class=\"label_prefix\">Box<\/span> <span class=\"label_counter\">9.2<\/span> <\/span>   Physicality-based digital input <\/p><\/p>\n<p>The <em><span class=\"touchit_term\"  ix_rawcontent=\"Apple\">Apple<\/span> <span class=\"touchit_term\"  ix_rawcontent=\"iPhone\">iPhone<\/span><\/em> changed the way we use mobile phones. The <span class=\"touchit_term\"  ix_as=\"touchscreen\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"touchscreen\" ix_rawcontent=\"multi-touch screen\">multi-touch screen<\/span> technology it embraced and the physical <span class=\"touchit_term\"  ix_as=\"gesture-based interfaces\" ix_rawcontent=\"gestures\">gestures<\/span> used to control it have become virtually ubiquitous, so it is hard to recall that they were once revolutionary. Apple made it possible to input using physical gestures that map well onto our &#8216;natural&#8217; sense of how the physical world works. Multi-touch screens allow us to utilise gestures from our real, physical world as human digital interaction methods. Thus we are able to zoom in on a picture by placing our thumb and forefinger on the screen and expanding the space between them, in a signal we might physically use in, say, a game of Charades to indicate expansion (in the Charades case of a word). The iPhone\u2019s ability to accept the inputs of more than one touch at a time and to interpret the physical movement between touches into meaningful digital inputs transformed our ability to interact with a digital product in a physical sense, despite the lack of many of the tactile qualities we would usually associate with a satisfactory physical interaction with an artificial device.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2680 \" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-768x1024.jpg\" alt=\"\" width=\"226\" height=\"301\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-768x1024.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-225x300.jpg 225w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-1152x1536.jpg 1152w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-1536x2048.jpg 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Box-9-2-2020-01-07-16.57.02-scaled.jpg 1920w\" sizes=\"auto, (max-width: 226px) 100vw, 226px\" \/><\/p>\n<p><a name=\"note:4\"><\/a><span class=\"touchit_comment touchit_source annotation\">https:\/\/www.flickr.com\/photos\/williamhook\/38109880456\/in\/photostream\/<\/span><\/p>\n<p><\/div>\n<p>Imagine you are about to make a call on a mobile phone and start to enter the number. You will experience several different forms of <span class=\"touchit_term\"  ix_rawcontent=\"feedback\">feedback<\/span>:<\/p>\n<ul>\n<li>you feel the key being pressed;<\/li>\n<li>you hear a simulated key click sound;<\/li>\n<li>the number appears on the screen.<\/li>\n<\/ul>\n<p>The first of these is connected purely with the physical device; you still feel it even if the battery is removed. The second is a simulated real sound, as if the physical keys made a noise, and the last is purely digital.<\/p>\n<p>Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.feedback-loops\" xref_postid=\"583\" touchit_value=\"9.10\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:feedback-loops --><a name=\"xu:12\"><\/a><a href=\"#fg:feedback-loops\">9.10<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.feedback-loops\n    [postid] => 583\n    [slug] => fg:feedback-loops\n    [local] => fg:feedback-loops\n    [global] => fg:hybrid-devices.feedback-loops\n    [value] => 9.10\n    [type] => figure\n    [content] => \n)\n   --><\/span> shows some of these <span class=\"touchit_term\"  ix_as=\"feedback loop\" ix_rawcontent=\"feedback loops\">feedback loops<\/span>. Unless the user is implanted with a brain-reading device, all interactions with the machine start with some physical action (a). This could include making sounds, but here we will focus on bodily actions such as turning a knob, pressing a button, dragging a mouse. In many cases this physical action will have an effect on the device: the mouse button goes down, or the knob rotates and this gives rise to the most direct physical feedback loop (A) where you feel the movement (c) or see the effect on the physical device (b).<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.10\"><\/a><!-- link_id --><a name=\"fg:feedback-loops\" class=\"xref_label\"  xref_local=\"fg:feedback-loops\" xref_label=\"fg:hybrid-devices.feedback-loops\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/feedback-loops.jpg\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2597\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-1024x634.png\" alt=\"\" width=\"500\" height=\"310\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-1024x634.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-300x186.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-400x248.png 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-768x476.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-1536x952.png 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-2048x1269.png 2048w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.10-Multiple-feedback-loops-scaled.png 2560w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/p>\n<p style=\"text-align: left;\"><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.10<\/span> <\/span>   Multiple feedback loops\u00a0<\/p><\/p>\n<p><\/div>\n<p>In order for there to be any digital effect on the underlying logical system the changes effected on the device through the user&#8217;s physical actions must be sensed (i). For example, a key press causes an electrical connection detected by the keyboard controller. This may give rise to a very immediate feedback associated with the device; for example, a simulated key click or an indicator light on an on\/off switch (ii). In some cases this immediate loop (B) may be indistinguishable from actual physical feedback from the device (e.g. force feedback as in the <span class=\"touchit_term\"  ix_rawcontent=\"BMW iDrive\">BMW iDrive<\/span> discussed in Chapter <span class=\"touchit_xref\"   xref_label=\"ch:sota\" xref_postid=\"731\" touchit_value=\"2\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:sota --><a name=\"xu:13\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/introduction\/whats-happening-now\/#ch:sota\">2<\/a><!-- xref_data: Array\n(\n    [name] => ch:sota\n    [postid] => 731\n    [slug] => ch:sota\n    [local] => ch:sota\n    [global] => ch:sota\n    [value] => 2\n    [type] => chapter\n    [content] => \n)\n   --><\/span>). In other cases, such as the on\/off indicator light, it is clearly not a physical effect, but proximity in space and immediacy of effect may make it feel like part of the device.<\/p>\n<p>Where the user is not aware of the difference between <span class=\"touchit_term\"  ix_rawcontent=\"feedback\">feedback<\/span> intrinsic to the physical device and simulated feedback, we may regard this aspect of loop (B) as part of `the device&#8217; and indistinguishable from (A). However, one has to be careful that this really is both instantaneous and reliable. For example, Alan often used to mistype on his old multi-tap mobile phone, hitting four instead of three taps for letters such as &#8216;c&#8217; or &#8216;i&#8217;. After some experimentation it became obvious that this was because there was a short delay (a fraction of a second) between pressing a key and the simulated key-click. The delayed aural feedback was clearly more salient than the felt physical feedback and so interfered with the typing; effectively he counted clicks rather than presses. Switching the phone to silent significantly reduced typing errors. These interactions between visual and aural feedback can be quite complex; we will return to this in Chapter <span class=\"touchit_xref\"   xref_label=\"ch:prototyping\" xref_postid=\"749\" touchit_value=\"20\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:prototyping --><a name=\"xu:14\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/theory-and-practice-of-physicality\/prototyping-and-tool-support\/#ch:prototyping\">20<\/a><!-- xref_data: Array\n(\n    [name] => ch:prototyping\n    [postid] => 749\n    [slug] => ch:prototyping\n    [local] => ch:prototyping\n    [global] => ch:prototyping\n    [value] => 20\n    [type] => chapter\n    [content] => \n)\n   --><\/span> when we discuss the McGurk Effect.<\/p>\n<p>The sensed input (i) will also cause internal effects on the logical system, changing the internal state of logical objects; for a GUI interface this may be changed text, for an MP3 player a new track or increased volume. This change to the logical state then often causes a virtual effect (iii) on a visual or audible display; for example an LCD showing the track number (iii). When the user perceives these changes (d) we get a semantic feedback loop (C). In direct manipulation systems the aim is to make this loop so rapid that it feels just like a physical action on the virtual objects.<\/p>\n<p>Finally, some systems affect the physical environment in more radical ways than changing screen content. For example, a washing machine starts to fill with water, or a light goes on. In addition there may be unintended physical feedback, for example, a disk starting up. These physical effects (iv) may then be perceived by the user (e) giving additional <span class=\"touchit_term\"  ix_as=\"semantic\" ix_within=\"feedback\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"semantic feedback\">semantic feedback<\/span> and so setting up a fourth <span class=\"touchit_term\"  ix_rawcontent=\"feedback loop\">feedback loop<\/span> (D).<\/p>\n<a name=\"note:5\"><\/a><span class=\"touchit_note touchit_web annotation\">\u00a0Frogger &#8211; feedforward <\/span>\n<h2 class=\"touchit_heading\"><a name=\"sc:9.7\"><\/a><!-- link_id --><a name=\"sc:device-unplugged\" class=\"xref_label\"  xref_local=\"sc:device-unplugged\" xref_label=\"sc:hybrid-devices.device-unplugged\"><\/a><span class=\"touchit_label touchit_label_section\"><span class=\"label_counter\">9.7<\/span> <\/span> The device unplugged<\/h2>\n\n<p>When something stops working, you might give it to a child as a plaything, if it is safe to do so. Or perhaps you are waiting for a bus and have a restless baby; you might give your phone to the baby to play with (after turning it off so that she does not accidentally call the police!).<\/p>\n<p>With a smartphone the baby could perhaps use it as a mirror, feel the weight of it, look at its shininess. With an older phone, the baby might press buttons, perhaps open and close the lid (Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.phone-states\" xref_postid=\"583\" touchit_value=\"9.11\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:phone-states --><a name=\"xu:15\"><\/a><a href=\"#fg:phone-states\">9.11<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.phone-states\n    [postid] => 583\n    [slug] => fg:phone-states\n    [local] => fg:phone-states\n    [global] => fg:hybrid-devices.phone-states\n    [value] => 9.11\n    [type] => figure\n    [content] => \n)\n   --><\/span>).<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.11\"><\/a><!-- link_id --><a name=\"fg:phone-states\" class=\"xref_label\"  xref_local=\"fg:phone-states\" xref_label=\"fg:hybrid-devices.phone-states\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2600\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-726x1024.jpg\" alt=\"\" width=\"124\" height=\"175\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-726x1024.jpg 726w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-213x300.jpg 213w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-768x1083.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-1089x1536.jpg 1089w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807-1452x2048.jpg 1452w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11a-iphone-mirror-IMG_2807.jpg 1736w\" sizes=\"auto, (max-width: 124px) 100vw, 124px\" \/> \u00a0<img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2601\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-846x1024.jpg\" alt=\"\" width=\"145\" height=\"175\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-846x1024.jpg 846w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-248x300.jpg 248w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-768x930.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-1268x1536.jpg 1268w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-1691x2048.jpg 1691w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11b-nokia-closed-IMG_2807-scaled.jpg 2114w\" sizes=\"auto, (max-width: 145px) 100vw, 145px\" \/>\u00a0 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2602\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-830x1024.jpg\" alt=\"\" width=\"142\" height=\"175\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-830x1024.jpg 830w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-243x300.jpg 243w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-768x947.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-1246x1536.jpg 1246w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-1661x2048.jpg 1661w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.11c-nokia-open-IMG_2808-scaled.jpg 2076w\" sizes=\"auto, (max-width: 142px) 100vw, 142px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.11<\/span> <\/span>   (i) a nice mirror (ii) buttons to push and (iii) slide the phone in and out <\/p><\/p>\n<p><\/div>\n<p>When we think of a device such as a phone, we quite rightly treat it as a whole, &#8216;I press this button and it dials a number&#8217;. However, as we started to see at the end of the last section, and as the playing baby demonstrates, the physical device has <span class=\"touchit_term\"  ix_rawcontent=\"interaction potential\">interaction potential<\/span> even when <span class=\"touchit_term\"  ix_as=\"device unplugged\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"unplugged devices\" ix_rawcontent=\"unplugged\">unplugged<\/span>, disconnected from its power and digital functionality.<\/p>\n<p>Think of the phone without its battery, or tearing a central heating control off the wall and snipping its wires. What can you do with them? What do they suggest to you?<\/p>\n<p>As the baby would discover, the <span class=\"touchit_term\"  ix_rawcontent=\"iPhone\">iPhone<\/span> on the left in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.feedback-loops\" xref_postid=\"583\" touchit_value=\"9.10\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:feedback-loops --><a name=\"xu:16\"><\/a><a href=\"#fg:feedback-loops\">9.10<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.feedback-loops\n    [postid] => 583\n    [slug] => fg:feedback-loops\n    [local] => fg:feedback-loops\n    [global] => fg:hybrid-devices.feedback-loops\n    [value] => 9.10\n    [type] => figure\n    [content] => \n)\n   --><\/span> has very little interaction potential without its power: there is one button at the bottom of the screen, and a few small buttons on its edge, all artfully placed so as not to obscure the clean lines of the phone. In contrast, the phone on the right has a variety of actions that can be performed, pressing buttons, sliding the keyboard in and out.<\/p>\n<p>In the remainder of this chapter we will work through a number of examples of devices showing different kinds of interaction potential when <span class=\"touchit_term\"  ix_as=\"unplugged devices\" ix_rawcontent=\"unplugged\">unplugged<\/span>, and discuss how these physical actions <span class=\"touchit_term\"  ix_as=\"mapping action to functionality\" ix_rawcontent=\"map\">map<\/span> onto the digital functionality. The &#8216;unplugged&#8217; behaviour will in most cases be illustrated using a <em><span class=\"touchit_term\"  ix_rawcontent=\"physigram\">physigram<\/span><\/em>, a diagrammatic way of formally describing physical behaviour <span class=\"touchit_bibcite\"  bibcite=\"DG09;DG17\"><a name=\"bibcite:10\"><\/a><a name=\"bibcite:11\"><\/a>[<a href=\"#ref-DG09\">DG09<\/a>;<a href=\"#ref-DG17\">DG17<\/a>]<\/span><\/p>\n<h3 class=\"touchit_heading\"><a name=\"sc:9.7.1\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_subsection\"><span class=\"label_counter\">9.7.1<\/span> <\/span> Exposed state<\/h3>\n<p>One of the simplest examples of a physical device is an on\/off light <span class=\"touchit_term\"  ix_as=\"controls\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_as=\"switches\" ix_rawcontent=\"switch\">switch<\/span>. In this case the switch has exactly two states (up and down) and pressing the switch changes the state (Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.light-switch-2-states\" xref_postid=\"583\" touchit_value=\"9.12\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:light-switch-2-states --><a name=\"xu:17\"><\/a><a href=\"#fg:light-switch-2-states\">9.12<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.light-switch-2-states\n    [postid] => 583\n    [slug] => fg:light-switch-2-states\n    [local] => fg:light-switch-2-states\n    [global] => fg:hybrid-devices.light-switch-2-states\n    [value] => 9.12\n    [type] => figure\n    [content] => \n)\n   --><\/span>). Note that even this simple device has <span class=\"touchit_term\"  ix_rawcontent=\"interaction potential\">interaction potential<\/span>; you can do things with it.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.12\"><\/a><!-- link_id --><a name=\"fg:light-switch-2-states\" class=\"xref_label\"  xref_local=\"fg:light-switch-2-states\" xref_label=\"fg:hybrid-devices.light-switch-2-states\"><\/a><br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2605\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.12-light-switch-STN-823x1024.png\" alt=\"\" width=\"192\" height=\"238\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.12-light-switch-STN-823x1024.png 823w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.12-light-switch-STN-241x300.png 241w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.12-light-switch-STN-768x955.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.12-light-switch-STN.png 825w\" sizes=\"auto, (max-width: 192px) 100vw, 192px\" \/><br \/>\n<p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.12<\/span> <\/span>   light switch: two states &#8212; visible even when the light bulb is broken\u00a0<\/p><\/p>\n<p><\/div>\n<p>Even this is not so simple, since the kind of press you give the switch depends on whether it is up and you want to press it down, or down and you want to press it up. For most switches you will not even be aware of this difference because it is obvious which way to press the switch. It is obvious because the current state of the switch is immediately visible.<\/p>\n<p>Note that the switch has a perceivable up\/down state whether or not it is actually connected to a light and whether or not the light works &#8212; it has <span class=\"touchit_term\"  ix_rawcontent=\"exposed state\">exposed state<\/span>.<\/p>\n<p>The phone in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.phone-states\" xref_postid=\"583\" touchit_value=\"9.11\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:phone-states --><a name=\"xu:18\"><\/a><a href=\"#fg:phone-states\">9.11<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.phone-states\n    [postid] => 583\n    [slug] => fg:phone-states\n    [local] => fg:phone-states\n    [global] => fg:hybrid-devices.phone-states\n    [value] => 9.11\n    [type] => figure\n    [content] => \n)\n   --><\/span> also has some exposed state in that you can see whether it is open or closed, but the buttons are not the kind that stay down. The <span class=\"touchit_term\"  ix_rawcontent=\"iPhone\">iPhone<\/span> has no exposed state at all. Here are some more exposed state devices (Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.exposed-state\" xref_postid=\"583\" touchit_value=\"9.13\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:exposed-state --><a name=\"xu:19\"><\/a><a href=\"#fg:exposed-state\">9.13<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.exposed-state\n    [postid] => 583\n    [slug] => fg:exposed-state\n    [local] => fg:exposed-state\n    [global] => fg:hybrid-devices.exposed-state\n    [value] => 9.13\n    [type] => figure\n    [content] => \n)\n   --><\/span>).<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.13\"><\/a><!-- link_id --><a name=\"fg:exposed-state\" class=\"xref_label\"  xref_local=\"fg:exposed-state\" xref_label=\"fg:hybrid-devices.exposed-state\"><\/a><\/p>\n<p><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/power-switches1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-600\" title=\"power-switches\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/power-switches1-300x239.jpg\" alt=\"\" width=\"152\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/power-switches1-300x239.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/power-switches1.jpg 517w\" sizes=\"auto, (max-width: 152px) 100vw, 152px\" \/><\/a> <a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-601\" title=\"washing-machine-knob\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob-300x257.jpg\" alt=\"\" width=\"141\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob-300x257.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob-349x300.jpg 349w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob-1024x877.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/washing-machine-knob.jpg 1548w\" sizes=\"auto, (max-width: 141px) 100vw, 141px\" \/><\/a> <a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-599\" title=\"central-heating-control\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control-300x269.jpg\" alt=\"\" width=\"134\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control-300x269.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control-333x300.jpg 333w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control-1024x921.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/central-heating-control.jpg 2148w\" sizes=\"auto, (max-width: 134px) 100vw, 134px\" \/><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.13<\/span> <\/span>   Exposed state devices\u00a0<\/p><\/p>\n<p><\/div>\n<p>The sockets are similar to the light switch except that the red colour on the top of the switch is also designed to give some indication of the mapping; this is known as feedforward. The washing machine control dial is more complex, but again it is immediately obvious by looking at the dial that it has many potential states. Like the power switch it also tries to provide feedforward through words and <span class=\"touchit_term\"  ix_rawcontent=\"symbols\">symbols<\/span> around the dial. We will return to the washing machine dial later as it has a particularly interesting story to tell.<\/p>\n<p>The central heating control is more like the mobile phone as it has a flap that moves up and down. Like the light switch, this means there are two very visually and tangibly obvious states: open and closed. However, this is a very particular form of <span class=\"touchit_term\"  ix_rawcontent=\"exposed state\">exposed state<\/span> as its effect is to hide or reveal other controls. In this case the purpose is to hide complexity, but it may also be used to protect against unintended actions &#8212; when the phone is closed it is impossible to accidentally dial a number. In the case of the phone there is of course yet another purpose, which is to change the form-factor: when closed the phone is smaller, to fit in your pocket or bag.<\/p>\n<h3 class=\"touchit_heading\"><a name=\"sc:9.7.2\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_subsection\"><span class=\"label_counter\">9.7.2<\/span> <\/span> Hidden state<\/h3>\n<p>In contrast to these exposed state devices, consider this volume control on a CD player (Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.CD-hidden-state\" xref_postid=\"583\" touchit_value=\"9.14\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:CD-hidden-state --><a name=\"xu:20\"><\/a><a href=\"#fg:CD-hidden-state\">9.14<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.CD-hidden-state\n    [postid] => 583\n    [slug] => fg:CD-hidden-state\n    [local] => fg:CD-hidden-state\n    [global] => fg:hybrid-devices.CD-hidden-state\n    [value] => 9.14\n    [type] => figure\n    [content] => \n)\n   --><\/span>). It has clear <span class=\"touchit_term\"  ix_rawcontent=\"action potential\">action potential<\/span>, perceptual affordance: you can see that it sticks out, is round, it invites you to pull, push and, in particular given its roundness, twist it. However, remember the power is unplugged and so there is no sound (or imagine twisting it during a moment of <span class=\"touchit_term\"  ix_rawcontent=\"silence\">silence<\/span> between movements). There is no indication after you have twisted it of how far it turned. The washing machine and cooker knobs were styled and decorated so there was an obvious &#8216;I am pointing this way&#8217; direction, but here there is no feedback. In fact, things have changed inside, but on the outside, nothing is detectable; it has <span class=\"touchit_term\"  ix_rawcontent=\"hidden state\">hidden state<\/span>.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.14\"><\/a><!-- link_id --><a name=\"fg:CD-hidden-state\" class=\"xref_label\"  xref_local=\"fg:CD-hidden-state\" xref_label=\"fg:hybrid-devices.CD-hidden-state\"><\/a><\/p>\n<p><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-602\" title=\"CD-volume-knob\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob-300x85.jpg\" alt=\"\" width=\"300\" height=\"85\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob-300x85.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob-400x114.jpg 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob-1024x291.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/CD-volume-knob.jpg 1245w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.14<\/span> <\/span>   Volume knob on CD player &#8212; no visible state\u00a0<\/p><\/p>\n<p><\/div>\n<p>Hidden state might be irritating on a music player, but there are occasions when it can have much more serious consequences (See box).<\/p>\n<div class=\"touchit_box\"><a name=\"bx:9.3\"><\/a><!-- link_id --><a name=\"bx:infusion\" class=\"xref_label\"  xref_local=\"bx:infusion\" xref_label=\"bx:hybrid-devices.infusion\"><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_box\"><span class=\"label_prefix\">Box<\/span> <span class=\"label_counter\">9.3<\/span> <\/span>   \u00a0A physicality approach to <span class=\"touchit_term\"  ix_rawcontent=\"infusion pumps\">infusion pumps<\/span> &#8212; some thoughts\u00a0<\/p><\/p>\n<p>In 2008 <span class=\"touchit_term\"  ix_as=\"Thimbleby, Harold\" ix_rawcontent=\"Harold Thimbleby\">Harold Thimbleby<\/span>\u00a0<span class=\"touchit_bibcite\"  bibcite=\"Th08\"><a name=\"bibcite:12\"><\/a>[<a href=\"#ref-Th08\">Th08<\/a>]<\/span> noted that the annual death toll from medical errors was roughly similar to the combined annual toll of car accidents, breast cancer and AIDS combined. He went on to describe a case study of an infusion pump that had caused at least one patient death. Thimbleby concentrates mostly on programming factors, but we would argue (and indeed Thimbleby suggests) that the pump\u2019s physical design is an equally important factor. The accident in question involved a chemotherapy drug called diluted\u00a0<em>Fluorouracil<\/em>. The bag\u2019s label described the contents, the size of the dose and so on. In this case 5,250 mg of fluorouracil was to be diluted to 45.57 mg per mL and delivered over a four-day period. It was delivered 24 times too fast, killing the patient. While 2008 is some time ago, infusion pump designs at the time of writing nearly all still follow a very similar layout to the one Thimbleby inspected, with the key difference being larger, colour screens on a minority of models.<\/p>\n<p>A catalogue of issues had led to the patient\u2019s death, from failure to employ guidelines on how quantities should be notated, to problems with employing calculators to work out dosages (bear in mind that the context here is a hospital ward where a nurse making the calculations and programming the pump may well be interrupted, and where there may also be a lot of background noise and activity). Thimbleby identified several issues with the design of the pump itself (which will have had to pass a series of very strict \u2018due diligence\u2019 design exercises to be allowed into production). Among these issues was the ease with which a button that changed doses by\u00a0single\u00a0units could be confused with one that changed the dose by\u00a0tens of units. Thimbleby also noted that computer-based medical devices such as this infusion pump are frequently rebooted when problems arise, at which point they lose previously stored data. It was at this point that many errors tended to happen.<\/p>\n<p>Thimbleby developed an <span class=\"touchit_term\"  ix_rawcontent=\"iPhone\">iPhone<\/span> app designed to overcome the flaws in the processes involved in programming the machine, but there is no reason the device itself couldn\u2019t be designed to reduce the potential for error. Could storing information via a device\u2019s physicality offer potential design solutions in cases such as this?<\/p>\n<p>In Chapter\u00a0<span class=\"touchit_xref\"   xref_label=\"ch:physicality-of-things\" xref_postid=\"213\" touchit_value=\"7\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:physicality-of-things --><a name=\"xu:21\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/objects-things\/physicality-of-things\/#ch:physicality-of-things\">7<\/a><!-- xref_data: Array\n(\n    [name] => ch:physicality-of-things\n    [postid] => 213\n    [slug] => ch:physicality-of-things\n    [local] => ch:physicality-of-things\n    [global] => ch:physicality-of-things\n    [value] => 7\n    [type] => chapter\n    [content] => \n)\n   --><\/span> we noted that computers appear to break some of the laws of the natural (physical) world where many of our gut level understandings and \u2018instincts\u2019 are rooted. As a quick reminder, those <span class=\"touchit_term\"  ix_as=\"rules of physical things\" ix_rawcontent=\"rules of thumb\">rules of thumb<\/span> were:<\/p>\n<p>1.\u00a0\u00a0\u00a0\u00a0 <span class=\"touchit_term\"  ix_as=\"proportional effort\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"directness of effort\">directness of effort<\/span>\u00a0\u2013 Small effort produces small effects, large effort produces large effects.<br \/>\n2.\u00a0\u00a0\u00a0\u00a0 <span class=\"touchit_term\"  ix_rawcontent=\"locality of effect\">locality of effect<\/span>\u00a0\u2013 The effects of actions occur where and when you physically initiate the action.<br \/>\n3.\u00a0\u00a0\u00a0\u00a0 <span class=\"touchit_term\"  ix_rawcontent=\"visibility of state\">visibility of state<\/span>\u00a0\u2013 Physical objects have complex shape and texture, but this is largely static.<\/p>\n<p>Just like the mobile phone in Chapter <span class=\"touchit_xref\"   xref_label=\"ch:physicality-of-things\" xref_postid=\"213\" touchit_value=\"7\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:physicality-of-things --><a name=\"xu:22\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/objects-things\/physicality-of-things\/#ch:physicality-of-things\">7<\/a><!-- xref_data: Array\n(\n    [name] => ch:physicality-of-things\n    [postid] => 213\n    [slug] => ch:physicality-of-things\n    [local] => ch:physicality-of-things\n    [global] => ch:physicality-of-things\n    [value] => 7\n    [type] => chapter\n    [content] => \n)\n   --><\/span>, our infusion pump breaks all of these physical world rules:<\/p>\n<p>1.\u00a0\u00a0\u00a0\u00a0 no directness of effort\u00a0\u2013 One wrongly inputted digit (say a decimal point) and an effect can be multiplied 10 or 100 times.<br \/>\n2.\u00a0\u00a0\u00a0\u00a0 no locality of effect\u00a0\u2013 The whole purpose of an infusion pump is to supply a dosage over a period of time &#8212; temporal non\u2010locality.<br \/>\n3.\u00a0\u00a0\u00a0\u00a0 no visibility of state\u00a0\u2013 The infusion pump is full of hidden state. It has a small screen driven by buttons which must be used to interrogate the computer one function at a time (e.g. dosage and rate of delivery).<\/p>\n<p>Could physicality be used to develop a more \u2018natural\u2019 interface? Consider the following suggestions for changing the traditional infusion pump arrangement:<\/p>\n<p>1.\u00a0\u00a0\u00a0\u00a0 Use dials and sliders instead of buttons: these mechanical <span class=\"touchit_term\"  ix_rawcontent=\"controls\">controls<\/span> allow us to see a setting and judge if it is high or low (visibility of state). While there is no directness of effort as such with these controls, there is at least a correlation between effort and effect (e.g. to create 10 times the dose I have to turn the dial ten times as far). The fact that the controls are physical would mean that the pump can re-programme itself to its last setting in the event of a power cut or a reboot. This would remove a major and common risk area identified by Thimbleby.<br \/>\n2.\u00a0\u00a0\u00a0\u00a0 Place the controls in the order\u00a0that the nurse generally needs to input them (e.g. from left to right or from top to bottom). This should reduce user error by providing logical sequencing. Remember that this arrangement might vary according to culture (e.g. in Arabic countries it would seem natural to <span class=\"touchit_term\"  ix_as=\"reading order\" ix_rawcontent=\"read\">read<\/span> from right to left).<br \/>\n3.\u00a0\u00a0\u00a0\u00a0 Assign one control device per task: this creates a direct, visible and physical link between the control input and what it is controlling, removing hidden state.<br \/>\n4.\u00a0\u00a0\u00a0\u00a0 The size or location of the controls can be used to denote their relative importance.\u00a0This helps the user to concentrate their efforts where they are most critical.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-1863\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/infusion-pump.png\" alt=\"\" width=\"453\" height=\"241\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/infusion-pump.png 940w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/infusion-pump-400x213.png 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/infusion-pump-300x160.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2018\/12\/infusion-pump-768x409.png 768w\" sizes=\"auto, (max-width: 453px) 100vw, 453px\" \/><\/p>\n<p><\/div>\n<p>Another common example of <span class=\"touchit_term\"  ix_rawcontent=\"hidden state\">hidden state<\/span> is <span class=\"touchit_term\"  ix_rawcontent=\"bounce-back buttons\">bounce-back buttons<\/span>, such as often found for the on\/off switches of computers. Consider the TV and dishwasher button in Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.dishwasher\" xref_postid=\"583\" touchit_value=\"9.15\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:dishwasher --><a name=\"xu:23\"><\/a><a href=\"#fg:dishwasher\">9.15<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.dishwasher\n    [postid] => 583\n    [slug] => fg:dishwasher\n    [local] => fg:dishwasher\n    [global] => fg:hybrid-devices.dishwasher\n    [value] => 9.15\n    [type] => figure\n    [content] => \n)\n   --><\/span>. Superficially they look similar, but when you interact with them their behaviours differ markedly. With the dishwasher button you press it and it stays in (in fact, this is the &#8216;on&#8217; position when the power is on &#8212; see the little red light, the power was actually on when the photo was taken!). In other words it has exposed state. In contrast you press the TV button in and as soon as you let go the button bounces right back out again. Of course the TV turns on or off as you do this, but the button on its own tells you nothing; this is hidden state.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.15\"><\/a><!-- link_id --><a name=\"fg:dishwasher\" class=\"xref_label\"  xref_local=\"fg:dishwasher\" xref_label=\"fg:hybrid-devices.dishwasher\"><\/a><\/p>\n<p><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-off.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-603\" title=\"dishwasher-off\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-off-217x300.jpg\" alt=\"\" width=\"109\" height=\"150\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-off-217x300.jpg 217w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-off.jpg 487w\" sizes=\"auto, (max-width: 109px) 100vw, 109px\" \/><\/a> <a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-on.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-604\" title=\"dishwasher-on\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-on-211x300.jpg\" alt=\"\" width=\"106\" height=\"150\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-on-211x300.jpg 211w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/dishwasher-on.jpg 717w\" sizes=\"auto, (max-width: 106px) 100vw, 106px\" \/><\/a> <a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/TV-on-off.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-605\" title=\"TV-on-off\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/TV-on-off-300x231.jpg\" alt=\"\" width=\"195\" height=\"150\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/TV-on-off-300x231.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/TV-on-off-389x300.jpg 389w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2010\/08\/TV-on-off.jpg 603w\" sizes=\"auto, (max-width: 195px) 100vw, 195px\" \/><\/a><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.15<\/span> <\/span>   (i) dishwasher with exposed state, out=off, in=on (ii) TV hidden state push-back button<\/p><\/p>\n<p><\/div>\n<p>If this seems a minor thing, maybe you have had the experience when the TV screen is blank, but you don&#8217;t know why. Is it because it is off, because it is in standby, because you have just turned it on and it is warming up, or because the DVD player connected to it is off? In principle it is often possible to see, because small red LEDs are added &#8212; in this case you can see the LED next to the button labelled &#8216;STAND BY&#8217;. However, in reality, do you really look at all those little red lights or do you simply press a few buttons at random on the different boxes until something happens?<\/p>\n<p>Maybe you have even lost data from your computer because you accidentally turned it off when it was in fact just sleeping? On many computers, both desktop and laptops, there is a single on\/off button (Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.computer-on-off\" xref_postid=\"583\" touchit_value=\"9.16\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:computer-on-off --><a name=\"xu:24\"><\/a><a href=\"#fg:computer-on-off\">9.16<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.computer-on-off\n    [postid] => 583\n    [slug] => fg:computer-on-off\n    [local] => fg:computer-on-off\n    [global] => fg:hybrid-devices.computer-on-off\n    [value] => 9.16\n    [type] => figure\n    [content] => \n)\n   --><\/span>). To turn it on you press it, to turn it off you press it, but it simply sits there looking the same. You open the laptop or look at the blank monitor (which itself may be because the computer is asleep or because the monitor is). Thinking the machine is off you press the power button to\u00a0hear, too late, the little whirr of the disk starting to spin as it wakes from sleep, followed rapidly by the dull thud as it turns off and starts to reboot. What was onscreen before it went to sleep? Did you save the draft of that chapter on annoying <span class=\"touchit_term\"  ix_rawcontent=\"hidden state\">hidden state<\/span> buttons?<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.16\"><\/a><!-- link_id --><a name=\"fg:computer-on-off\" class=\"xref_label\"  xref_local=\"fg:computer-on-off\" xref_label=\"fg:hybrid-devices.computer-on-off\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2610\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN-1024x967.png\" alt=\"\" width=\"159\" height=\"150\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN-1024x967.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN-300x283.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN-318x300.png 318w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN-768x726.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16a-computer-bounce-back-with-STN.png 1086w\" sizes=\"auto, (max-width: 159px) 100vw, 159px\" \/>\u00a0 \u00a0\u00a0 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2612\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-300x222.png\" alt=\"\" width=\"203\" height=\"150\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-300x222.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-1024x757.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-400x296.png 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-768x568.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-1536x1136.png 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED-2048x1514.png 2048w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.16b-computer-switch-with-LED.png 2479w\" sizes=\"auto, (max-width: 203px) 100vw, 203px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.16<\/span> <\/span>   Computer on\/off button: hidden state with power light\u00a0<\/p><\/p>\n<p><\/div>\n<p>As you contemplate several hours&#8217; lost work, you can take comfort in the fact that the <span class=\"touchit_term\"  ix_as=\"designers\" ix_rawcontent=\"designer\">designer<\/span> has often foreseen the potential problem. In the photo above, you can see that this computer button, like the TV button earlier, has a small light so that you can see that the power is on, in this case a tiny green (unlabelled) LED. If you had been observant, if you had realised this is an indicator meaning &#8216;turned on&#8217; rather than &#8216;connected to the power&#8217;, if you hadn&#8217;t got confused in the moment, then you could have worked out it was on and not lost all that work &#8212; small comfort indeed.<\/p>\n<p>Now there are good reasons for using a <span class=\"touchit_term\"  ix_as=\"bounce-back buttons\" ix_rawcontent=\"bounce-back switch\">bounce-back switch<\/span>, which we will discuss in detail later, one of which is when the computer can also turn itself off through the software. However, these bounce-back buttons are often found on computers when this is not the case (indeed the one photographed in Fig. <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.computer-on-off\" xref_postid=\"583\" touchit_value=\"9.16\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:computer-on-off --><a name=\"xu:25\"><\/a><a href=\"#fg:computer-on-off\">9.16<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.computer-on-off\n    [postid] => 583\n    [slug] => fg:computer-on-off\n    [local] => fg:computer-on-off\n    [global] => fg:hybrid-devices.computer-on-off\n    [value] => 9.16\n    [type] => figure\n    [content] => \n)\n   --><\/span> does not have a software &#8216;off&#8217;) and an old fashioned up\/down power switch might be more appropriate, or a switch which, like the dishwasher button, stays depressed when in the &#8216;on&#8217; position. Even where the software can switch the power off, why not simply have an &#8216;on&#8217; button and then an additional &#8217;emergency off&#8217; button for the cases when the software is not shutting down as it should? This could be small and recessed so it is not accidentally pressed, rather like a wristwatch button for setting the time.<\/p>\n<p>Sometimes the reason for not doing this is lack of insight, and sometimes plain economics &#8212; the cents or pence it costs to add an extra button are worth more to the manufacturer than your lost work! However, often it is <span class=\"touchit_term\"  ix_rawcontent=\"aesthetics\">aesthetics<\/span>: your lost work is weighed against the flawless smooth casing with its single iconic button. And if you think the designer made a poor choice, what do you think about when you buy a new computer? It is a brave designer who is willing to focus on the long-term benefit of users, which improves their life, rather than the immediate appearance that makes them buy the product. Are you brave enough? Or perhaps it is possible to achieve both <span class=\"touchit_term\"  ix_as=\"aesthetics\" ix_within=\"usability\" ix_rawcontent=\"aesthetics and safety\">aesthetics and safety<\/span>. Certainly the additional small &#8217;emergency off&#8217; button could be located slightly out of sight (although not so hidden the user can&#8217;t find it!), or made into an essential part of the aesthetic of the device.<\/p>\n<h3 class=\"touchit_heading\"><a name=\"sc:9.7.3\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_subsection\"><span class=\"label_counter\">9.7.3<\/span> <\/span> Tangible transitions and tension states<\/h3>\n<p>When you twist the CD knob shown in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.CD-hidden-state\" xref_postid=\"583\" touchit_value=\"9.14\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:CD-hidden-state --><a name=\"xu:26\"><\/a><a href=\"#fg:CD-hidden-state\">9.14<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.CD-hidden-state\n    [postid] => 583\n    [slug] => fg:CD-hidden-state\n    [local] => fg:CD-hidden-state\n    [global] => fg:hybrid-devices.CD-hidden-state\n    [value] => 9.14\n    [type] => figure\n    [content] => \n)\n   --><\/span> it is heavy to turn, giving it a feel of quality, but there is no sense of how far you have turned it. However, not all knobs and dials are like this.<\/p>\n<p>Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.photo-viewer\" xref_postid=\"583\" touchit_value=\"9.17\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:photo-viewer --><a name=\"xu:27\"><\/a><a href=\"#fg:photo-viewer\">9.17<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.photo-viewer\n    [postid] => 583\n    [slug] => fg:photo-viewer\n    [local] => fg:photo-viewer\n    [global] => fg:hybrid-devices.photo-viewer\n    [value] => 9.17\n    [type] => figure\n    [content] => \n)\n   --><\/span> shows three experimental <span class=\"touchit_term\"  ix_rawcontent=\"prototypes\">prototypes<\/span> that were produced for a photo viewer. All have an area where a small screen would go and all have a rotary control. The one on the left has a very obvious retro dial, the middle a more discreet dial, and the one on the right an iPod-like touch surface. In all the prototypes, rotating the dial enables the user to scroll between different menu options, although never more than seven at any level.<\/p>\n<p>While they all use <span class=\"touchit_term\"  ix_rawcontent=\"rotary controls\">rotary controls<\/span>, they feel very different in use. On the right the touch surface offers no <span class=\"touchit_term\"  ix_rawcontent=\"resistance\">resistance<\/span> at all, your finger goes round, but without the display you cannot tell there is anything happening. In fact, it is perhaps only because one is used to devices like this that one would even try to stroke it &#8212; the <span class=\"touchit_term\"  ix_as=\"cultural\" ix_within=\"affordance\" ix_rawcontent=\"cultural affordance\">cultural affordance<\/span> of the iPod generation! In contrast the more clunky looking prototype on the left has a far richer repertoire of tangible feedback. It already has exposed state, since you can tell what direction it is pointing, and it also has end stops so that you can feel when it has got to one extreme or other of the menu. In addition, the mechanics of the mechanism mean that there is slight resistance as you move between its seven positions: it has <em><span class=\"touchit_term\"  ix_rawcontent=\"tangible transitions\">tangible transitions<\/span><\/em> between states.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.17\"><\/a><!-- link_id --><a name=\"fg:photo-viewer\" class=\"xref_label\"  xref_local=\"fg:photo-viewer\" xref_label=\"fg:hybrid-devices.photo-viewer\"><\/a>\u00a0<a href=\"http:\/\/www.hcibook.com\/alan\/papers\/FAC-physical-2009\/images\/fig12c.png\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2479\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device1-1004x1024.png\" alt=\"\" width=\"118\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device1-1004x1024.png 1004w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device1-294x300.png 294w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device1-768x783.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device1.png 1683w\" sizes=\"auto, (max-width: 118px) 100vw, 118px\" \/> <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2480\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2-1024x936.png\" alt=\"\" width=\"131\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2-1024x936.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2-328x300.png 328w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2-300x274.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2-768x702.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device2.png 1713w\" sizes=\"auto, (max-width: 131px) 100vw, 131px\" \/> <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2481\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3-1024x859.png\" alt=\"\" width=\"143\" height=\"120\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3-1024x859.png 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3-358x300.png 358w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3-300x252.png 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3-768x644.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/07\/device3.png 2103w\" sizes=\"auto, (max-width: 143px) 100vw, 143px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.17<\/span> <\/span>   Three prototype media players <\/p><\/p>\n<p><\/div>\n<p>Tangible transitions are particularly important when considering <span class=\"touchit_term\"  ix_rawcontent=\"accessibility\">accessibility<\/span> for people with impaired vision, or for occasions when you cannot look at the screen, such as when driving. The left-hand device has both end-stops and tangible transitions; this means that once someone has learned some of the menu layouts, the device can be used without looking at the screen at all. Even when you can see, the <span class=\"touchit_term\"  ix_rawcontent=\"tangible transitions\">tangible transitions<\/span> give additional feedback and the resistance between the positions makes it difficult to accidentally select the wrong option.<\/p>\n<p>The device in the middle has a form of tangible transition: there is a very slight sensation as one moves between positions. However it has no end stops and there is no resistance before it moves to a new position. The lack of resistance makes errors more likely and the lack of end stops means it is harder to orient oneself except by looking at the screen, but at least it is possible to tell how many steps one has taken.<\/p>\n<p>It is not only knobs that can have tangible transitions. The light and power switches we discussed earlier not only have a visible state, but there is definite resistance as you push the switch down: it gives a little, and then there is sudden movement as it flicks down. If you release the pressure of your finger before it flicks down, it simply bounces back to where it started. In a sense the device has at least four states; as well as the obvious up\/down there are also part-up and part-down states as one pushes the switch, although only the up\/down states are stable when you release your finger pressure.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.18\"><\/a><!-- link_id --><a name=\"fg:light-switch-part-way\" class=\"xref_label\"  xref_local=\"fg:light-switch-part-way\" xref_label=\"fg:hybrid-devices.light-switch-part-way\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2614\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-298x300.png\" alt=\"\" width=\"326\" height=\"328\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-298x300.png 298w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-1016x1024.png 1016w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-768x774.png 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-1524x1536.png 1524w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN-230x230.png 230w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.18-light-switch-partway-STN.png 1712w\" sizes=\"auto, (max-width: 326px) 100vw, 326px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.18<\/span> <\/span>   Light switch with partway states\u00a0<\/p><\/p>\n<p><\/div>\n<p><span class=\"touchit_term\"  ix_rawcontent=\"Bounce-back buttons\">Bounce-back buttons<\/span>, such as the computer power button in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.light-switch-part-way\" xref_postid=\"583\" touchit_value=\"9.18\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:light-switch-part-way --><a name=\"xu:28\"><\/a><a href=\"#fg:light-switch-part-way\">9.18<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.light-switch-part-way\n    [postid] => 583\n    [slug] => fg:light-switch-part-way\n    [local] => fg:light-switch-part-way\n    [global] => fg:hybrid-devices.light-switch-part-way\n    [value] => 9.18\n    [type] => figure\n    [content] => \n)\n   --><\/span>, can similarly be seen as actually having two states, out and in. Only the out state is stable, but while you press with your finger it remains in a pressed-in state. This is a <span class=\"touchit_term\"  ix_rawcontent=\"tension state\">tension state<\/span>, one where you have to maintain a continuous effort in order to maintain the state. In the case of the computer power, the tension is never maintained, you just press and release. However, tension states are often used as part of interaction, for example, dragging with a <span class=\"touchit_term\"  ix_as=\"mouse\" ix_within=\"input devices\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"mouse\">mouse<\/span>.<\/p>\n<p>Keeping your hand or other muscles in tension can cause fatigue if continued for a long period, and it also affects <span class=\"touchit_term\"  ix_rawcontent=\"accuracy\">accuracy<\/span> and timing. Indeed, <span class=\"touchit_term\"  ix_rawcontent=\"Fitts&amp;#8217; Law\">Fitts&#8217; Law<\/span> measurements show measurable differences in performance between ordinary mouse movement and dragging <span class=\"touchit_bibcite\"  bibcite=\"MS91\"><a name=\"bibcite:13\"><\/a>[<a href=\"#ref-MS91\">MS91<\/a>]<\/span>. However, the advantage of a tension state is that you are very aware that you are in the middle of doing something. When typing it is possible to break partway through a sentence and leave it incomplete, but it is impossible to go away partway through dragging the mouse, you have to release the mouse button and end the drag. This can be particularly important in safety-critical situations, such as the use of the &#8216;dead man&#8217;s handle&#8217; in trains.<\/p>\n<h3 class=\"touchit_heading\"><a name=\"sc:9.7.4\"><\/a><!-- link_id --><span class=\"touchit_label touchit_label_subsection\"><span class=\"label_counter\">9.7.4<\/span> <\/span> Natural inverse<\/h3>\n<p>It&#8217;s the summer holidays, and you are <span class=\"touchit_term\"  ix_rawcontent=\"driving\">driving<\/span> down a small country lane where the sides of the lanes are high earth banks and the lanes themselves winding, narrow and with no room for cars to pass one another. The car is packed full with suitcases and tents, spades and swimming costumes, so you cannot even see out of the back window. Suddenly, round the bend ahead another car appears, coming towards you. You both stop; one of you must go back. There is a relatively straight part of the lane behind you with nowhere to pass, but you do recall passing a gateway just before the last bend, so you shift the gear into <span class=\"touchit_term\"  ix_as=\"reversing\" ix_rawcontent=\"reverse\">reverse<\/span> and begin to edge backwards, with only your wing mirrors to see where you are going.<\/p>\n<p>At first you drive very slowly, everything is back-to-front and unless you think very hard you turn the wheel in the wrong direction. However, after a bit you find yourself confidently driving backwards at a fair speed down the straight lane behind. Every so often you suddenly &#8216;lose&#8217; it, end up getting too close to one of the banks and have to stop, and, as if from the beginning, work out which way to turn the wheel, but each time you quickly get back into the flow.<\/p>\n<p>Even if you are a very experienced driver and find reversing is no longer difficult, maybe you have tried to reverse a trailer or caravan and had a similar experience.<\/p>\n<p>It is reasonable that this is difficult if you are not used to reversing a car for long distances, but what is remarkable are the periods in between, when it becomes easy. It is not that you have learned the right thing to do, as you find that when you get out of the flow you have no better idea which way to turn the wheel than when you started.<\/p>\n<p>The reason for these periods when reversing becomes easy is that the steering wheel exploits very basic human responses &#8212; the <span class=\"touchit_term\"  ix_rawcontent=\"natural inverse\">natural inverse<\/span>. When you draw a line on paper and decide it is in the wrong place, you need to find the eraser and rub it out. It is not difficult, it is something you&#8217;ll do without thinking, but it is something you&#8217;ve had to learn. If, however, you are trying to put the pencil inside a desk-tidy and you move your hand a little too far to the right, you&#8217;ll automatically move it slightly to the left. In the world there are natural opposites, up\/down, closer\/further, left\/right, and our body mirrors these with muscles and limbs hard-wired to exploit them.<\/p>\n<p>Work by Rodolfo Llin\u00e1s showed that some of this is very low-level indeed, with sets of mutually inhibitory <span class=\"touchit_term\"  ix_rawcontent=\"neurons\">neurons<\/span> that allow pairs of opposing muscles to be connected <span class=\"touchit_bibcite\"  bibcite=\"Li02,p.45\"><a name=\"bibcite:14\"><\/a>[<a href=\"#ref-Li02\">Li02<\/a>, p.45]<\/span>. Although higher-level brain functions determine which pairs operate, some of the actual control even happens in the spinal column, as is evident in the headless chicken that still runs around the farmyard. These paired muscle groups allow both rhythmic movement such as walking, and the isometric balancing of one muscle group against another that is needed to maintain a static position, such as holding a mug in mid-air.<\/p>\n<p>When you first start to drive in <span class=\"touchit_term\"  ix_as=\"reversing\" ix_rawcontent=\"reverse\">reverse<\/span>, you have to think to yourself, &#8216;if I want the car to move to the left which direction do I need to turn the wheel?&#8217;. However, when you have started to move the wheel and discover it is going in the wrong direction, or you are about to overshoot and go too far, you do not have to think again, you instinctively move it in the opposite direction (see also Box\u00a0<span class=\"touchit_xref\"   xref_label=\"bx:hybrid-devices.driving-backwards\" xref_postid=\"583\" touchit_value=\"9.4\" touchit_type=\"box\"><!-- xref_xshortcode_handler: name = bx:driving-backwards --><a name=\"xu:29\"><\/a><a href=\"#bx:driving-backwards\">9.4<\/a><!-- xref_data: Array\n(\n    [name] => bx:hybrid-devices.driving-backwards\n    [postid] => 583\n    [slug] => bx:driving-backwards\n    [local] => bx:driving-backwards\n    [global] => bx:hybrid-devices.driving-backwards\n    [value] => 9.4\n    [type] => box\n    [content] => \n)\n   --><\/span>). The natural inverse takes over and you do the opposite of what you were doing before.<\/p>\n<p><span class=\"touchit_term\"  ix_as=\"device unplugged\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"Unplugged devices\">Unplugged devices<\/span> often have buttons, knobs and other controls that have <span class=\"touchit_term\"  ix_rawcontent=\"natural inverse\">natural inverse<\/span> actions: twist left\/twist right, push\/pull. The minidisk controller in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.minidisk\" xref_postid=\"583\" touchit_value=\"9.19\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:minidisk --><a name=\"xu:30\"><\/a><a href=\"#fg:minidisk\">9.19<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.minidisk\n    [postid] => 583\n    [slug] => fg:minidisk\n    [local] => fg:minidisk\n    [global] => fg:hybrid-devices.minidisk\n    [value] => 9.19\n    [type] => figure\n    [content] => \n)\n   --><\/span> was intended to be clipped onto clothing while the user was walking or running. Since it will be used eyes-free it is particularly important that the physical format helps make it easy to use. The device has two different kinds of control and both of them exhibit natural inverse.<\/p>\n<p>On the end of the device is a <span class=\"touchit_term\"  ix_as=\"rotary controls\" ix_rawcontent=\"knob\">knob<\/span>. Twisting the knob in one direction moves on to the next track, twisting it in the other direction moves it back a track &#8212; natural inverse. The knob can also be pulled out and this changes its function: twisting it one way increases the volume, twisting it in the opposite direction turns the volume down. Note also that this is a <span class=\"touchit_term\"  ix_rawcontent=\"tension state\">tension state<\/span>. It is obvious whether you are changing track or changing volume, not just from the immediate aural feedback, but also because the knob wants to spring back into place, and to adjust the volume requires continuous tension.<\/p>\n<p>Along the side of the device are a number of spring-back <span class=\"touchit_term\"  ix_as=\"slider\" ix_rawcontent=\"sliders\">sliders<\/span>; they can be pushed forward or backward. Each slider controls a different function, but all of them use the same principle. There is an ordered list of options for each setting; pushing the slider moves between the relevant option settings one way through the list, pulling it back moves it the other way. Note that the <span class=\"touchit_term\"  ix_rawcontent=\"natural inverse\">natural inverse<\/span> reduces the impact of mistakes. If you choose the wrong option and change it, you instinctively move the <span class=\"touchit_term\"  ix_rawcontent=\"slider\">slider<\/span> in the opposite direction and restore the setting.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.19\"><\/a><!-- link_id --><a name=\"fg:minidisk\" class=\"xref_label\"  xref_local=\"fg:minidisk\" xref_label=\"fg:hybrid-devices.minidisk\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2616\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-300x153.jpg\" alt=\"\" width=\"467\" height=\"238\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-300x153.jpg 300w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-1024x523.jpg 1024w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-400x204.jpg 400w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-768x392.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-1536x785.jpg 1536w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-2048x1046.jpg 2048w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2019\/12\/Fig9.19-minidisk-controller-scaled.jpg 2560w\" sizes=\"auto, (max-width: 467px) 100vw, 467px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.19<\/span> <\/span>   Minidisk controller\u00a0<\/p><\/p>\n<p><\/div>\n<p>Using the <span class=\"touchit_term\"  ix_rawcontent=\"natural inverse\">natural inverse<\/span> can obviate the need for explicit &#8216;<span class=\"touchit_term\"  ix_rawcontent=\"undo\">undo<\/span>&#8216; operations, and can make a control usable even when you don&#8217;t know what it does. The phone in Figure <span class=\"touchit_xref\"   xref_label=\"fg:hybrid-devices.old-phone\" xref_postid=\"583\" touchit_value=\"9.20\" touchit_type=\"figure\"><!-- xref_xshortcode_handler: name = fg:old-phone --><a name=\"xu:31\"><\/a><a href=\"#fg:old-phone\">9.20<\/a><!-- xref_data: Array\n(\n    [name] => fg:hybrid-devices.old-phone\n    [postid] => 583\n    [slug] => fg:old-phone\n    [local] => fg:old-phone\n    [global] => fg:hybrid-devices.old-phone\n    [value] => 9.20\n    [type] => figure\n    [content] => \n)\n   --><\/span> belonged to Alan some years ago. On the top left-hand side of the phone was a small slider. This slider did different things in different modes: when in a call it adjusted volume, when in the address book it scrolled through the names. Alan never knew exactly what it did, yet he used it extensively. This was because it always respected the natural inverse property and so he could use it without fear; if it didn&#8217;t do what he expected he just did the opposite movement and carried on.<\/p>\n<div class=\"touchit_figure\"><a name=\"fg:9.20\"><\/a><!-- link_id --><a name=\"fg:old-phone\" class=\"xref_label\"  xref_local=\"fg:old-phone\" xref_label=\"fg:hybrid-devices.old-phone\"><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2668\" title=\"old-phone-natural-inverse\" src=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-773x1024.jpg\" alt=\"\" width=\"200\" height=\"265\" srcset=\"https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-773x1024.jpg 773w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-226x300.jpg 226w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-768x1018.jpg 768w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-1159x1536.jpg 1159w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider-1546x2048.jpg 1546w, https:\/\/physicality.org\/internal\/touchit-draft\/wp-content\/uploads\/2020\/01\/Fig-9-20-Phone-with-slider.jpg 1606w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" \/><\/p>\n<p><p class=\"touchit_caption\"><span class=\"touchit_label touchit_label_figure\"><span class=\"label_prefix\">Fig.<\/span> <span class=\"label_counter\">9.20<\/span> <\/span>   Phone with slider at top left\u00a0<\/p><\/p>\n<p><\/div>\n<div class=\"touchit_box\"><a name=\"bx:9.4\"><\/a><!-- link_id --><a name=\"bx:driving-backwards\" class=\"xref_label\"  xref_local=\"bx:driving-backwards\" xref_label=\"bx:hybrid-devices.driving-backwards\"><\/a><\/p>\n<h3 class=\"touchit_heading\"><!--  set caption for bx:9.4 =   --> <span class=\"touchit_label touchit_label_box\"><span class=\"label_prefix\">Box<\/span> <span class=\"label_counter\">9.4<\/span> <\/span>  Why driving backwards is hard: expectation, magnification and control theory<\/h3>\n<p>Of course when you are <span class=\"touchit_term\"  ix_rawcontent=\"driving\">driving<\/span> using mirrors things are not really back-to-front. If, as you look in the mirror, you see the left-hand side a little too close to the bank, you turn the wheel to the right &#8212; this is exactly the same as when you are driving forwards. So if you could somehow &#8216;switch off&#8217; the knowledge you are <span class=\"touchit_term\"  ix_as=\"reversing\" ix_rawcontent=\"driving backwards\">driving backwards<\/span> and pretend that the mirror is really just a very small windscreen, things would be easier &#8212; however, we do not have the power to fool our own minds so easily!<\/p>\n<p>The other difficult thing is that the wing mirrors are designed so that you can see the whole road behind in a tiny mirror, whereas the same portion of the road ahead fills the entire windscreen. Using the mirrors is a bit like driving forward looking through the wrong end of a telescope ((N.B. not to be attempted on the open road if you value your life!)).<\/p>\n<p>Finally the mechanics of the steering work differently in reverse. Whether driving forward or backward, it is always the front wheels that turn. This makes it (in principle) easier to reverse into a narrow space, but makes the car much harder to drive backwards in a straight line. The front wheels of a car also have a small &#8216;toe in&#8217;: they point slightly together. This has the effect of making the car tend to stay in a straight line going forwards, but the opposite effect when driving backwards.<\/p>\n<p>Chapter <span class=\"touchit_xref\"   xref_label=\"ch:body-and-mind\" xref_postid=\"100\" touchit_value=\"5\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:body-and-mind --><a name=\"xu:32\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/human-body-mind\/body-and-mind\/#ch:body-and-mind\">5<\/a><!-- xref_data: Array\n(\n    [name] => ch:body-and-mind\n    [postid] => 100\n    [slug] => ch:body-and-mind\n    [local] => ch:body-and-mind\n    [global] => ch:body-and-mind\n    [value] => 5\n    [type] => chapter\n    [content] => \n)\n   --><\/span> discussed <span class=\"touchit_term\"  ix_as=\"open loop control\" ix_rawcontent=\"open\">open<\/span> and <span class=\"touchit_term\"  ix_as=\"closed loop control\" ix_rawcontent=\"closed loop control\">closed loop control<\/span>; these are part of a wider area of <span class=\"touchit_term\"  ix_rawcontent=\"mathematics\">mathematics<\/span> called &#8216;<span class=\"touchit_term\"  ix_rawcontent=\"Control Theory\">Control Theory<\/span>&#8216;. One general principle in control theory is that there is always a trade-off between control and stability. For example a light beach ball is easy to control. You can roll it exactly where you want it, but it is unstable: the slightest breeze and it rolls away. In contrast a large cubic block of concrete is very stable, but boy is it hard to move where you want it. The forward and reverse movements of the car demonstrate different points in this trade-off: going forwards you have a high degree of stability, the car keeps on going in a relatively straight line unless you work hard to change direction, whereas in reverse the opposite is true, it is easy to control in the sense that you can manoeuvre into very tight spaces, but it is highly unstable.<\/p>\n<p>Because digital and mechanical systems do not exhibit <span class=\"touchit_term\"  ix_as=\"directness of effort\" ix_rawcontent=\"\"><\/span><span class=\"touchit_term\"  ix_rawcontent=\"proportional effort\">proportional effort<\/span> (Chapter <span class=\"touchit_xref\"   xref_label=\"ch:physicality-of-things\" xref_postid=\"213\" touchit_value=\"7\" touchit_type=\"chapter\"><!-- xref_xshortcode_handler: name = ch:physicality-of-things --><a name=\"xu:33\"><\/a><a href=\"https:\/\/physicality.org\/internal\/touchit-draft\/touchit-draft\/objects-things\/physicality-of-things\/#ch:physicality-of-things\">7<\/a><!-- xref_data: Array\n(\n    [name] => ch:physicality-of-things\n    [postid] => 213\n    [slug] => ch:physicality-of-things\n    [local] => ch:physicality-of-things\n    [global] => ch:physicality-of-things\n    [value] => 7\n    [type] => chapter\n    [content] => \n)\n   --><\/span>) it is possible to engineer situations that are at extreme points in this trade-off space. It is also occasionally possible to &#8216;break&#8217; the trade-off, to have your cake and eat it. Modern fighter jets are deliberately designed to be unstable while flying, rather like the car driven in reverse. This allows very rapid movements when required, but makes them unflyable by a human <span class=\"touchit_term\"  ix_as=\"pilots\" ix_rawcontent=\"pilot\">pilot<\/span> alone. However, the pilot&#8217;s control is augmented by very fast, automated systems, which constantly trim the aerofoils to keep the plane flying where it is intended to go.<\/p>\n<p><\/div>\n<p>&nbsp;<\/p>\n<h2 class=\"touchit_bibliography_heading\">References<\/h2>\n<\/p>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">1. [<a name=\"ref-BS05\"><\/a>BS05]<\/span> S. Benford, H. Schn\u00e4delbach, B. Koleva, R. Anastasi, S. Greenhalgh, T. Rodden, J. Green, A. Ghali, T. Pridmore, B. Gaver, A. Boucher, B. Walker, S. Pennington, A. Schmidt, H. Gellersen &amp; A. Steed. Expected, sensed, and desired: A framework for designing sensing-based interaction (, ACM Transactions on Computer-Human Interaction, TOCHI, Volume 12 Issue 1, March 2005) [<a href=\"#bibcite:5\">9.5<\/a>;<a href=\"#bibcite:6\">9.5<\/a>;<a href=\"#bibcite:7\">9.5<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">2. [<a name=\"ref-Bu90\"><\/a>Bu90]<\/span> <span style=\"font-family: Times New Roman,Times;\">Buxton, W. (1990). A Three-State Model of Graphical Input. In D. Diaper et al. (Eds), <em>Human-Computer Interaction &#8211; INTERACT &#8217;90<\/em>. Amsterdam: Elsevier Science Publishers B.V. (North-Holland), 449-456. <\/span>http:\/\/www.billbuxton.com\/3state.html [<a href=\"#bibcite:4\">9.2<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">3. [<a name=\"ref-DG09\"><\/a>DG09]<\/span> A. Dix, M. Ghazali, S. Gill, J. Hare and D. Ramduny-Ellis (2009). Physigrams: Modelling Devices for Natural Interaction. Formal Aspects of Computing , Springer, 21(6):613-641, doi:10.1007\/s00165-008-0099-y http:\/\/alandix.com\/academic\/papers\/FAC-physical-2009\/ [<a href=\"#bibcite:10\">9.7<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">4. [<a name=\"ref-DG17\"><\/a>DG17]<\/span> Alan Dix and Masitah Ghazali (2017). Physigrams: Modelling Physical Device Characteristics Interaction. Chapter 9 in <em>The Handbook of Formal Methods in Human-Computer Interaction<\/em>, Springer, pp.247\u2013271. DOI: 10.1007\/978-3-319-51838-1_9 [<a href=\"#bibcite:11\">9.7<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">5. [<a name=\"ref-Li02\"><\/a>Li02]<\/span> Rodolfo Llin\u00e1s (2002). I of the Vortex: From Neurons to Self. MIT Press. [<a href=\"#bibcite:14\">9.7.4<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">6. [<a name=\"ref-MS91\"><\/a>MS91]<\/span> MacKenzie, I. S., Sellen, A., &amp; Buxton, W. (1991). A comparison of input devices in elemental pointing and dragging tasks.\u00a0<i>Proceedings of the CHI `91 Conference on Human Factors in Computing Systems<\/i>, pp. 161-166. New York: ACM. [<a href=\"#bibcite:13\">9.7.3<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">7. [<a name=\"ref-Ne68\"><\/a>Ne68]<\/span> Newman, W. M. 1968. A system for interactive graphical programming. In Proceedings of the April 30&#8211;May 2, 1968, Spring Joint Computer Conference (Atlantic City, New Jersey, April 30 &#8211; May 02, 1968). AFIPS &#8217;68 (Spring). ACM, New York, NY, 47-54. DOI= http:\/\/doi.acm.org\/10.1145\/1468075.1468083 [<a href=\"#bibcite:1\">9.1<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">8. [<a name=\"ref-No98\"><\/a>No98]<\/span> \u00a0 Donald A. Norman, The Design of Everyday Things. MIT Press, 1998,\u00a0 ISBN-10: 0-262-64037-6 [<a href=\"#bibcite:8\">9.6<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">9. [<a name=\"ref-Re90\"><\/a>Re90]<\/span> Reason, James (1990): Human Error. New York, NY, Cambridge University Press [<a href=\"#bibcite:9\">9.6<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">10. [<a name=\"ref-Th08\"><\/a>Th08]<\/span> \u00a0 Thimbleby, H. (2008) <strong>\u2018<\/strong><strong>Ignorance of interaction programming is killing people\u2019 ACM Interactions,<\/strong> Volume 15 Issue 5, September + October 2008ACM, New York, NY, USA [<a href=\"#bibcite:12\">9.7.2<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">11. [<a name=\"ref-Wa76\"><\/a>Wa76]<\/span> Wallace, V. L. 1976. The semantics of graphic input devices. SIGGRAPH Comput. Graph. 10, 1 (May. 1976), 61-65. DOI= http:\/\/doi.acm.org\/10.1145\/957197.804734 [<a href=\"#bibcite:2\">9.1<\/a>]<\/p><\/div>\n<div class=\"bibitem\"><p class=\"bibitem_inner\"><span class=\"bibitem-label\">12. [<a name=\"ref-WM09\"><\/a>WM09]<\/span> Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In\u00a0Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u00a0(CHI &#8217;09). ACM, New York, NY, USA, 1083-1092. DOI: https:\/\/doi.org\/10.1145\/1518701.1518866 [<a href=\"#bibcite:3\">9.1<\/a>]<\/p><\/div>\n<p>\n\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":2,"featured_media":0,"parent":52,"menu_order":3,"comment_status":"closed","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-81","page","type-page","status-publish","hentry","","tg-column-two"],"_links":{"self":[{"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/pages\/81","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/comments?post=81"}],"version-history":[{"count":2,"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/pages\/81\/revisions"}],"predecessor-version":[{"id":134,"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/pages\/81\/revisions\/134"}],"up":[{"embeddable":true,"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/pages\/52"}],"wp:attachment":[{"href":"https:\/\/physicality.org\/TouchIT\/wp-json\/wp\/v2\/media?parent=81"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}