Controlling the future:

Emerging user interface approaches

@KathyReid on GitHub, Twitter, IRC, Slack etc

kathyreid.com.au

Overview

A brief recap on user interfaces

Drivers for change

Emerging UI technologies

Implications and considerations

History

A quick look back at how far user interfaces have come...

Punch cards? FML.

Attribution: Punch Cards via Chris Limb on Flickr.

Attribution: Terminal Znakowy MERA 7951 OM Mera-ELZAB MERAMAT via Arkadiusz Sikorski on Flickr.

Attribution: Macintosh Mouse via Marcin Wichary on Flickr.

Attribution: BAMBOOFun16 via Shou-Hui Wang on Flickr.

Attribution: Asus TX201LA Transformer Book Series Laptop via India7 Network on Flickr.

Drivers for change in user interfaces

Paradigm shifts, instead of incremental improvement (wireless, bluetooth, ergonomics etc)

Driver #1 - Mobility

Users are on the go - and the UI must follow

Chained to the desk?

Attribution: Chained via clement127 on Flickr.

Attribution: infrared keyboard on a table for your iPhone via Francisco Huguenin Uhlfelder on Flickr.

Driver #2 - Contexts and context-switching

Users operate in different contexts - and the UI must be appropriate for the context

Timeslicing throughout the day

Haber's classification of contexts

Intimate space

Personal space

Social space

Public space

Driver #3 - Interfaces are everywhere

Interfaces exist in a landscape with other interfaces, not in isolation

Speech recognition, voice control and conversational UIs

Attribution: Mirrored Drives via Ian Sterling on Flickr.

Gesture control and natural user interfaces

Attribution: Leap Motion Hand Tracking via 0xF2 on Flickr.

Attribution: Project Soli via Portal GDA on Flickr.

Attribution: Keeping up with the times via Mister G.C. on Flickr.

Emotional and social interfaces

Attribution: CV Dazzle Collection via Adam Harvey

Wearable interfaces

The law of unintended consequences...

Attribution: Information Overload via James Marvin Phelps on Flickr.

Attribution: Blind Man Walking via Meena Kadri on Flickr.

Conclusion

Mobility, context switching, interfaces everywhere

Speech recognition, natural user interfaces and gesture control, emotional UIs and wearables

How we harness these technologies will shape the future. Use your control wisely.

References

Boehm, J. (2012). Natural user interface sensors for human body measurement. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 39, 531–536.

Braga, M. (n.d.). Here’s What’s Holding Back Your Universal Translator | Motherboard. Retrieved August 7, 2016, from http://motherboard.vice.com/read/heres-whats-holding-back-your-universal-translator

Brownlee, J. (n.d.). Conversational Interfaces, Explained | Co.Design | business + design. Retrieved August 7, 2016, from http://www.fastcodesign.com/3058546/conversational-interfaces-explained

Brumitt, B., & Cadiz, J. J. (2001). Let there be light" examining interfaces for homes of the future. In Human Computer Interaction. INTERACT’01. IFIP TC. 13 International Conference on Human Computer Interaction. IOS Press, Amsterdam, Netherlands; 2001; xxvii+ 897 pp (pp. 375–82).

David W. Cearley. (n.d.). The Evolving User Interface From Graphical UI to Environmental UI - Gartner Research ID G00138271. Retrieved August 3, 2016, from https://www.gartner.com/doc/490171/evolving-user-interface-graphical-ui

Delimarschi, D., Swartzendruber, G., & Kagdi, H. (2014). Enabling integrated development environments with natural user interface interactions. In Proceedings of the 22nd International Conference on Program Comprehension (pp. 126–129). ACM.

Haber, J., Greening, M., Castellano, L., & Wheaton, P. (n.d.). Proxemic Conversational UI: Moving beyond simple conversation.

Harris, R. A. (2004). Voice interaction design: crafting the new conversational speech systems. Elsevier.

Jackie Fenn, Alexander Linden, Steve Cramoysan, Toby Bell, & Bern Elliot. (n.d.). Hype Cycle for Human-Computer Interaction, 2005 Gartner Research ID G00128069. Retrieved August 3, 2016, from https://www.gartner.com/doc/481880?ref=ddisp

Jain, J., Lund, A., & Wixon, D. (2011). The future of natural user interfaces. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems (pp. 211–214). Vancouver, BC, Canada: ACM.

Koskela, T., & Väänänen-Vainio-Mattila, K. (2004). Evolution towards smart home environments: empirical evaluation of three user interfaces. Personal and Ubiquitous Computing, 8(3–4), 234–240.

Lee, E. J., Nass, C., & Brave, S. (2000). Can computer-generated speech have gender?: an experimental test of gender stereotype. In CHI’00 extended abstracts on Human factors in computing systems (pp. 289–290). ACM.

Nass, C., Moon, Y., & Green, N. (1997). Are Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices. Journal of Applied Social Psychology, 27(10), 864–876.

Picard, R. W., Wexelblat, A., & Clifford I Nass, C. I. N. I. (2002). Future interfaces: social and emotional. In CHI’02 Extended Abstracts on Human Factors in Computing Systems (pp. 698–699). ACM.

Steinberg, G. (2012). Natural user interfaces. In ACM SIGCHI Conference on Human Factors in Computing Systems.

Štolfa, T. (n.d.). The Future of Conversational UI Belongs to Hybrid Interfaces — The Layer — Medium. Retrieved August 7, 2016, from https://medium.com/the-layer/the-future-of-conversational-ui-belongs-to-hybrid-interfaces-8a228de0bdb5#.613h0diz3

The evolution of the interface, from text through touch | Ars Technica. (n.d.). Retrieved August 4, 2016, from http://arstechnica.com/gadgets/2015/04/the-evolution-of-the-interface-from-text-through-touch/