Appendix to: Design Patterns for Mixed-Method ...

Appendix to: Design Patterns for Mixed-Method Research in HCI Koen van Turnhout, Arthur Bennis, Sabine Craenmehr, Robert Holwerda, Marjolein Jacobs, Ralph Niels, Lambert Zaad, Stijn Hoppenbrouwers, Dick Lenior, René Bakker. HAN University of Applied Sciences Academy of Information Technology and Communication [Koen.vanTurnhout, Arthur.Bennis, Sabine.Craenmehr, Robert.Holwerda, Marjolein.Jacobs, Ralph.Niels, Lambert.Zaad, Stijn.Hoppenbrouwers, Dick.Lenior, Rene.Bakker] @ han.nl ABSTRACT

Table 2: Papers classified as Validated Solution

In this appendix we present the full reference list and classification results of our empirical literature study as presented in the paper Design Patterns for Mixed-Method Research in HCI [a].

VALIDATED SOLUTION Reference

Combination

1

Alt et al [1]

with Showroom

In ‘Design Patterns for Mixed-Method Research in HCI’ we presented an empirical literature study of an a-select sample of 40 papers taken from the NordiChi 2012 proceedings. This appendix lists our full. The set of papers was classified in to three fully described patterns and three ‘candidate patters’ which were only deliniated. Table 1 lists the division of papers across (candidate) patterns as presented in [a].

2

Ardito et al [3]

3

Dalsgaard & Halskov [9]

4

Freitag et al [12]

5

Hansen et al [19]

6

Harris [20]

Table 1: Patterns which were found

7

Honkala & Yanqing [21]

8

McGookin et al [30]

9

Medhi et al [31]

INTRODUCTION

Validated Solution

Number of papers 11

Field Reframing

10

10

Rodil et al [34]

Rigor Cycle

9

11

Veen et al [39]

Parameter Discovery

4

Transformative Design

3

Relevance Cycle

1

Unclassified

2

CLASSIFICATION RESULTS

In this section we present the full classification results of the empirical literature study. We have chosen to group the references according to the pattern which was assigned. Some combine multiple patterns or execute a study which is not part of the pattern in the strict sense of definition. These are listed in the column ‘combination’. What follows is a listing of the results. able 2 lists papers classified as Validated Solution; Table 3 lists papers classified as Field Reframing; Table 4 lists papers classified as Rigor Cycle; Table 5 lists papers classified as Parameter Discovery; Table 6 lists papers classified as Transformative Design; Table 7 lists the paper classified as Relevance Cycle; Table 8 lists the unclassified papers.

with Showroom

with Showroom

with Showroom

Table 3: Papers classified as Field Reframing FIELD REFRAMING Reference

Combination

1

Blythe et al [4]

with Workshop, without Showroom

2

Brown et al [5]

3

Følstad et al [11]

4

Giusti et al [13]

with Lab

5

Gonçalves et al [14]

with Lab

6

Grubert et al [16]

with Validated Solution

7

Häkkilä et al [17]

without Showroom

8

Kinnula et al [24]

9

Kuusinen et al [26]

10

Nylander [32]

without Showroom

Table 4: Papers classified as Rigor Cycle RIGOR CYCLE Reference

Combination

1

Fass & Main [10]

2

Gonzalez [15]

3

Hansen & Dalsgaard [18]

4

Iversen & Leong [22]

5

Knudsen et al [23]

6

Kynsilehto & Olsson [27]

7

Laporte et al [28]

8

Stienstra et al [37]

9

Weiss et al [40]

with Field

with Field

Table 5: Papers classified as Parameter Discovery PARAMETER DISCOVERY Reference

Combination

1

Andersen et al [2]

with Showroom

2

Cuendet et al [8]

3

MacKenzie & Teather [29]

with Workshop

4

Oeldorf-Hirsch et al [33]

with Field

Table 6: Papers classified as Transformative Design TRANSFORMATIVE DESIGN Reference

Combination

1

Clarke & Wright [7]

Field, Workshop, Showroom

2

Korn & Back [25]

Library, Field, Showroom

3

Seeburger [36]

Library, Workshop, Lab

Table 7: Paper classified as Relevance Cycle RELEVANCE CYCLE

1

Reference

Combination

Ciolfi & McLoughlin [6]

with Library

Table 8: Unclassified Papers UNCLASSIFIED Reference

Combination

1

Roeck, De et al [35]

Library, Field, Lab, Showroom

2

Syrjänen et al [38]

Library, Field, Workshop, Showroom

REFERENCES

a. Koen van Turnhout, Arthur Bennis, Sabine Craenmehr, Robert Holwerda, Marjolein Jacobs, Ralph Niels, Lambert Zaad, Stijn Hoppenbrouwers, Dick Lenior, and René Bakker. 2014. Design patterns for mixed-method research in HCI. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 361-370. DOI=10.1145/2639189.2639220 http://doi.acm.org/10.1145/2639189.2639220 REFERED PAPERS FROM THE DATASET

These papers appeared in Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI '12). ACM, New York, NY, USA. 1. Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt, and Julian Mennenöh. 2012. Increasing the user's attention on the web: using implicit interaction based on gaze behavior to tailor content, 544-553. 2. Hans Jørgen Andersen, Ann Morrison, and Lars Knudsen. 2012. Modeling vibrotactile detection by logistic regression, 500-503. 3. C. Ardito, M. F. Costabile, G. Desolda, M. Matera, A. Piccinno, and M. Picozzi. 2012. Composition of situational interactive spaces by end users: a case for cultural heritage, 79-88. 4. Mark Blythe, Jo Briggs, Patrick Olivier, and Jonathan Hook. 2012. Digital originals: reproduction as a space for design, 1-20. 5. Judith M. Brown, Gitte Lindgaard, and Robert Biddle. 2012. Joint implicit alignment work of interaction designers and software developers, 693-702. 6. Luigina Ciolfi and Marc McLoughlin. 2012. Designing for meaningful visitor engagement at a living history museum, 69-78. 7. Rachel Clarke and Pete Wright. 2012. Evocative of experience: crafting cross-cultural digital narratives through stories and portraits, 318-321. 8. Sébastien Cuendet, Engin Bumbacher, and Pierre Dillenbourg. 2012. Tangible vs. virtual representations: when tangibles benefit the training of spatial skills, 99108. 9. Peter Dalsgaard and Kim Halskov. 2012. Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection, 109-118. 10. John Fass and Angus Main. 2012. Revealing the news: how online news changes without you noticing, 757760. 11. Asbjørn Følstad, Effie Lai-Chong Law, and Kasper Hornbæk. 2012. Outliers in usability testing: how to treat usability problems found for only one test participant?, 257-260.

12. Georg Freitag, Michael Tränkner, and Markus Wacker. 2012. Enhanced feed-forward for a user aware multitouch device, 578-586.

27. Minna Kynsilehto and Thomas Olsson. 2012. Checkpoints, hotspots and standalones: placing smart services over time and place, 209-218.

13. Leonardo Giusti, Kotval Xerxes, Amelia Schladow, Nicholas Wallen, Francis Zane, and Federico Casalegno. 2012. Workspace configurations: setting the stage for remote collaboration on physical tasks, 351-360.

28. Lieve Laporte, Karin Slegers, and Dirk De Grooff. 2012. Using correspondence analysis to monitor the persona segmentation process, 265-274.

14. Lígia Gonçalves, Pedro Campos, and Margarida Sousa. 2012. M-dimensions: a framework for evaluating and comparing interactive installations in museums, 59-68. 15. Berto Gonzalez, Erin Carroll, and Celine Latulipe. 2012. Dance-inspired technology, technology-inspired dance, 398-407. 16. Jens Grubert, Raphaël Grasset, and Gerhard Reitmayr. 2012. Exploring the design of hybrid interfaces for augmented posters in public spaces, 238-246. 17. Jonna Häkkilä, Jussi Huhtala, Ari-Heikki Sarjanoja, and Albrecht Schmidt. 2012. Price tags, maps, recipes: mobile phone photos for functional purposes, 41-44. 18. Nicolai Brodersen Hansen and Peter Dalsgaard. 2012. The productive role of material design artefacts in participatory design events, 665-674. 19. John Paulin Hansen, Arne John Glenstrup, Wang Wusheng, Li Weiping, and Wu Zhonghai. 2012. Collecting location-based voice messages on a TalkingBadge, 219-227. 20. Christopher G. Harris. 2012. VisualizIR: a game for identifying and categorizing relevant text in documents, 554-557. 21. Mikko Honkala and Yanqing Cui. 2012. Automatic ondevice filtering of social networking feeds, 721-730. 22. Ole Sejer Iversen and Tuck W. Leong. 2012. Values-led participatory design: mediating the emergence of values, 468-477. 23. Søren Knudsen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2012. An exploratory study of how abundant display space may support data analysis, 558-567. 24. Marianne Kinnula, Netta Iivari, and Tuula Ijäs. 2012. On the brink of adulthood: a qualitative study of adolescent engagement with the internet, 418-427. 25. Matthias Korn and Jon Back. 2012. Talking it further: from feelings and memories to civic discussions in and about places, 189-198. 26. Kati Kuusinen and Kaisa Väänänen-Vainio-Mattila. 2012. How to make agile UX work more efficient: management and sales perspectives, 139-148.

29. I. Scott MacKenzie and Robert J. Teather. 2012. FittsTilt: the application of Fitts' law to tilt-based interaction, 568-577. 30. David McGookin, Yolanda Vazquez-Alvarez, Stephen Brewster, and Joanna Bergstrom-Lehtovirta. 2012. Shaking the dead: multimodal location based experiences for un-stewarded archaeological sites, 199208. 31. Indrani Medhi, Mohit Jain, Anuj Tewari, Mohini Bhavsar, Michael Matheke-Fischer, and Edward Cutrell. 2012. Combating rural child malnutrition through inexpensive mobile phones, 635-644. 32. Stina Nylander. 2012. Changing my life one step at a time: using the twelve step program as design inspiration for long term lifestyle change, 711-720. 33. Anne Oeldorf-Hirsch, Jonathan Donner, and Edward Cutrell. 2012. How bad is good enough?: exploring mobile video quality trade-offs for bandwidthconstrained consumers, 49-58. 34. Kasper Rodil, Heike Winschiers-Theophilus, Kasper L. Jensen, and Matthias Rehm. 2012. Homestead creator: a tool for indigenous designers, 627-630. 35. Dries De Roeck, Karin Slegers, Johan Criel, Marc Godon, Laurence Claeys, Katriina Kilpi, and An Jacobs. 2012. I would DiYSE for it!: a manifesto for do-ityourself internet-of-things creation, 170-179. 36. Jan Seeburger. 2012. No cure for curiosity: linking physical and digital urban layers, 247-256. 37. Jelle Stienstra, Miguel Bruns Alonso, Stephan Wensveen, and Stoffel Kuenen. 2012. How to design for transformation of behavior through interactive materiality, 21-30. 38. Anna-Liisa Syrjänen, Vesa Sihvola, Kari Kuutti, and Raisa Vilmunen. 2012. Human-to-human interfaces for remote service kiosks: the potential of audiovisual communication, 288-297. 39. Stefan Veen, Thomas Visser, and David V. Keyson. 2012. I heard you were on Facebook: linking awareness systems to online social networking, 703-706. 40. Benjamin Weiss, Ina Wechsung, and Stefanie Marquardt. 2012. Assessing ICT user groups, 275-283.