WEDNESDAY, 25 SEPTEMBER 2019

	Room 1400 | GW2	Room 1410 | GW2
8.30 - 9.15	REGISTRATION
9.15 - 9.30	OPENING ▶ Empirical Inroads
9.30 - 10.30	KEYNOTE Irene Mittelberg ▶ Augmented iconicity: How kinetic data analyses may inform gesture theory
10.30 - 11.00	COFFEE BREAK
	STORYTELLING & READING	DIAGRAMS & GRAPHS
11.00 - 11.40	Rebeca Wegener & Jörg Cassens ▶ Combining the lab with the crowd to understand multimodal responses to fantasy text reading	Tuomo Hiippala ▶ AI2D-RST: A multimodal corpus of diagrams
11.40 - 12.20	Daniel Echeverri & Huaxin Wei ▶ Hear, See, Do: Empirical insights of interactive storytelling and metamodality	Giovanni Parodi & Tomás Moreno-de León ▶ Integrating multiple multimodal professional written static texts: Reading purposes in an eye-tracking study with Economics word-graph texts
12.20 - 14.15	LUNCH BREAK
14.15 - 15.15	KEYNOTE John A. Bateman ▶ From Stephanie’s bedroom to World of Warcraft via Powerpoint: texts, semi-texts, and the methodological centrality of materiality
15.15 - 15.45	COFFEE BREAK
	PEDAGOGY & EDUCATION	HAPTICS & TEXTURE
15.45 - 16.10	Alex Leitao & Rodrigo Albuquerque ▶ Multimodal metaphors and social representations in (non)visual narratives: in scene an additional language student with Autism Spectrum Disorder	Marina Zagidullina ▶ The coding of haptic aesthetics: multimodality of "slime maniac" videos
16.10 - 16.35	Peter Teo ▶ The affective labour of education: A multimodal analysis of teacher recruitment videos in Singapore	Christian Mosbaek Johannessen, Kristoffer Claussen Boesen & Mads Lomholt Tvede ▶ A corpus-based approach to shape and colour in logos
16.35 - 17.00	Belinda Crawford Camiciottoli ▶ Analysing intersemiotic complementarity in OpenCourseWare lectures: An experimental mixed-method approach	Anna Zieba ▶ Raw & Pure – The social semiotic approach to visual texture in contemporary Scandinavian interior design
17.00 - 17.30	INTERACTIVE DEMO Daniel Echeverri & Huaxin Wie ▶ Letters to José: A Multimodal Playable Story

THURSDAY, 26 SEPTEMBER 2019

	Room 1400 | GW2	Room 1410 | GW2
9.30 - 10.30	KEYNOTE Ralph Ewerth ▶ Towards automatic interpretation of multimodal information? - Computational approaches in the context of the visual/verbal divide
10.30 - 11.40	COFFEE BREAK
	LECTURES & STORYTELLING	FACE-TO-FACE INTERACTION
11.00 - 11.40	Jörg Cassens & Rebekah Wegener ▶ Multimodal markers for meaning: Making use of behavioural, acoustic and textual cues to automatically identify importance in lectures"	Andreas Rothenhöfer ▶ Co-verbal facial gestures and automated facial expression recognition - Theoretical models, technical solutions and challenges in multimodal interaction analysis
11.40 - 12.20	Mikko Virtanen ▶ Multimodality of storytelling in popular science books	Martin Janecka ▶ Grammatical integration of gestures into the spoken language on the basis of experiments with aphasic patients
12.20 - 14.00	LUNCH BREAK
	FILM	ANALYTICAL CHALLENGES
14.00 - 14.40	Loli Kim ▶ Conventions in Korean revenge cinema: Three pilot studies using ‘Segmented Film Discourse Representation Structures’	Inke Du Bois ▶ Multiactivity in complex work settings - The media production of the ARD SportSchau
14.40 - 15.05	Jakub Kopecký ▶ Social identities of filmmakers within documentary films	Anna Maria Volpers ▶ Multimodality as challenge for the quantitative analysis of media content
	Zhen Zhang ▶ The segmentation methodology of classical Hollywood film. A multimodality approach	Julia Rytter Dakwar ▶ Reflections on the multimodal analytical interplay in the case of online and offline grocery shopping
15.30 - 16.30	INTERACTIVE POSTER SESSION
	PUBLIC INFORMATION	GAMES
16.30 - 17.10	Frederico Belcavello, Alexandre Diniz da Costa, Vânia Gomes de Almeida, Marcelo Viridiano & Tiago Timponi Torrent ▶ Multimodal analysis for building semantic representations in the tourism domain using frames and qualia	Dušan Stamenković & Janina Wildfeuer ▶ Constraining the open world: A multimodal empirical approach to GTA V’s game modes
17.10 - 17.50	Marcela González Chacón ▶ Analyzing multimodal texts resources, classification, and correlations in preventive public health campaigns in Costa Rica	Carman Ng ▶ An empirical exploration of gameplay as affective semiotic operations
19.00	CONFERENCE DINNER

FRIDAY, 27 SEPTEMBER 2019

	Room 1400 | GW2	Room 1410 | GW2
9.30 - 10.30	KEYNOTE Barbara Tversky ▶ Thinking and communicating with the world and the body
10.30 - 11.00	COFFEE BREAK
	NEWS, JOURNALISM & ADS	YOUNG MULTIMODALISTS
11.00 - 11.40	Hartmut Stöckl ▶ Multimodal Rhetorical Approaches to Social/Not-for-Profit Advertising	Kate Maxwell ▶ Starting young: Multimodal gender presentations in children's pop music
11.40 - 12.20	Chiara Pollaroli & Laura Bonelli ▶ Investigating multimodal creativity in advertising: The challanges of a corpus-based project
12.20 - 12.45	Jan Alyne Barbosa Prado ▶ Finding regularities and modalities for news design. An analysis of six digital news products under the perspective of multimodality	Julián de la Fuente, Pilar Lacasa & Rut Martínez-Borda ▶ Mimesis as multimodal discourse in children's media practices
12.45 - 13.15	CLOSING

See the full preliminary program here.