SceneMaker: Creative Technology for Digital StoryTelling

Murat Akser, Brian Bridges, Giuliano Campo, Abbas Cheddad, Kevin Curran, Lisa Fitzpatrick, Linley Hamilton, John Harding, Ted Leath, Tom Lunney, Frank Lyons, Minhua Eunice Ma, John Macrae, Tom Maguire, Aiden McCaughey, Eileen McClory, Victoria McCollum, Paul McKevitt, Adam Melvin, Paul Moore & 4 others Eleanor Mulholland, Karla Muñoz, Greg O’Hanlon, Laurence Roman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.
LanguageEnglish
Title of host publicationInteractivity, Game Creation, Design, Learning, and Innovation
Subtitle of host publicationArtsIT 2016, DLI 2016
EditorsAntony Brooks, Eva Brooks
Place of PublicationCham
PublisherSpringer Verlag
Pages29-38
Number of pages10
ISBN (Electronic)9783319558349
ISBN (Print)9783319558332
DOIs
Publication statusPublished - 18 Mar 2017
Event5th EAI International Conference: ArtsIT, Interactivity & Game Creation - Esbjerg, Denmark
Duration: 2 May 20163 May 2016
Conference number: 5
http://artsit.org/2016/show/home (Link to Conference Website )

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
PublisherSpringer
ISSN (Electronic)1867-8211

Conference

Conference5th EAI International Conference
Abbreviated titleArtsIT 2016
CountryDenmark
CityEsbjerg
Period2/05/163/05/16
Internet address

Fingerprint

Digital Storytelling
Drama
Music
Education
Posture
Emotion
Cinematography
Screenplay
Software
Art Film
Facial Expression
Screenwriter
Creative Arts
Dance
Ulster
Affective
Module
Simulation

Cite this

Akser, M., Bridges, B., Campo, G., Cheddad, A., Curran, K., Fitzpatrick, L., ... Roman, L. (2017). SceneMaker: Creative Technology for Digital StoryTelling. In A. Brooks, & E. Brooks (Eds.), Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016 (pp. 29-38). (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). Cham: Springer Verlag. https://doi.org/10.1007/978-3-319-55834-9_4
Akser, Murat ; Bridges, Brian ; Campo, Giuliano ; Cheddad, Abbas ; Curran, Kevin ; Fitzpatrick, Lisa ; Hamilton, Linley ; Harding, John ; Leath, Ted ; Lunney, Tom ; Lyons, Frank ; Ma, Minhua Eunice ; Macrae, John ; Maguire, Tom ; McCaughey, Aiden ; McClory, Eileen ; McCollum, Victoria ; McKevitt, Paul ; Melvin, Adam ; Moore, Paul ; Mulholland, Eleanor ; Muñoz, Karla ; O’Hanlon, Greg ; Roman, Laurence. / SceneMaker : Creative Technology for Digital StoryTelling. Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. editor / Antony Brooks ; Eva Brooks. Cham : Springer Verlag, 2017. pp. 29-38 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).
@inproceedings{4e6c563c107640848bd4a17a0bd342d3,
title = "SceneMaker: Creative Technology for Digital StoryTelling",
abstract = "The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.",
keywords = "SceneMaker, natural language processing (NLP), speech processing, Artificial Intelligence, affective computing, computer graphics, cinematography, 3D visualization, digital storytelling, storyboards, film, drama, dance, music technology, design",
author = "Murat Akser and Brian Bridges and Giuliano Campo and Abbas Cheddad and Kevin Curran and Lisa Fitzpatrick and Linley Hamilton and John Harding and Ted Leath and Tom Lunney and Frank Lyons and Ma, {Minhua Eunice} and John Macrae and Tom Maguire and Aiden McCaughey and Eileen McClory and Victoria McCollum and Paul McKevitt and Adam Melvin and Paul Moore and Eleanor Mulholland and Karla Mu{\~n}oz and Greg O’Hanlon and Laurence Roman",
note = "Accepted date taken from ePrints SH.",
year = "2017",
month = "3",
day = "18",
doi = "10.1007/978-3-319-55834-9_4",
language = "English",
isbn = "9783319558332",
series = "Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering",
publisher = "Springer Verlag",
pages = "29--38",
editor = "Antony Brooks and Eva Brooks",
booktitle = "Interactivity, Game Creation, Design, Learning, and Innovation",

}

Akser, M, Bridges, B, Campo, G, Cheddad, A, Curran, K, Fitzpatrick, L, Hamilton, L, Harding, J, Leath, T, Lunney, T, Lyons, F, Ma, ME, Macrae, J, Maguire, T, McCaughey, A, McClory, E, McCollum, V, McKevitt, P, Melvin, A, Moore, P, Mulholland, E, Muñoz, K, O’Hanlon, G & Roman, L 2017, SceneMaker: Creative Technology for Digital StoryTelling. in A Brooks & E Brooks (eds), Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Springer Verlag, Cham, pp. 29-38, 5th EAI International Conference, Esbjerg, Denmark, 2/05/16. https://doi.org/10.1007/978-3-319-55834-9_4

SceneMaker : Creative Technology for Digital StoryTelling. / Akser, Murat; Bridges, Brian; Campo, Giuliano; Cheddad, Abbas; Curran, Kevin; Fitzpatrick, Lisa; Hamilton, Linley; Harding, John; Leath, Ted; Lunney, Tom; Lyons, Frank; Ma, Minhua Eunice; Macrae, John; Maguire, Tom; McCaughey, Aiden; McClory, Eileen; McCollum, Victoria; McKevitt, Paul; Melvin, Adam; Moore, Paul; Mulholland, Eleanor; Muñoz, Karla; O’Hanlon, Greg; Roman, Laurence.

Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. ed. / Antony Brooks; Eva Brooks. Cham : Springer Verlag, 2017. p. 29-38 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - SceneMaker

T2 - Creative Technology for Digital StoryTelling

AU - Akser, Murat

AU - Bridges, Brian

AU - Campo, Giuliano

AU - Cheddad, Abbas

AU - Curran, Kevin

AU - Fitzpatrick, Lisa

AU - Hamilton, Linley

AU - Harding, John

AU - Leath, Ted

AU - Lunney, Tom

AU - Lyons, Frank

AU - Ma, Minhua Eunice

AU - Macrae, John

AU - Maguire, Tom

AU - McCaughey, Aiden

AU - McClory, Eileen

AU - McCollum, Victoria

AU - McKevitt, Paul

AU - Melvin, Adam

AU - Moore, Paul

AU - Mulholland, Eleanor

AU - Muñoz, Karla

AU - O’Hanlon, Greg

AU - Roman, Laurence

N1 - Accepted date taken from ePrints SH.

PY - 2017/3/18

Y1 - 2017/3/18

N2 - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

AB - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

KW - SceneMaker

KW - natural language processing (NLP)

KW - speech processing

KW - Artificial Intelligence

KW - affective computing

KW - computer graphics

KW - cinematography

KW - 3D visualization

KW - digital storytelling

KW - storyboards

KW - film

KW - drama

KW - dance

KW - music technology

KW - design

U2 - 10.1007/978-3-319-55834-9_4

DO - 10.1007/978-3-319-55834-9_4

M3 - Conference contribution

SN - 9783319558332

T3 - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

SP - 29

EP - 38

BT - Interactivity, Game Creation, Design, Learning, and Innovation

A2 - Brooks, Antony

A2 - Brooks, Eva

PB - Springer Verlag

CY - Cham

ER -

Akser M, Bridges B, Campo G, Cheddad A, Curran K, Fitzpatrick L et al. SceneMaker: Creative Technology for Digital StoryTelling. In Brooks A, Brooks E, editors, Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. Cham: Springer Verlag. 2017. p. 29-38. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). https://doi.org/10.1007/978-3-319-55834-9_4