SceneMaker: Creative Technology for Digital StoryTelling

Murat Akser; Brian Bridges; Giuliano Campo; Abbas Cheddad; Kevin Curran; Lisa Fitzpatrick; Linley Hamilton; John Harding; Ted Leath; Tom Lunney; Frank Lyons; Minhua Eunice Ma; John Macrae; Tom Maguire; Aiden McCaughey; Eileen McClory; Victoria McCollum; Paul McKevitt; Adam Melvin; Paul Moore; Eleanor Mulholland; Karla Muñoz; Greg O’Hanlon; Laurence Roman

doi:10.1007/978-3-319-55834-9_4

SceneMaker: Creative Technology for Digital StoryTelling

Murat Akser, Brian Bridges, Giuliano Campo, Abbas Cheddad, Kevin Curran, Lisa Fitzpatrick, Linley Hamilton, John Harding, Ted Leath, Tom Lunney, Frank Lyons, Minhua Eunice Ma, John Macrae, Tom Maguire, Aiden McCaughey, Eileen McClory, Victoria McCollum, Paul McKevitt, Adam Melvin, Paul MooreEleanor Mulholland, Karla Muñoz, Greg O’Hanlon, Laurence Roman

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

Original language	English
Title of host publication	Interactivity, Game Creation, Design, Learning, and Innovation
Subtitle of host publication	ArtsIT 2016, DLI 2016
Editors	Antony Brooks, Eva Brooks
Place of Publication	Cham
Publisher	Springer Verlag
Pages	29-38
Number of pages	10
ISBN (Electronic)	9783319558349
ISBN (Print)	9783319558332
DOIs	https://doi.org/10.1007/978-3-319-55834-9_4
Publication status	Published - 18 Mar 2017
Event	5th EAI International Conference: ArtsIT, Interactivity & Game Creation - Esbjerg, Denmark Duration: 2 May 2016 → 3 May 2016 Conference number: 5 http://artsit.org/2016/show/home (Link to Conference Website )

Publication series

Name	Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
Publisher	Springer
ISSN (Electronic)	1867-8211

Conference

Conference	5th EAI International Conference
Abbreviated title	ArtsIT 2016
Country	Denmark
City	Esbjerg
Period	2/05/16 → 3/05/16
Internet address	http://artsit.org/2016/show/home (Link to Conference Website )

Access to Document

10.1007/978-3-319-55834-9_4Licence: Unspecified

http://www.springer.com/gb/book/9783319558332?wt_mc=ThirdParty.SpringerLink.3.EPR653.About_eBookLicence: Unspecified

Fingerprint Dive into the research topics of 'SceneMaker: Creative Technology for Digital StoryTelling'. Together they form a unique fingerprint.

Cite this

Akser, M., Bridges, B., Campo, G., Cheddad, A., Curran, K., Fitzpatrick, L., Hamilton, L., Harding, J., Leath, T., Lunney, T., Lyons, F., Ma, M. E., Macrae, J., Maguire, T., McCaughey, A., McClory, E., McCollum, V., McKevitt, P., Melvin, A., ... Roman, L. (2017). SceneMaker: Creative Technology for Digital StoryTelling. In A. Brooks, & E. Brooks (Eds.), Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016 (pp. 29-38). (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). Springer Verlag. https://doi.org/10.1007/978-3-319-55834-9_4

Akser, Murat ; Bridges, Brian ; Campo, Giuliano ; Cheddad, Abbas ; Curran, Kevin ; Fitzpatrick, Lisa ; Hamilton, Linley ; Harding, John ; Leath, Ted ; Lunney, Tom ; Lyons, Frank ; Ma, Minhua Eunice ; Macrae, John ; Maguire, Tom ; McCaughey, Aiden ; McClory, Eileen ; McCollum, Victoria ; McKevitt, Paul ; Melvin, Adam ; Moore, Paul ; Mulholland, Eleanor ; Muñoz, Karla ; O’Hanlon, Greg ; Roman, Laurence. / SceneMaker : Creative Technology for Digital StoryTelling. Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. editor / Antony Brooks ; Eva Brooks. Cham : Springer Verlag, 2017. pp. 29-38 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).

@inproceedings{4e6c563c107640848bd4a17a0bd342d3,

title = "SceneMaker: Creative Technology for Digital StoryTelling",

abstract = "The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.",

keywords = "SceneMaker, natural language processing (NLP), speech processing, Artificial Intelligence, affective computing, computer graphics, cinematography, 3D visualization, digital storytelling, storyboards, film, drama, dance, music technology, design",

author = "Murat Akser and Brian Bridges and Giuliano Campo and Abbas Cheddad and Kevin Curran and Lisa Fitzpatrick and Linley Hamilton and John Harding and Ted Leath and Tom Lunney and Frank Lyons and Ma, {Minhua Eunice} and John Macrae and Tom Maguire and Aiden McCaughey and Eileen McClory and Victoria McCollum and Paul McKevitt and Adam Melvin and Paul Moore and Eleanor Mulholland and Karla Mu{\~n}oz and Greg O{\textquoteright}Hanlon and Laurence Roman",

note = "Accepted date taken from ePrints SH.; 5th EAI International Conference : ArtsIT, Interactivity & Game Creation, ArtsIT 2016 ; Conference date: 02-05-2016 Through 03-05-2016",

year = "2017",

month = mar,

day = "18",

doi = "10.1007/978-3-319-55834-9_4",

language = "English",

isbn = "9783319558332",

series = "Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering",

publisher = "Springer Verlag",

pages = "29--38",

editor = "Antony Brooks and Eva Brooks",

booktitle = "Interactivity, Game Creation, Design, Learning, and Innovation",

address = "Germany",

url = "http://artsit.org/2016/show/home",

}

Akser, M, Bridges, B, Campo, G, Cheddad, A, Curran, K, Fitzpatrick, L, Hamilton, L, Harding, J, Leath, T, Lunney, T, Lyons, F, Ma, ME, Macrae, J, Maguire, T, McCaughey, A, McClory, E, McCollum, V, McKevitt, P, Melvin, A, Moore, P, Mulholland, E, Muñoz, K, O’Hanlon, G & Roman, L 2017, SceneMaker: Creative Technology for Digital StoryTelling. in A Brooks & E Brooks (eds), Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Springer Verlag, Cham, pp. 29-38, 5th EAI International Conference, Esbjerg, Denmark, 2/05/16. https://doi.org/10.1007/978-3-319-55834-9_4

SceneMaker : Creative Technology for Digital StoryTelling. / Akser, Murat; Bridges, Brian; Campo, Giuliano; Cheddad, Abbas; Curran, Kevin; Fitzpatrick, Lisa; Hamilton, Linley; Harding, John; Leath, Ted; Lunney, Tom; Lyons, Frank; Ma, Minhua Eunice; Macrae, John; Maguire, Tom; McCaughey, Aiden; McClory, Eileen; McCollum, Victoria; McKevitt, Paul; Melvin, Adam; Moore, Paul; Mulholland, Eleanor; Muñoz, Karla; O’Hanlon, Greg; Roman, Laurence.

Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. ed. / Antony Brooks; Eva Brooks. Cham : Springer Verlag, 2017. p. 29-38 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - SceneMaker

T2 - 5th EAI International Conference

AU - Akser, Murat

AU - Bridges, Brian

AU - Campo, Giuliano

AU - Cheddad, Abbas

AU - Curran, Kevin

AU - Fitzpatrick, Lisa

AU - Hamilton, Linley

AU - Harding, John

AU - Leath, Ted

AU - Lunney, Tom

AU - Lyons, Frank

AU - Ma, Minhua Eunice

AU - Macrae, John

AU - Maguire, Tom

AU - McCaughey, Aiden

AU - McClory, Eileen

AU - McCollum, Victoria

AU - McKevitt, Paul

AU - Melvin, Adam

AU - Moore, Paul

AU - Mulholland, Eleanor

AU - Muñoz, Karla

AU - O’Hanlon, Greg

AU - Roman, Laurence

N1 - Conference code: 5

PY - 2017/3/18

Y1 - 2017/3/18

N2 - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

AB - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

KW - SceneMaker

KW - natural language processing (NLP)

KW - speech processing

KW - Artificial Intelligence

KW - affective computing

KW - computer graphics

KW - cinematography

KW - 3D visualization

KW - digital storytelling

KW - storyboards

KW - film

KW - drama

KW - dance

KW - music technology

KW - design

U2 - 10.1007/978-3-319-55834-9_4

DO - 10.1007/978-3-319-55834-9_4

M3 - Conference contribution

SN - 9783319558332

T3 - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

SP - 29

EP - 38

BT - Interactivity, Game Creation, Design, Learning, and Innovation

A2 - Brooks, Antony

A2 - Brooks, Eva

PB - Springer Verlag

CY - Cham

Y2 - 2 May 2016 through 3 May 2016

ER -

Akser M, Bridges B, Campo G, Cheddad A, Curran K, Fitzpatrick L et al. SceneMaker: Creative Technology for Digital StoryTelling. In Brooks A, Brooks E, editors, Interactivity, Game Creation, Design, Learning, and Innovation: ArtsIT 2016, DLI 2016. Cham: Springer Verlag. 2017. p. 29-38. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). https://doi.org/10.1007/978-3-319-55834-9_4