Visualization of patient behavior from natural language recommendations

Jonathan Siddle, Alan Lindsay, João F. Ferreira, Julie Porteous, Jonathon Read, Fred Charles, Marc Cavazza, Gersende Georg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The visualization of procedural knowledge from textual documents using 3D animation may be a way to improve understanding. We are interested in applying this approach to documents relating to patient education for bariatric surgery: a domain with challenging textual documents describing behavior recommendations that contain few procedural steps and leave much commonsense knowledge unspecified. In this work we look at how to automatically capture knowledge from a range of differently phrased recommendations and use that with implicit knowledge about compliance and violation, such that the recommendations can be visualized using 3D animations. Our solution is an end-to-end system that automates this process via: analysis of input recommendations to uncover their conditional structure; the use of commonsense knowledge and deontic logic to generate compliance and violation rules; and mapping of this knowledge to update a default knowledge base, which is used to generate appropriate sequences of visualizations. In this paper we overview this approach and demonstrate its potential.
Original languageEnglish
Title of host publicationProceedings of K-CAP 2017
Subtitle of host publicationKnowledge Capture Conference (K-CAP 2017)
PublisherAssociation for Computing Machinery (ACM)
Number of pages5
ISBN (Electronic)9781450355537
DOIs
Publication statusPublished - 4 Dec 2017
Externally publishedYes
Event9th International Conference on Knowledge Capture - Hilton Garden Inn Convention Center, Austin, United States
Duration: 4 Dec 20176 Dec 2017
Conference number: 9
https://k-cap2017.org/ (Link to Conference Website)

Conference

Conference9th International Conference on Knowledge Capture
Abbreviated titleK-CAP 2017
CountryUnited States
CityAustin
Period4/12/176/12/17
Internet address

Fingerprint

Animation
Visualization
Surgery
Education
Compliance

Cite this

Siddle, J., Lindsay, A., Ferreira, J. F., Porteous, J., Read, J., Charles, F., ... Georg, G. (2017). Visualization of patient behavior from natural language recommendations. In Proceedings of K-CAP 2017: Knowledge Capture Conference (K-CAP 2017) [25] Association for Computing Machinery (ACM). https://doi.org/10.1145/3148011.3148036
Siddle, Jonathan ; Lindsay, Alan ; Ferreira, João F. ; Porteous, Julie ; Read, Jonathon ; Charles, Fred ; Cavazza, Marc ; Georg, Gersende. / Visualization of patient behavior from natural language recommendations. Proceedings of K-CAP 2017: Knowledge Capture Conference (K-CAP 2017). Association for Computing Machinery (ACM), 2017.
@inproceedings{978bba7e15cf408f9ce758d3911923e1,
title = "Visualization of patient behavior from natural language recommendations",
abstract = "The visualization of procedural knowledge from textual documents using 3D animation may be a way to improve understanding. We are interested in applying this approach to documents relating to patient education for bariatric surgery: a domain with challenging textual documents describing behavior recommendations that contain few procedural steps and leave much commonsense knowledge unspecified. In this work we look at how to automatically capture knowledge from a range of differently phrased recommendations and use that with implicit knowledge about compliance and violation, such that the recommendations can be visualized using 3D animations. Our solution is an end-to-end system that automates this process via: analysis of input recommendations to uncover their conditional structure; the use of commonsense knowledge and deontic logic to generate compliance and violation rules; and mapping of this knowledge to update a default knowledge base, which is used to generate appropriate sequences of visualizations. In this paper we overview this approach and demonstrate its potential.",
keywords = "AI Planning, Default Reasoning, Deontic Modality, Interactive Narrative, NLP, Serious Games, Virtual Reality",
author = "Jonathan Siddle and Alan Lindsay and Ferreira, {Jo{\~a}o F.} and Julie Porteous and Jonathon Read and Fred Charles and Marc Cavazza and Gersende Georg",
year = "2017",
month = "12",
day = "4",
doi = "10.1145/3148011.3148036",
language = "English",
booktitle = "Proceedings of K-CAP 2017",
publisher = "Association for Computing Machinery (ACM)",
address = "United States",

}

Siddle, J, Lindsay, A, Ferreira, JF, Porteous, J, Read, J, Charles, F, Cavazza, M & Georg, G 2017, Visualization of patient behavior from natural language recommendations. in Proceedings of K-CAP 2017: Knowledge Capture Conference (K-CAP 2017)., 25, Association for Computing Machinery (ACM), 9th International Conference on Knowledge Capture, Austin, United States, 4/12/17. https://doi.org/10.1145/3148011.3148036

Visualization of patient behavior from natural language recommendations. / Siddle, Jonathan; Lindsay, Alan; Ferreira, João F.; Porteous, Julie; Read, Jonathon; Charles, Fred; Cavazza, Marc; Georg, Gersende.

Proceedings of K-CAP 2017: Knowledge Capture Conference (K-CAP 2017). Association for Computing Machinery (ACM), 2017. 25.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Visualization of patient behavior from natural language recommendations

AU - Siddle, Jonathan

AU - Lindsay, Alan

AU - Ferreira, João F.

AU - Porteous, Julie

AU - Read, Jonathon

AU - Charles, Fred

AU - Cavazza, Marc

AU - Georg, Gersende

PY - 2017/12/4

Y1 - 2017/12/4

N2 - The visualization of procedural knowledge from textual documents using 3D animation may be a way to improve understanding. We are interested in applying this approach to documents relating to patient education for bariatric surgery: a domain with challenging textual documents describing behavior recommendations that contain few procedural steps and leave much commonsense knowledge unspecified. In this work we look at how to automatically capture knowledge from a range of differently phrased recommendations and use that with implicit knowledge about compliance and violation, such that the recommendations can be visualized using 3D animations. Our solution is an end-to-end system that automates this process via: analysis of input recommendations to uncover their conditional structure; the use of commonsense knowledge and deontic logic to generate compliance and violation rules; and mapping of this knowledge to update a default knowledge base, which is used to generate appropriate sequences of visualizations. In this paper we overview this approach and demonstrate its potential.

AB - The visualization of procedural knowledge from textual documents using 3D animation may be a way to improve understanding. We are interested in applying this approach to documents relating to patient education for bariatric surgery: a domain with challenging textual documents describing behavior recommendations that contain few procedural steps and leave much commonsense knowledge unspecified. In this work we look at how to automatically capture knowledge from a range of differently phrased recommendations and use that with implicit knowledge about compliance and violation, such that the recommendations can be visualized using 3D animations. Our solution is an end-to-end system that automates this process via: analysis of input recommendations to uncover their conditional structure; the use of commonsense knowledge and deontic logic to generate compliance and violation rules; and mapping of this knowledge to update a default knowledge base, which is used to generate appropriate sequences of visualizations. In this paper we overview this approach and demonstrate its potential.

KW - AI Planning

KW - Default Reasoning

KW - Deontic Modality

KW - Interactive Narrative

KW - NLP

KW - Serious Games

KW - Virtual Reality

U2 - 10.1145/3148011.3148036

DO - 10.1145/3148011.3148036

M3 - Conference contribution

BT - Proceedings of K-CAP 2017

PB - Association for Computing Machinery (ACM)

ER -

Siddle J, Lindsay A, Ferreira JF, Porteous J, Read J, Charles F et al. Visualization of patient behavior from natural language recommendations. In Proceedings of K-CAP 2017: Knowledge Capture Conference (K-CAP 2017). Association for Computing Machinery (ACM). 2017. 25 https://doi.org/10.1145/3148011.3148036