Information Extraction for Clinical Handover

Information Extraction for Clinical Handover

Information Extraction
for Clinical Handover
Improving patient safety through advances in the
communication of patient information
Liyuan Zhou, Hanna Suominen and Leif Hanlen
Demonstration
NICTA Synthetic Nursing
Handover Data
 Patient
profiles
 Written, free-form text documents
 Structured handover form
 Written, structured documents
 Voice documents
 Our

team
Data sets
 Training


data(101):
Jun 2014
 Validation

Nov 2015
 Test

data(100):
data(100):
Apr 2016
Data formats
 Patient
profiles (DOCX)
 free-form text
documents (TXT)
 Audio files (WAV)
 structured documents
(TXT in CRF++ format).
Related works













L Dawson, M Johnson, H Suominen, J Basilakis, P Sanchez, B Kelly, and L Hanlen. A usability framework for speech
recognition technologies in clinical handover: A pre-implementation study. J Med Syst., 38(6):1-9, 2014.
M Johnson, S Lapkin, V Long, P Sanchez, H Suominen, J Basilakis, L Dawson. A systematic review of speech
recognition technology in health care. BMC Med Inform and Dec Making 2014 14(94). (PDF)
M Johnson, P Sanchez, H Suominen, J Basilakis, L Dawson, B Kelly, and L Hanlen. Comparing nursing handover
and documentation: Forming one set of patient information. Int Nurs Rev. 61(1):73-81, 2014.
M Johnson, H Suominen, L Hanlen, L Dawson, J Basilakis, A Yeo, and B Overs. Using speech-to-text (STT)
technology in nursing health communication. 7th December 2011 at the Researching Communication at UWS:
Brain, Behaviour and Computation, at University of Western Sydney, Bankstown, Sydney. Australia.
H Suominen. Tohtori Australiassa: Mikrofoni auttaisi hoitajaa [Dr in Australia: Mic for a nurse]. Invited Science
Column in the major regional newspapers in Finland (i.e., Turun Sanomat in Southwest Finland and Kaleva in
Council of Oulu Region). Turun Sanomat and Kaleva – June 2013.
H Suominen, J Basilakis, M Johnson, L Dawson, L Hanlen, B Kelly, Yeo A, and P Sanchez.Clinical speech to text:
Evaluation setting. In H Suominen, editor, The eHealth workshop of the Conference and Labs of the Evaluation
Forum (CLEF 2012), Sydney, NSW, Australia, 2012. NICTA.
H Suominen, J Basilakis, M Johnson, P Sanchez, L Dawson, L Hanlen, and B Kelly. Preliminary evaluation of speech
recognition for capturing patient information at nursing shift changes: Accuracy in speech to text and user
preferences for recorders. In H Suominen, editor, The Proceedings of the Fourth International Workshop on Health
Document Text Mining and Information Analysis (Louhi 2013), Sydney, NSW, Australia, 2013. NICTA.
H Suominen, M Johnson, L Zhou, P Sanchez, R Sirel, J Basilakis, L Hanlen, D Estival, L Dawson, B Kelly.Capturing
patient information at nursing shift changes: methodological evaluation of speech recognition and information
extraction. J Am Med Inf Assoc. 0:1-14, 2014.
H Suominen, D Martinez, M Wu, M Ananda-Rajah, and L Cavedon. NICTA eHealth initiatives on clinical speech
and text processing. HIC 2012, Australia’s Health Informatics Conference.
H Suominen, L Zhou, L Hanlen, G Ferraro. Benchmarking clinical speech recognition and information extraction:
New data, methods, and evaluations. JMIR Med Inform. 3(2):e19, 2015. (PDF)
Hanna Suominen, Leif Hanlen, Lorraine Goeuriot, Liadh Kelly, Gareth J F Jones, Task 1a of the CLEF eHealth
Evaluation Lab 2015: Clinical Speech Recognition, CLEF 2015 - 6th Conference and Labs of the Evaluation Forum Wednesday 2nd of September 2015
Lorraine Goeuriot, Liadh Kelly, Hanna Suominen, Leif Hanlen, Aurelie Neveol, Cyril Grouin, Joao Palotti, Guido
Zuccon, Overview of the CLEF eHealth Evaluation Lab 2015, Conference and Labs of the Evaluation Forum (CLEF)
2015, Lecture Notes in Computer Science 9283 - Friday 11th of September 2015
Liyuan Zhou, Hanna Suominen, Leif Hanlen, Evaluation Data and Benchmarks for Cascaded Speech Recognition
and Entity Extraction, ACM Multimedia 2015 Workshop on Speech, Language and Audio in Multimedia - Monday
26th of October 2015
Our model
 CRF
 Syntactic
features
 Semantic features
 Statistical features
Syntactic features
Semantic features
Statistical features
Our result
CLEF eHealth 2016
 Task
1: Handover Information Extraction
 Task 2: Multilingual Information Extraction
 Task 3: Patient-Centred Information
Retrieval
Important Dates







Data release begins: 15 Nov 2015
Participant result submissions: 1 May 2016
Results released: 15 May 2016
Participants’ working notes papers submitted
[CEUR-WS]: Jun 2016
Notification of Acceptance Participant
Papers [CEUR-WS]: tba
Camera Ready Copy of Participant Papers
[CEUR-WS] due: tba
CLEFeHealth2016 one-day lab session: Sept
2016
Contact



Task 1: Hanna Suominen ([email protected])
Task 2: Aurélie Névéol ([email protected])
Task 3: [email protected]

Mailing lists:
General information about CLEF eHealth lab:
https://groups.google.com/forum/#!forum/clef-ehealthevaluation-lab-information

Task 3 general enquiries and information:
https://groups.google.com/forum/#!forum/clef-ehealth-ir-task

Follow us on Twitter! @clefehealth

THANK YOU