Remote sensing of heart rate and blood oxygenation level using gaming camera based technology

1
Remote sensing of heart rate and blood
oxygenation level using gaming camera-based
technology
David Harris-Birtill1, David Morrison1, Devesh
Dhasmana2,3   1School of Computer Science,
University of St Andrews, Fife, KY16 9SX,
Scotland, UK 2School of Medicine, University of
St Andrews, Fife, KY16 9TJ, Scotland, UK 3NHS
Fife, Victoria Hospital, Hayfield Road,
Kirkcaldy, KY2 5AH, Scotland, UK dcchb_at_st-andrews
.ac.uk
2
Pulse Oximetry

• Heart Rate (less than 40, or more than 130 beats
  per minute bad)
• Blood Oxygenation level (less than 90 bad)

Taenzer et al. Impact of pulse oximetry
surveillance on rescue events and intensive care
unit transfers a before-and-after concurrence
study. Anesthesiology. 112 (2010) 282-7.
3
Kinect what data does it give us?

• Colour image (RGB)
• Infrared (IR) image
• Depth map
• Joint positions (head arms legs etc.)

4
Reflectance measurement setup
Spectrometer setup
Kinect setup
5
Calculation of heart rate
Peak frequency 72 beats per minute
Integrated intensity over time (across all
wavelengths)
Frequency content (using FFT) after high pass
filter
6
Calculated heart rate at each wavelength
High accuracy
7
Automated extraction of colour and IR skin
reflectance
8
Remote pulse oximetry
9
Questions?
David Harris-Birtill dcchb_at_st-andrews.ac.uk
Acknowledgements - Co-authors David Morrison,
Devesh Dhasmana - St Andrews Human Computer
Interaction (SACHI) lab
Funding
Institutions
10
Blood oxygenation
IR laser
IR laser
Blood spectra
Spectral differences
11
Reflectance spectra
Raw measures
Normalised to light emission intensity
12
Reflectance spectra
Normalised to light emission intensity
13
Kinect IR laser wavelength
858.75nm 0.5nm
Laser spectrum
Peak wavelength histogram (from 1 million spectra)
14
v1
v2
Current Kinect uses in healthcare

• Navigating through images in surgery
• Physical rehabilitation, using joint positions
• Special needs rehabilitation

15
Remote pulse oximetry
Person Heart rate Oxygen Saturation
74 98
65 99
78 98
140 89
86 97
16
Personal Research Background
Light In
Light absorbed Sound created
Light scattered
TEM image
20nm