Today we used the audio extracted from the video in a post below. It was taken by a Logitech 270 webcam which was pressed against my finger, hence the strange red pulsating color.
The audio was truncated as in the beginning the camera was moved a bit harshly and at the end the boiler used by my other self was creating an increasing white noise.
We just used Hjerte 0.3 (available on this Hackaday page and on Github) to classify the heart sound. It recognizes my heart beat quite well, and seems to find convincing S1 and S2 sounds.
What are the take home points?
– There is no need for a ultrasound Doppler to record heart sounds. Hence the “passive” in the title. It is important as some people dislike the idea of using ultrasounds in mass market devices.
– Heart sounds can be recorded on a finger!
– The Hjerte algorithm works even in weird conditions (ordinary microphone, lot of noise).
Now we have to use the video component in the file, and use it in conjunction with the audio part. An obvious use would be to have a reliable heart beat detection, before starting the segmentation.
We are dreaming of multiple webcams recording heart and lung sounds and integrating all those information!