CalorieCaptorGlass: Food Calorie Estimation based on Actual Size using HoloLens and Deep Learning

Abstract

We propose ”CalorieCaptorGlass”, a calorie estimation system based on actual size using image recognition and AR / MR glasses. In addition to the user experience with AR / MR glasses, we have built a system that takes into account the actual size of meals, which cannot be understood from images alone, using the environment recognition function. Therefore, unlike existing methods, the calorie amount can be estimated in consideration of the actual size without any restrictions on the reference object or the camera position, so the user can easily manage meals without stress by using this a system.

Topics & Concepts