Google Is Developing Technology to Detect Diabetes Risk Using a Smartphone Camera

Google is expanding the capabilities of its smartphone cameras, including work on a feature that will allow users to assess their body composition from a simple photo.

Google is working on PhotoScan, a feature that will allow users to scan their bodies simply by taking a photo to identify potential health issues, including those associated with the risk of developing diabetes.

To develop the technology, Google is using photos taken with smartphone cameras and comparing them with the results of DXA scans, also known as DEXA scans. This method is used to measure bone density as well as the amount of fat and muscle tissue in the body.

The resulting data, along with other relevant information, is processed by an artificial intelligence model. According to Google’s research blog, the system already demonstrates “strong agreement with DXA” when estimating body fat and other metrics. This enables near-DXA accuracy in predicting insulin resistance.

Google’s research also notes that while DXA scans are considered an accurate method for assessing body composition, they are difficult to scale for widespread use. Meanwhile, bioelectrical impedance analysis (BIA) sensors can provide only a basic estimate of body fat percentage.

The company has not yet announced when PhotoScan will become widely available.

While PhotoScan Is Still in Development

Google recently introduced the Pixel Watch 5, which includes an “Insulin Resistance Trends” feature as part of Pixel Health Guardian.

“Insulin Resistance Trends analyzes several weeks of physiological data to track changes in your metabolic health without the need to draw even a single drop of blood,” Google explains.

The feature tracks blood sugar spikes and shows how they change over time from month to month. This allows users to adjust their sleep, physical activity, or diet to help maintain a healthy weight or better manage diabetes.

Samsung also uses similar technology and offers devices with built-in BIA sensors. The company first introduced a device with a BIA sensor in 2021 with the launch of the Samsung Galaxy Watch 4 series.