{"id":6273,"date":"2013-01-16T20:55:00","date_gmt":"2013-01-16T20:55:00","guid":{"rendered":"http:\/\/www.pharma-mkting.com\/study-reveals-inaccuracy-of-smartphone\/"},"modified":"2019-02-21T01:18:03","modified_gmt":"2019-02-21T01:18:03","slug":"study-reveals-inaccuracy-of-smartphone","status":"publish","type":"post","link":"http:\/\/ec2-54-175-84-28.compute-1.amazonaws.com\/pharma-mkting.com\/blog\/study-reveals-inaccuracy-of-smartphone\/","title":{"rendered":"Study Reveals Inaccuracy of Smartphone Health Apps"},"content":{"rendered":"

Performance of smartphone applications in assessing melanoma risk is highly variable and 3 of 4 applications incorrectly classified 30 percent or more of melanomas as unconcerning, according to a study published in JAMA Dermatology<\/i> (“Diagnostic Inaccuracy of Smartphone Applications for Melanoma Detection”; jamadermatol.2013.2382). The authors suggest that reliance on these applications, which are not subject to regulatory oversight, and not seeking medical consultation can delay the diagnosis of melanoma and potentially harm users. <\/p>\n

This is the first example I have seen of a study evaluating the accuracy of health apps, but it may not be the last. Sooner or later, apps developed by pharma companies will also be subject to such scrutiny by academics, and also by the FDA.<\/p>\n

I myself have reviewed several health apps developed by pharma companies that may be “buggy” and deserve to be rigorously tested for accuracy (see “Some Unregulated Physician Smartphone Apps May Be Buggy<\/a>“). Some pharma apps may be collecting personal information without adequately notifying users (see “Checking Under the Hood of Pharma Mobile Apps<\/a>“) or may be performing diagnostic calculations using undocumented and uncertified algorithms (see “FDA Promises Still More Guidance! This Time It’s Mobile. Janssen’s Psoriasis iPhone App May Need It<\/a>“).<\/p>\n

The authors of the study cited above looked at 4 apps that are designed to help consumers evaluate photographs of skin lesions and provide the user with feedback about the likelihood of malignancy. Three of the apps studied used an automated analysis algorithm to evaluate images. These apps were free or very inexpensive (e.g., $4.99) and allowed unlimited evaluations at no additional charge. The fourth app required images to be sent to a board-certified dermatologist for evaluation and an assessment is returned to the user within 24 hours (for a fee).<\/p>\n

Although the authors did not identify the apps, I used one of their search terms (“skin cancer”) in the Apple App Store and quickly found two representative apps, which are displayed in the image below:
\n<\/p>\n

\n<\/div>\n
\n<\/a><\/div>\n

\nThe authors used the apps to evaluate photos of 60 melanoma and 128 benign control lesions. It’s no surprise that human experts were much better at correctly evaluating skin lesions. Whereas the 3 apps that used algorithms evaluated 30% or more of melanomas as “unconcerning,” the remote dermatologist app incorrectly evaluated only 1 of the 53 melanomas as typical (ie, benign).<\/p>\n

The authors note that “more than 13,000 health care applications marketed to consumers are available in the largest online application store alone… Two-thirds of physicians use smartphone applications in their practice. Some<\/i> [my emphasis] of these applications have been evaluated in the peer reviewed literature,…However, this type of evaluation is not common for applications marketed directly to consumers,” noted the authors. And I wouldn’t say this type of evaluation is “common” either for apps marketed directly to physicians by pharma.<\/p>\n

The FDA may regulate some medical apps, but it is unclear which apps will be subject to regulation and what the regulatory review will entail. Sooner or later, IMHO, Congress is going to be investigating mobile health apps to see if more stringent regulations are required.<\/p>\n

IMHO, the pharmaceutical industry should differentiate itself from “wild west” apps developers by being pro-active in issuing Guidelines for Mobile Health Apps Developed by the Pharmaceutical Industry<\/b> in much the same manner as it developed other self-regulatory guidelines such as PhRMA’s DTC Guiding Principles<\/a> and Code on Interactions With Healthcare Professionals<\/a>.<\/p>\n

What Do You Think?<\/b><\/p>\n

The Regulation of Pharma Health Apps Survey<\/b><\/a> asks whether or not you agree that it is in the drug industry’s best interest to police itself and develop best practices or self-regulatory guidelines for developing trustworthy health\/medical apps for consumers and physicians.<\/p>\n

It also asks if you agree or disagree with the following specific suggestions:<\/p>\n