Machine vision 3D skin texture analysis for detection of melanoma

The purpose of this paper is to describe innovative machine vision methods that have been employed for the capture and analysis of 3D skin textures; and the resulting potential for assisting with identification of suspicious lesions in the detection of skin cancer.

A machine vision approach has been employed for analysis of 3D skin textures. This involves an innovative application of photometric stereo for the capture of the textures, and a range of methods for analysing and quantifying them, including statistical methods and neural networks.

3D skin texture has been identified as a useful indicator of skin cancer. It can be used to improve realism of virtual skin reconstructions in tele‐dermatology. 3D texture features can also be combined with 2D features to obtain a more robust classifier for improving diagnostic accuracy, thereby assisting with the long‐term goal of implementing computer‐aided diagnostics for skin cancer.

The device developed for capturing 3D skin textures is known as the “Skin Analyser”, and as far as the authors know it is unique in the world in being able to recover 3D textures from pigmented lesions in vivo. There currently exist numerous methods for analysing lesions, including manual inspection (using established heuristics commonly known as ABCD rules), dermoscopy and SIAoscopy. The ability to capture and analyse 3D lesion textures complements these existing techniques and forms a valuable additional indicator for assisting with the early detection of dangerous skin cancers such as melanoma.