<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "http://dtd.nlm.nih.gov/publishing/2.0/journalpublishing.dtd">
<article article-type="abstract" dtd-version="2.0" xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IPROC</journal-id>
      <journal-id journal-id-type="nlm-ta">iproc</journal-id>
      <journal-title>Iproceedings</journal-title>
      <issn pub-type="epub">2369-6893</issn>
      <publisher>
        <publisher-name>JMIR Publications</publisher-name>
        <publisher-loc>Toronto, Canada</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">v7i1e35431</article-id>
      <article-id pub-id-type="pmid">27739470</article-id>
      <article-id pub-id-type="doi">10.2196/35431</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Abstract</subject>
        </subj-group>
        <subj-group subj-group-type="article-type">
          <subject>Abstract</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Privacy Protection With Facial Deidentification Machine Learning Methods: Can Current Methods Be Applied to Dermatology?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="editor">
          <name>
            <surname>Derrick</surname>
            <given-names>Thomas</given-names>
          </name>
        </contrib>
      </contrib-group>
      <contrib-group>
        <contrib id="contrib1" contrib-type="author" corresp="yes">
          <name name-style="western">
            <surname>Jeong</surname>
            <given-names>Hyeon Ki</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <address>
            <institution>Department of Dermatology</institution>
            <institution>Duke University</institution>
            <addr-line>Duke University Medical Center, DUMC 3135</addr-line>
            <addr-line>Durham, NC, 27710</addr-line>
            <country>United States</country>
            <phone>1 919 684 3432</phone>
            <email>hyeonki.jeong@duke.edu</email>
          </address>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0001-6680-2012</ext-link>
        </contrib>
        <contrib id="contrib2" contrib-type="author">
          <name name-style="western">
            <surname>Park</surname>
            <given-names>Christine</given-names>
          </name>
          <degrees>BA</degrees>
          <xref rid="aff2" ref-type="aff">2</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-0066-366X</ext-link>
        </contrib>
        <contrib id="contrib3" contrib-type="author">
          <name name-style="western">
            <surname>Henao</surname>
            <given-names>Ricardo</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff3" ref-type="aff">3</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0003-4980-845X</ext-link>
        </contrib>
        <contrib id="contrib4" contrib-type="author">
          <name name-style="western">
            <surname>Kheterpal</surname>
            <given-names>Meenal</given-names>
          </name>
          <degrees>MD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-0460-6400</ext-link>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <label>1</label>
        <institution>Department of Dermatology</institution>
        <institution>Duke University</institution>
        <addr-line>Durham, NC</addr-line>
        <country>United States</country>
      </aff>
      <aff id="aff2">
        <label>2</label>
        <institution>Duke School of Medicine</institution>
        <institution>Duke University</institution>
        <addr-line>Durham, NC</addr-line>
        <country>United States</country>
      </aff>
      <aff id="aff3">
        <label>3</label>
        <institution>Duke University</institution>
        <addr-line>Durham, NC</addr-line>
        <country>United States</country>
      </aff>
      <author-notes>
        <corresp>Corresponding Author: Hyeon Ki Jeong <email>hyeonki.jeong@duke.edu</email></corresp>
      </author-notes>
      <pub-date pub-type="collection">
        <season>Jan-Dec</season>
        <year>2021</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>17</day>
        <month>12</month>
        <year>2021</year>
      </pub-date>
      <volume>7</volume>
      <issue>1</issue>
      <elocation-id>e35431</elocation-id>
      <history>
        <date date-type="received">
          <day>3</day>
          <month>12</month>
          <year>2021</year>
        </date>
        <date date-type="accepted">
          <day>3</day>
          <month>12</month>
          <year>2021</year>
        </date>
      </history>
      <copyright-statement>©Hyeon Ki Jeong, Christine Park, Ricardo Henao, Meenal Kheterpal. Originally published in Iproceedings (https://www.iproc.org), 17.12.2021.</copyright-statement>
      <copyright-year>2021</copyright-year>
      <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
        <p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Iproceedings, is properly cited. The complete bibliographic information, a link to the original publication on https://www.iproc.org/, as well as this copyright and license information must be included.</p>
      </license>
      <self-uri xlink:href="https://www.iproc.org/2021/1/e35431" xlink:type="simple"/>
      <abstract>
        <sec sec-type="background">
          <title>Background</title>
          <p>In the era of increasing tools for automatic image analysis in dermatology, new machine learning models require high-quality image data sets. Facial image data are needed for developing models to evaluate attributes such as redness (acne and rosacea models), texture (wrinkles and aging models), pigmentation (melasma, seborrheic keratoses, aging, and postinflammatory hyperpigmentation), and skin lesions. Deidentifying facial images is critical for protecting patient anonymity. Traditionally, journals have required facial feature concealment typically covering the eyes, but these guidelines are largely insufficient to meet ethical and legal guidelines of the Health Insurance Portability and Accountability Act for patient privacy. Currently, facial feature deidentification is a challenging task given lack of expert consensus and lack of testing infrastructure for adequate automatic and manual facial image detection.</p>
        </sec>
        <sec sec-type="objective">
          <title>Objective</title>
          <p>This study aimed to review the current literature on automatic facial deidentification algorithms and to assess their utility in dermatology use cases, defined by preservation of skin attributes (redness, texture, pigmentation, and lesions) and data utility.</p>
        </sec>
        <sec sec-type="methods">
          <title>Methods</title>
          <p>We conducted a systematic search using a combination of headings and keywords to encompass the concepts of facial deidentification and privacy preservation. The MEDLINE (via PubMed), Embase (via Elsevier), and Web of Science (via Clarivate) databases were queried from inception to May 1, 2021. Studies with the incorrect design and outcomes were excluded during the screening and review process.</p>
        </sec>
        <sec sec-type="results">
          <title>Results</title>
          <p>A total of 18 studies, largely focusing on general adversarial network (GANs), were included in the final review reporting various methodologies of facial deidentification algorithms for still and video images. GAN-based studies were included owing to the algorithm’s capacity to generate high-quality, realistic images. Study methods were rated individually for their utility for use cases in dermatology, pertaining to skin color or pigmentation and texture preservation, data utility, and human detection, by 3 human reviewers. We found that most studies notable in the literature address facial feature and expression preservation while sacrificing skin color, texture, pigmentation, which are critical features in dermatology-related data utility.</p>
        </sec>
        <sec sec-type="conclusions">
          <title>Conclusions</title>
          <p>Overall, facial deidentification algorithms have made notable advances such as disentanglement and face swapping techniques, while producing realistic faces for protecting privacy. However, they are sparse and currently not suitable for complete preservation of skin texture, color, and pigmentation quality in facial photographs. Using the current advances in artificial intelligence for facial deidentification summarized herein, a novel approach is needed to ensure greater patient anonymity, while increasing data access for automated image analysis in dermatology.</p>
        </sec>
        <sec>
          <title>Conflicts of Interest</title>
          <p>None declared.</p>
        </sec>
      </abstract>
      <kwd-group>
        <kwd>artificial intelligence</kwd>
        <kwd>privacy</kwd>
        <kwd>facial deidentification</kwd>
        <kwd>machine learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <back>
    <app-group>
      <supplementary-material id="app1">
        <label>Multimedia Appendix 1</label>
        <p>Overview of included studies.</p>
        <media xlink:href="iproc_v7i1e35431_app1.png" xlink:title="PNG File , 311 KB"/>
      </supplementary-material>
      <supplementary-material id="app2">
        <label>Multimedia Appendix 2</label>
        <p>Part 2 of Multimedia Appendix 1.</p>
        <media xlink:href="iproc_v7i1e35431_app2.png" xlink:title="PNG File , 238 KB"/>
      </supplementary-material>
    </app-group>
  </back>
</article>
