<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "http://dtd.nlm.nih.gov/publishing/2.0/journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.0" xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IPROC</journal-id>
      <journal-id journal-id-type="nlm-ta">iproc</journal-id>
      <journal-title>Iproceedings</journal-title>
      <issn pub-type="epub">2369-6893</issn>
      <publisher>
        <publisher-name>JMIR Publications</publisher-name>
        <publisher-loc>Toronto, Canada</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">v8i1e36895</article-id>
      <article-id pub-id-type="pmid"/>
      <article-id pub-id-type="doi">10.2196/36895</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Abstract</subject>
        </subj-group>
        <subj-group subj-group-type="article-type">
          <subject>Abstract</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Interobserver and Human–Artificial Intelligence Concordance in Differentiating Between Invasive and In Situ Melanoma</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="editor">
          <name>
            <surname>Derrick</surname>
            <given-names>Thomas</given-names>
          </name>
        </contrib>
      </contrib-group>
      <contrib-group>
        <contrib id="contrib1" contrib-type="author" corresp="yes">
          <name name-style="western">
            <surname>Polesie</surname>
            <given-names>Sam</given-names>
          </name>
          <degrees>MD, PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <address>
            <institution>Department of Dermatology and Venereology</institution>
            <institution>Institute of Clinical Sciences, Sahlgrenska Academy</institution>
            <institution>University of Gothenburg</institution>
            <addr-line>Medicinaregatan 3</addr-line>
            <addr-line>Gothenburg, 41390</addr-line>
            <country>Sweden</country>
            <phone>46 31 786 00 00</phone>
            <email>sam.polesie@vgregion.se</email>
          </address>
          <xref rid="aff2" ref-type="aff">2</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-5398-6200</ext-link>
        </contrib>
        <contrib id="contrib2" contrib-type="author">
          <name name-style="western">
            <surname>Paoli</surname>
            <given-names>John</given-names>
          </name>
          <degrees>MD, PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <xref rid="aff2" ref-type="aff">2</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0003-1326-8535</ext-link>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <label>1</label>
        <institution>Department of Dermatology and Venereology</institution>
        <institution>Institute of Clinical Sciences, Sahlgrenska Academy</institution>
        <institution>University of Gothenburg</institution>
        <addr-line>Gothenburg</addr-line>
        <country>Sweden</country>
      </aff>
      <aff id="aff2">
        <label>2</label>
        <institution>Department of Dermatology and Venereology</institution>
        <institution>Sahlgrenska University Hospital</institution>
        <institution>Region Västra Götaland</institution>
        <addr-line>Gothenburg</addr-line>
        <country>Sweden</country>
      </aff>
      <author-notes>
        <corresp>Corresponding Author: Sam Polesie <email>sam.polesie@vgregion.se</email></corresp>
      </author-notes>
      <pub-date pub-type="collection">
        <season>Jan-Dec</season>
        <year>2022</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>8</day>
        <month>2</month>
        <year>2022</year>
      </pub-date>
      <volume>8</volume>
      <issue>1</issue>
      <elocation-id>e36895</elocation-id>
      <history>
        <date date-type="received">
          <day>28</day>
          <month>1</month>
          <year>2022</year>
        </date>
        <date date-type="accepted">
          <day>28</day>
          <month>1</month>
          <year>2022</year>
        </date>
      </history>
      <copyright-statement>©Sam Polesie, John Paoli. Originally published in Iproceedings (https://www.iproc.org), 08.02.2022.</copyright-statement>
      <copyright-year>2022</copyright-year>
      <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
        <p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Iproceedings, is properly cited. The complete bibliographic information, a link to the original publication on https://www.iproc.org/, as well as this copyright and license information must be included.</p>
      </license>
      <self-uri xlink:href="https://www.iproc.org/2022/1/e36895" xlink:type="simple"/>
      <abstract>
        <sec sec-type="background">
          <title>Background</title>
          <p>Machine learning algorithms including convolutional neural networks (CNNs) have recently made significant advances in research settings. Even though several algorithms nowadays are targeted directly to the consumer market, their implementation in clinical practice is still pending. Most melanomas are easy to recognize even without the aid of dermoscopy. Nonetheless, it is often more challenging to discriminate between invasive melanoma and melanoma in situ (MIS) in a preoperative setting even with the assistance of dermoscopy. Although several dermoscopic features suggestive of MIS and invasive melanomas have been presented, their usefulness in a larger setting is limited by how well physicians agree on their presence or absence.</p>
        </sec>
        <sec sec-type="objective">
          <title>Objective</title>
          <p>The overarching aims of this research project are to identify useful dermoscopic features to help dermatologists predict melanoma thickness and to develop CNNs that can assist dermatologists in the preoperative assessment of melanoma thickness. The ultimate aim is to develop algorithms that can strengthen patient care, improve clinical decision-making, and be used in routine health care.</p>
        </sec>
        <sec sec-type="methods">
          <title>Methods</title>
          <p>We have included dermoscopic images as well as clinical close-up images of invasive melanomas and MIS from our department during the time period of January 1, 2016, to December 31, 2020. Using this image material, we have trained, validated, and tested two separated CNNs based on dermoscopic and clinical close-up images. We have also invited dermatologists to review the test sets and, for a subset of the dermoscopic images, asked them to specify the presence of prespecified dermoscopic features. Subsequently, we compared CNN outputs to the combined dermatologists’ output for all lesions and assessed the interobserver agreement for several dermoscopic features.</p>
        </sec>
        <sec sec-type="results">
          <title>Results</title>
          <p>The CNN developed using dermoscopic images performed on par with the invited dermatologists whereas the CNN using clinical close-up images was outperformed by the group of dermatologists. Two dermoscopic features (atypical blue-white structures and shiny white lines) both displayed a moderate to substantial interobserver agreement and were both indicative of invasive melanomas &gt;1.0 mm.</p>
        </sec>
        <sec sec-type="conclusions">
          <title>Conclusions</title>
          <p>CNNs used to differentiate between invasive melanomas and MIS might be an example of a clinically relevant machine learning application, but they need further refinement and evaluation in prospective clinical trials. Only a few dermoscopic features are helpful in distinguishing melanoma thickness.</p>
        </sec>
        <sec>
          <title>Conflicts of Interest</title>
          <p>None declared.</p>
        </sec>
      </abstract>
      <kwd-group>
        <kwd>artificial intelligence</kwd>
        <kwd>clinical decision-making</kwd>
        <kwd>melanoma</kwd>
        <kwd>neural networks</kwd>
        <kwd>computer</kwd>
        <kwd>supervised machine learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
