<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "http://dtd.nlm.nih.gov/publishing/2.0/journalpublishing.dtd">
<article article-type="abstract" dtd-version="2.0" xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IPROC</journal-id>
      <journal-id journal-id-type="nlm-ta">iproc</journal-id>
      <journal-title>Iproceedings</journal-title>
      <issn pub-type="epub">2369-6893</issn>
      <publisher>
        <publisher-name>JMIR Publications</publisher-name>
        <publisher-loc>Toronto, Canada</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">v8i1e39408</article-id>
      <article-id pub-id-type="pmid"/>
      <article-id pub-id-type="doi">10.2196/39408</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Abstract</subject>
        </subj-group>
        <subj-group subj-group-type="article-type">
          <subject>Abstract</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Development and Usability Testing of a Chatbot to Promote Mental Health Services Use Among Individuals With Eating Disorders Following Screening</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="editor">
          <name>
            <surname>Pagoto</surname>
            <given-names>Sherry</given-names>
          </name>
        </contrib>
      </contrib-group>
      <contrib-group>
        <contrib id="contrib1" contrib-type="author">
          <name name-style="western">
            <surname>Shah</surname>
            <given-names>Jilllian</given-names>
          </name>
          <degrees>BS</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0001-6006-3263</ext-link>
        </contrib>
        <contrib id="contrib2" contrib-type="author">
          <name name-style="western">
            <surname>DePietro</surname>
            <given-names>Bianca</given-names>
          </name>
          <degrees>BA</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-1794-2833</ext-link>
        </contrib>
        <contrib id="contrib3" contrib-type="author">
          <name name-style="western">
            <surname>D'Adamo</surname>
            <given-names>Laura</given-names>
          </name>
          <degrees>BA</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0001-9963-7316</ext-link>
        </contrib>
        <contrib id="contrib4" contrib-type="author">
          <name name-style="western">
            <surname>Firebaugh</surname>
            <given-names>Marie-Laure</given-names>
          </name>
          <degrees>LMSW</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-3663-131X</ext-link>
        </contrib>
        <contrib id="contrib5" contrib-type="author">
          <name name-style="western">
            <surname>Laing</surname>
            <given-names>Olivia</given-names>
          </name>
          <degrees>MSW</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0003-0242-2349</ext-link>
        </contrib>
        <contrib id="contrib6" contrib-type="author">
          <name name-style="western">
            <surname>Fowler</surname>
            <given-names>Lauren A</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-9240-7267</ext-link>
        </contrib>
        <contrib id="contrib7" contrib-type="author">
          <name name-style="western">
            <surname>Smolar</surname>
            <given-names>Lauren</given-names>
          </name>
          <degrees>MA</degrees>
          <xref rid="aff2" ref-type="aff">2</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-8160-5882</ext-link>
        </contrib>
        <contrib id="contrib8" contrib-type="author">
          <name name-style="western">
            <surname>Sadeh-Sharvit</surname>
            <given-names>Shiri</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff3" ref-type="aff">3</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0001-6499-9034</ext-link>
        </contrib>
        <contrib id="contrib9" contrib-type="author">
          <name name-style="western">
            <surname>Taylor</surname>
            <given-names>Craig Barr</given-names>
          </name>
          <degrees>MD</degrees>
          <xref rid="aff4" ref-type="aff">4</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-4564-6548</ext-link>
        </contrib>
        <contrib id="contrib10" contrib-type="author">
          <name name-style="western">
            <surname>Wilfley</surname>
            <given-names>Denise E</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0002-3599-8689</ext-link>
        </contrib>
        <contrib id="contrib11" contrib-type="author" corresp="yes">
          <name name-style="western">
            <surname>Fitzsimmons-Craft</surname>
            <given-names>Ellen E</given-names>
          </name>
          <degrees>PhD</degrees>
          <xref rid="aff1" ref-type="aff">1</xref>
          <address>
            <institution>Department of Psychiatry</institution>
            <institution>Washington University in St Louis School of Medicine</institution>
            <addr-line>660 S Euclid Avenue</addr-line>
            <addr-line>St Louis, MO, 63110</addr-line>
            <country>United States</country>
            <phone>1 (314) 286 2074</phone>
            <email>fitzsimmonse@wustl.edu</email>
          </address>
          <ext-link ext-link-type="orcid">https://orcid.org/0000-0001-7064-3835</ext-link>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <label>1</label>
        <institution>Department of Psychiatry</institution>
        <institution>Washington University in St Louis School of Medicine</institution>
        <addr-line>St Louis, MO</addr-line>
        <country>United States</country>
      </aff>
      <aff id="aff2">
        <label>2</label>
        <institution>National Eating Disorders Association</institution>
        <addr-line>New York City, NY</addr-line>
        <country>United States</country>
      </aff>
      <aff id="aff3">
        <label>3</label>
        <institution>Center for m2Health</institution>
        <institution>Palo Alto University</institution>
        <addr-line>Palo Alto, CA</addr-line>
        <country>United States</country>
      </aff>
      <aff id="aff4">
        <label>4</label>
        <institution>Department of Psychiatry and Behavioral Sciences</institution>
        <addr-line>Stanford, CA</addr-line>
        <country>United States</country>
      </aff>
      <author-notes>
        <corresp>Corresponding Author: Ellen E Fitzsimmons-Craft <email>fitzsimmonse@wustl.edu</email></corresp>
      </author-notes>
      <pub-date pub-type="collection">
        <season>Jan-Dec</season>
        <year>2022</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>11</day>
        <month>7</month>
        <year>2022</year>
      </pub-date>
      <volume>8</volume>
      <issue>1</issue>
      <elocation-id>e39408</elocation-id>
      <history>
        <date date-type="received">
          <day>9</day>
          <month>5</month>
          <year>2022</year>
        </date>
        <date date-type="accepted">
          <day>24</day>
          <month>6</month>
          <year>2022</year>
        </date>
      </history>
      <copyright-statement>©Jilllian Shah, Bianca DePietro, Laura D'Adamo, Marie-Laure Firebaugh, Olivia Laing, Lauren A Fowler, Lauren Smolar, Shiri Sadeh-Sharvit, Craig Barr Taylor, Denise E Wilfley, Ellen E Fitzsimmons-Craft. Originally published in Iproceedings (https://www.iproc.org), 11.07.2022.</copyright-statement>
      <copyright-year>2022</copyright-year>
      <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
        <p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Iproceedings, is properly cited. The complete bibliographic information, a link to the original publication on https://www.iproc.org/, as well as this copyright and license information must be included.</p>
      </license>
      <self-uri xlink:href="https://www.iproc.org/2022/1/e39408" xlink:type="simple"/>
      <abstract>
        <sec sec-type="background">
          <title>Background</title>
          <p>Eating disorders (EDs) are complex mental illnesses with debilitating, pervasive psychological and physiological consequences when left untreated. Unfortunately, patients may face barriers to receiving treatment, such as stereotypes surrounding EDs, denial of illness severity, lack of motivation for treatment, and lack of knowledge about treatment resources. Barriers such as these result in a large treatment gap: only 20% of those with EDs will ever receive treatment. Digital tools like chatbots show potential to disseminate mental health–related interventions to large populations while offering a user-friendly, cost-effective, accessible, and anonymous means of tackling patient concerns.</p>
        </sec>
        <sec sec-type="objective">
          <title>Objective</title>
          <p>This study developed and evaluated the usability of a chatbot designed for pairing with online ED screening. The tool aimed to promote mental health service utilization by improving motivation for treatment and self-efficacy among individuals with EDs.</p>
        </sec>
        <sec sec-type="methods">
          <title>Methods</title>
          <p>A chatbot prototype, Alex, was designed using decision trees and theoretically informed components: psychoeducation, motivational interviewing, personalized recommendations, and repeated administration. Usability testing was conducted over 4 iterative cycles, with user feedback informing refinements to the next iteration. Postintervention, participants (N=21) completed the System Usability Scale (SUS), the Usefulness, Satisfaction, and Ease of Use Questionnaire (USE), and a semistructured interview. This process aimed to create an optimized chatbot by the final cycle for use in a randomized trial.</p>
        </sec>
        <sec sec-type="results">
          <title>Results</title>
          <p>Interview feedback detailed chatbot aspects participants enjoyed and aspects necessitating improvement. Feedback converged on four themes: user experience, chatbot qualities, chatbot content, and ease of use. Following refinements, users described Alex as humanlike, supportive, and encouraging. Content was perceived as novel and personally relevant. USE scores across domains were generally above average (~5 out of 7), and SUS scores indicated “good” to “excellent” usability across cycles, with the final iteration receiving the highest average SUS score.</p>
        </sec>
        <sec sec-type="conclusions">
          <title>Conclusions</title>
          <p>Overall, participants responded well in interactions with Alex, including the initial version. Refinements between cycles further improved user experiences. This study provides preliminary evidence of the feasibility and acceptance of a chatbot designed to promote motivation for and use of services among individuals with EDs. Alex is the first chatbot designed for pairing with an ED or other mental health–related online screen, with the goal of ultimately increasing service utilization.</p>
        </sec>
        <sec>
          <title>Acknowledgments</title>
          <p>This research was supported by K08 MH120341 from the National Institute of Mental Health.</p>
        </sec>
        <sec>
          <title>Availability of Data, Materials, and Code</title>
          <p>The data will be made available by reasonable request to the corresponding author.</p>
        </sec>
        <sec>
          <title>Authors’ Contributions</title>
          <p>EEFC conceptualized and designed the study. OL and BD conducted the investigation process. BD and JS assisted with data curation and conducted formal thematic analyses. JS conducted formal statistical analyses. JS wrote the original manuscript, with contribution from BD. EEFC, CBT, DEW, and SSS designed the data collection instruments, and coordinated and supervised data collection, in addition to reviewing and editing the manuscript with LS, LMF, LAF, and LD.</p>
        </sec>
        <sec>
          <title>Conflicts of Interest</title>
          <p>None declared.</p>
        </sec>
      </abstract>
      <kwd-group>
        <kwd>eating disorder</kwd>
        <kwd>chatbot</kwd>
        <kwd>mental health treatment</kwd>
        <kwd>digital intervention</kwd>
        <kwd>health screening</kwd>
        <kwd>conversational agent</kwd>
        <kwd>chatbot design</kwd>
        <kwd>chatbot development</kwd>
        <kwd>mHealth</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
