<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "http://dtd.nlm.nih.gov/publishing/2.0/journalpublishing.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" article-type="abstract" dtd-version="2.0">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">IPROC</journal-id>
      <journal-id journal-id-type="nlm-ta">iproc</journal-id>
      <journal-title>Iproceedings</journal-title>
      <issn pub-type="epub">2369-6893</issn>
      <publisher>
        <publisher-name>JMIR Publications</publisher-name>
        <publisher-loc>Toronto, Canada</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
    <article-id pub-id-type="publisher-id">v4i2e11766</article-id>
    <article-id pub-id-type="pmid"/>
    <article-id pub-id-type="doi">10.2196/11766</article-id>
    <article-categories>
      <subj-group subj-group-type="heading">
        <subject>Abstract</subject>
      </subj-group>
      <subj-group subj-group-type="article-type">
        <subject>Abstract</subject>
      </subj-group>
    </article-categories>
    <title-group>
      <article-title>Predicting Obstetric Disease With Machine Learning Applied to Patient-Reported Data</article-title>
    </title-group>
    <contrib-group>
      <contrib contrib-type="editor">
        <name>
          <surname>Hale</surname>
          <given-names>Timothy</given-names>
        </name>
      </contrib>
    </contrib-group>
    <contrib-group>
      <contrib contrib-type="author" id="contrib1" corresp="yes">
      <name name-style="western">
        <surname>Bradley</surname>
        <given-names>Danielle</given-names>
      </name>
      <degrees>MPH, MS</degrees>
      <xref rid="aff1" ref-type="aff">1</xref>
      <address>
        <institution>Ovia Health</institution>
        <addr-line>76 Summer Street</addr-line>
        <addr-line>Boston, MA,</addr-line>
        <country>United States</country>
        <phone>771 1711</phone>
        <email>dani.bradley@oviahealth.com</email>
      </address> </contrib>
      <contrib contrib-type="author" id="contrib2">
        <name name-style="western">
          <surname>Landau</surname>
          <given-names>Erin</given-names>
        </name>
        <xref rid="aff1" ref-type="aff">1</xref>
      </contrib>
      <contrib contrib-type="author" id="contrib3">
        <name name-style="western">
          <surname>Wolfberg</surname>
          <given-names>Adam</given-names>
        </name>
        <degrees>MD, MPH</degrees>
        <xref rid="aff1" ref-type="aff">1</xref>
      </contrib>
      <contrib contrib-type="author" id="contrib4">
        <name name-style="western">
          <surname>Baron</surname>
          <given-names>Alex</given-names>
        </name>
        <degrees>PhD</degrees>
        <xref rid="aff1" ref-type="aff">1</xref>
      </contrib>
    </contrib-group>
    <aff id="aff1">
      <label>1</label>
      <institution>Ovia Health</institution>
      <addr-line>Boston, MA</addr-line>
      <country>United States</country>
    </aff>
    <author-notes>
      <corresp>Corresponding Author: Danielle Bradley 
      <email>dani.bradley@oviahealth.com</email></corresp>
    </author-notes>
    <pub-date pub-type="collection"><season>Jul-Dec</season><year>2018</year></pub-date>
    <pub-date pub-type="epub">
      <day>17</day>
      <month>09</month>
      <year>2018</year>
    </pub-date>
    <volume>4</volume>
    <issue>2</issue>
    <elocation-id>e11766</elocation-id>
    <!--history from ojs - api-xml-->
    <history>
      <date date-type="received">
        <day>1</day>
        <month>8</month>
        <year>2018</year>
      </date>
      <date date-type="accepted">
        <day>29</day>
        <month>8</month>
        <year>2018</year>
      </date>
    </history>
    <!--(c) the authors - correct author names and publication date here if necessary. Date in form ', dd.mm.yyyy' after jmir.org-->
    <copyright-statement>©Danielle Bradley, Erin Landau, Adam Wolfberg, Alex Baron. Originally published in Iproceedings (http://www.iproc.org), 17.09.2018.</copyright-statement>
    <copyright-year>2018</copyright-year>
    <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
      <p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Iproceedings, is properly cited. The complete bibliographic information, a link to the original publication on http://www.iproc.org/, as well as this copyright and license information must be included.</p>
    </license>  
    <self-uri xlink:href="http://www.iproc.org/2018/2/e11766/" xlink:type="simple"/>
    <abstract>
      <sec sec-type="background">
        <title>Background</title>
        <p>The rise of highly engaging digital health mobile apps over the past few years has created repositories containing billions of patient-reported data points that have the potential to inform clinical research and advance medicine.</p>
      </sec>
      <sec sec-type="objective">
        <title>Objective</title>
        <p>To determine if self-reported data could be leveraged to create machine learning algorithms to predict the presence of, or risk for, obstetric outcomes and related conditions.</p>
      </sec>
      <sec sec-type="methods">
        <title>Methods</title>
        <p>More than 10 million women have downloaded Ovia Health’s three mobile apps (Ovia Fertility, Ovia Pregnancy, and Ovia Parenting). Data points logged by app users can include information about menstrual cycle, health history, current health status, nutrition habits, exercise activity, symptoms, or moods. Machine learning algorithms were developed using supervised machine learning methodologies, specifically, Gradient Boosting Decision Tree algorithms. Each algorithm was developed and trained using anywhere from 385 to 5770 features and data from 77,621 to 121,740 app users.</p>
      </sec>
      <sec sec-type="results">
        <title>Results</title>
        <p>Algorithms were created to detect the risk of developing preeclampsia, gestational diabetes, and preterm delivery, as well as to identify the presence of existing preeclampsia. The positive predictive value (PPV) was set to 0.75 for all of the models, as this was the threshold where the researchers felt a clinical response—additional screening or testing—would be reasonable, due to the likelihood of a positive outcome. Sensitivity ranged from 24% to 75% across all models. When PPV was adjusted from 0.75 to 0.52, the sensitivity of the preeclampsia prediction algorithm rose from 24% to 85%. When PPV was adjusted from 0.75 to 0.65, the sensitivity of the preeclampsia detection or diagnostic algorithm increased from 37% to 79%.</p>
      </sec>
      <sec sec-type="conclusions">
        <title>Conclusions</title>
        <p>Algorithms based on patient-reported data can predict serious obstetric conditions with accuracy levels sufficient to guide clinical screening by health care providers and health plans. Further research is needed to determine whether such an approach can improve outcomes for at-risk patients and reduce the cost of screening those not at risk. Presenting the results of these models to patients themselves could also provide important insight into otherwise unknown health risks.</p>
      </sec>
    </abstract>
    <kwd-group>
      <kwd>machine learning</kwd>
      <kwd>mobile health</kwd>
      <kwd>positive predictive value</kwd>
      <kwd>obstetrics</kwd>
    </kwd-group></article-meta>
  </front>
</article>
