<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">HIVMED</journal-id>
<journal-title-group>
<journal-title>Southern African Journal of HIV Medicine</journal-title>
</journal-title-group>
<issn pub-type="ppub">1608-9693</issn>
<issn pub-type="epub">2078-6751</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">HIVMED-22-1197</article-id>
<article-id pub-id-type="doi">10.4102/sajhivmed.v22i1.1197</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Uptake of the Ithaka mobile application in Johannesburg, South Africa, for human immunodeficiency virus self-testing result reporting</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-6882-7245</contrib-id>
<name>
<surname>Fischer</surname>
<given-names>Alex E.</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-6925-0428</contrib-id>
<name>
<surname>Phatsoane</surname>
<given-names>Mothepane</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-0302-5353</contrib-id>
<name>
<surname>Majam</surname>
<given-names>Mohammed</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9231-9155</contrib-id>
<name>
<surname>Shankland</surname>
<given-names>Luke</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2420-6954</contrib-id>
<name>
<surname>Abrahams</surname>
<given-names>Musaed</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-1798-7887</contrib-id>
<name>
<surname>Rhagnath</surname>
<given-names>Naleni</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-3597-1643</contrib-id>
<name>
<surname>Lalla-Edward</surname>
<given-names>Samanta T.</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Ezintsha, Faculty of Health Science, University of the Witwatersrand, Johannesburg, South Africa</aff>
<aff id="AF0002"><label>2</label>Aviro Health, Cape Town, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Alex Fischer, <email xlink:href="fischermhealth@gmail.com">fischermhealth@gmail.com</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>22</day><month>02</month><year>2021</year></pub-date>
<pub-date pub-type="collection"><year>2021</year></pub-date>
<volume>22</volume>
<issue>1</issue>
<elocation-id>1197</elocation-id>
<history>
<date date-type="received"><day>17</day><month>11</month><year>2020</year></date>
<date date-type="accepted"><day>28</day><month>12</month><year>2020</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2021. The Authors</copyright-statement>
<copyright-year>2021</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>Human immunodeficiency virus self-testing (HIVST) can reduce facility-based HIV testing barriers; however, no proven applications exist with widespread uptake for self-reporting or linkage to care. Mobile health (mHealth) applications (apps) have shown high usability and feasibility scores, so Ithaka was developed for South Africans to self-report HIVST results outside clinical settings.</p>
</sec>
<sec id="st2">
<title>Objectives</title>
<p>This study investigated the use of Ithaka as a support tool for HIVST users, specifically the ability to self-report results.</p>
</sec>
<sec id="st3">
<title>Method</title>
<p>This cross-sectional study was conducted from November 2018 to June 2019. At existing HIVST distribution sites, individuals were given HIVST kits and then invited to use Ithaka. Participants could test at home and report their results through the app anytime. Ithaka tracked when people logged-on, registered, received counselling and reported results. Post-study surveys on user experience were also conducted.</p>
</sec>
<sec id="st4">
<title>Results</title>
<p>Of 751 participants, 531 (70.7&#x0025;) logged onto the app, 412 (54.9&#x0025;) registered, 295 (39.3&#x0025;) received counselling and 168 (22.4&#x0025;) self-reported results. Participants strongly agreed that Ithaka was useful and that it was easy to upload results. Forty-one participants completed a post-test survey, and 39/41 (95.1&#x0025;) completed the app journey. Most participants (36/41;87.8&#x0025;) had no challenges, although 2/41 (4.9&#x0025;) cited perceived data costs, 2/41 (4.9&#x0025;) difficulty uploading results and 1/41 (2.4&#x0025;) language, as challenges.</p>
</sec>
<sec id="st5">
<title>Conclusion</title>
<p>Despite the small sample size, this study has shown that HIVST participants under pragmatic conditions were willing and able to self-report results via the app, whilst also identifying areas of improvement for scaling up.</p>
</sec>
</abstract>
<kwd-group>
<kwd>HIV</kwd>
<kwd>HIV self-test</kwd>
<kwd>self-reporting</kwd>
<kwd>mobile app</kwd>
<kwd>mHealth</kwd>
<kwd>monitoring and evaluation</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Background</title>
<p>Human immunodeficiency virus self-testing (HIVST) can reduce barriers associated with conventional facility-based HIV testing, and since its introduction in 2012, more than 6.5 million HIVST kits have been distributed globally.<sup><xref ref-type="bibr" rid="CIT0001">1</xref>,<xref ref-type="bibr" rid="CIT0002">2</xref></sup> In 2018, South Africa integrated HIVST into its national HIV strategy as a way to expand testing beyond standard healthcare facilities to meet the UNAIDS 90-90-90 target.<sup><xref ref-type="bibr" rid="CIT0003">3</xref>,<xref ref-type="bibr" rid="CIT0004">4</xref></sup> These targets state that 90&#x0025;, 81&#x0025; and 73&#x0025; of the total population should know their HIV status, be linked to antiretroviral treatment (ART) and experience viral suppression, respectively.<sup><xref ref-type="bibr" rid="CIT0005">5</xref></sup> Despite the benefits of HIVST, there are some gaps associated with its use, as it is hard to track and is only classified as tests for triage, which should not be considered diagnostic.<sup><xref ref-type="bibr" rid="CIT0006">6</xref></sup></p>
<p>Furthermore, South Africa does not have an appropriate system for users to self-report their results, or be linked to care, and this lack of reporting makes it difficult for public health stakeholders to conduct monitoring and evaluation on the uptake and effectiveness of HIVST, especially at the population level.<sup><xref ref-type="bibr" rid="CIT0007">7</xref></sup></p>
<p>Over the last decade, low- and middle-income countries have experienced an increase in mobile coverage and smartphone use, which has qualified the introduction of mobile health (mHealth) interventions in these regions.<sup><xref ref-type="bibr" rid="CIT0008">8</xref>,<xref ref-type="bibr" rid="CIT0009">9</xref>,<xref ref-type="bibr" rid="CIT0010">10</xref></sup></p>
<p>There is a strong body of evidence supporting the use of mHealth interventions to enhance patient outcomes for a broad spectrum of health conditions, including HIV. In low-income settings specifically, different interventions have targeted various stages of the HIV care cascade, including text message campaigns, telephone hotlines and mobile applications (apps).<sup><xref ref-type="bibr" rid="CIT0006">6</xref>,<xref ref-type="bibr" rid="CIT0011">11</xref>,<xref ref-type="bibr" rid="CIT0012">12</xref>,<xref ref-type="bibr" rid="CIT0013">13</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref></sup></p>
<p>South Africa has been investigating the use of mHealth interventions to accompany HIVST for users to self-report their results, and in a recent study, 9.8&#x0025; of participants self-reported their results by using an interactive voice response telephone hotline.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> Feasibility studies have also been done on the HIVSmart! app and the Aspect<sup>TM</sup> app; both mobile apps guide self-testers through the testing and reporting process. These apps were both tested in a clinical setting, under the observation of healthcare workers (HCWs), and whilst both the apps reported high usability and acceptability, they did not investigate the reporting of results in a non-clinical setting as an outcome.<sup><xref ref-type="bibr" rid="CIT0016">16</xref>,<xref ref-type="bibr" rid="CIT0017">17</xref>,<xref ref-type="bibr" rid="CIT0018">18</xref>,<xref ref-type="bibr" rid="CIT0019">19</xref></sup></p>
<p>The Ithaka app (Aviro Health, Cape Town, South Africa) has been developed to close this gap by providing untrained HIVST users a mobile platform to self-report their HIVST results independent of a formal clinical setting, whilst also removing the potential for observational bias. The objective of this study was to investigate the use of Ithaka as an HIVST support tool for individuals, specifically the ability to report self-results outside a clinical environment.</p>
</sec>
<sec id="s0002">
<title>Methods</title>
<sec id="s20003">
<title>Study design</title>
<p>This was a cross-sectional evaluation conducted from November 2018 to June 2019 with a random sample of 751 consenting adults from the general population of inner-city Johannesburg, South Africa. People who received an HIVST kit were invited to participate in the study. As per the HIVST programme, requirements to receive an HIVST kit were if they had willingness to perform an HIVST, had not tested for HIV in the previous 3 months, had a mobile phone compatible with the app, were 18 years or older, were able to read English and were able to provide written informed consent. Participants were excluded if they were known to be living with HIV, were a practising HCW or if they were taking drugs that could affect the sensitivity of the test, such as pre-exposure prophylaxis, ART or an experimental HIV vaccine. Before the study, a 2-week pilot period that included 41 people was used to improve operational issues, refine the content and user experience of the app and confirm the linkage between the data collection and data analysis datasets.</p>
</sec>
<sec id="s20004">
<title>App development</title>
<p>The Ithaka self-test support tool is a mobile phone-based tool to support users through self-testing and eventual confirmatory testing. It is a Progressive Web App (PWA), which is accessible as a reverse-billed mobi-site, where the provider pays any data costs, rendering the tool free to end users. The Ithaka platform provides users with a tailored journey to encourage user retention, reporting and linkage to care, as well as gamification to boost user engagement. Ithaka guides the patients through the various testing steps and will prompt the users to report back on their status, progress, emotional state, information comprehension and user satisfaction. Before conducting the self-test, users must complete a brief counselling component that explains the test process, and what to expect after obtaining the results; however, if users want more information, they can access integrated chat-based help at any time, or request a call back from a call centre. In the event of a positive HIV result, the study participant is referred for clinical treatment and care, whilst participants who test negative will be counselled and encouraged to seek confirmatory testing at 3 months.</p>
<p>The Ithaka platform is secure, with unique user profile logins and encrypted back-end databases to ensure data security and patient anonymity in line with the Protection of Personal Information (POPI) guidelines.<sup><xref ref-type="bibr" rid="CIT0020">20</xref></sup> Furthermore, stakeholders can receive real-time data on how users are engaging with the materials and platform. Screenshots of Ithaka are presented in <xref ref-type="fig" rid="F0001">Figure 1</xref>.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>Ithaka screenshots.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="HIVMED-22-1197-g001.tif"/>
</fig>
</sec>
<sec id="s20005">
<title>Data collection</title>
<p>HIV Self-Testing Africa (HSTAR) is an HIVST distribution and research programme that supplies free OraQuick&#x00AE; Rapid HIV Self-Test (Orasure Technologies, Bethlehem, USA) to people in Region F of Johannesburg, South Africa, through fixed-point distribution sites. These sites were also used to recruit participants for the Ithaka study. To collect a random sample and minimise disruption to the regular HSTAR programme (since recruitment was being performed by the distribution team), one random day each week was used to recruit participants for the Ithaka study. After an individual received their self-test, peer educators invited them to participate in the Ithaka study. No additional log was maintained to document individuals who declined to participate.</p>
<p>If an individual showed interest, the peer educator provided detailed information on the Ithaka study and obtained a written informed consent prior to administering the pre-survey questionnaire. The peer educator helped the participant log into and register on the app on the participant&#x2019;s phone, which was available through a uniform resource locator (URL).</p>
<p>Data were collected from three sources as follows:</p>
<list list-type="order">
<list-item><p><bold>Pre-study survey</bold>: An in-person survey was conducted by peer educators to capture demographic information, including age, education, shared phone, gender and location.</p></list-item>
<list-item><p><bold>Ithaka platform</bold>: The app tracked user engagement marked by logging on, registering, receiving counselling and reporting results.</p></list-item>
<list-item><p><bold>Post-study survey</bold>: A telephone survey was conducted to obtain user feedback on the app, which included Likert-scale questions ([1] strongly disagree; [2] disagree; [3] neither agree nor disagree; [4] agree; [5] strongly agree) and open-ended questions. The Likert scale was used to understand the user experience of Ithaka (asking ratings on usefulness, ease of use, empowering, trustworthiness, ease of understanding and reliability), and whether it decreased barriers to report results, find a clinic, read frequently asked questions (FAQs), get reminders and make referrals. Participants were asked open-ended questions regarding their discontinued usage of the app, challenges using the app and if they would recommend it to a friend (<xref ref-type="app" rid="app001">Appendix 1</xref>). All participants were invited to participate in the post-study survey via a phone call to the number they had provided. Participants were eligible to participate if they provided consent and had completed the app journey, making it to the final reporting results stage, and answered all survey questions.</p></list-item>
</list>
</sec>
<sec id="s20006">
<title>Data analysis</title>
<p>Data from the surveys and Ithaka database were cleaned in Excel (Microsoft, Seattle, USA) and then exported to Stata V.14 (StataCorp, College Station, USA) for analysis. Demographic information and questions about app usage were described with frequency and percentages. User flow through the app was tracked and then presented with frequency and percentage through each stage. Likert scores were averaged and presented as a number between 1 and 5, with numbers approaching five representing favourable outcomes.</p>
</sec>
<sec id="s20007">
<title>Ethical consideration and approval</title>
<p>Ethics approval was obtained from the Human Research Ethics Committee of the University of the Witwatersrand, reference number: 180708. All participants provided written informed consent. The app was made available as a reverse-billed site, so participants did not incur data costs, but participants were provided no reimbursements for their time in the study.</p>
</sec>
</sec>
<sec id="s0008">
<title>Results</title>
<sec id="s20009">
<title>Demographics</title>
<p>A total of 751 people participated in the study. Nearly half of the participants, 340 (45.3&#x0025;), were between the ages of 26 and 35 years, a third were 25 years old or below, 231 (30.8&#x0025;) and about a quarter above were 35 years of age, 175 (23.3&#x0025;). Four hundred and thirty-one (57.4&#x0025;) participants were female, and 634 (84.4&#x0025;) did not share mobile phones with anyone. Only 3 (0.4&#x0025;) participants had a primary school education, 444 (59.1&#x0025;) had a secondary school education and 203 (27.0&#x0025;) had a tertiary school education, or higher. The complete demographic characteristics are presented in <xref ref-type="table" rid="T0001">Table 1</xref>.</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Demographic characteristics.</p></caption>
<table frame="hsides" rules="groups">
<thead valign="top">
<tr>
<th align="left">Demographics</th>
<th align="center">Frequency (<italic>n</italic> = 751)</th>
<th align="center">Percentage<xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref> (&#x0025;)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" colspan="3"><bold>Age (years)</bold></td>
</tr>
<tr>
<td align="left">18&#x2013;25</td>
<td align="center">231</td>
<td align="center">30.8</td>
</tr>
<tr>
<td align="left">26&#x2013;35</td>
<td align="center">339</td>
<td align="center">45.1</td>
</tr>
<tr>
<td align="left">Over 35</td>
<td align="center">175</td>
<td align="center">23.3</td>
</tr>
<tr>
<td align="left">Not answered</td>
<td align="center">6</td>
<td align="center">0.8</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Sex</bold></td>
</tr>
<tr>
<td align="left">Female</td>
<td align="center">431</td>
<td align="center">57.4</td>
</tr>
<tr>
<td align="left">Male</td>
<td align="center">318</td>
<td align="center">42.3</td>
</tr>
<tr>
<td align="left">Not answered</td>
<td align="center">2</td>
<td align="center">0.3</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Highest level of education</bold></td>
</tr>
<tr>
<td align="left">None</td>
<td align="center">4</td>
<td align="center">0.5</td>
</tr>
<tr>
<td align="left">Primary school education</td>
<td align="center">3</td>
<td align="center">0.4</td>
</tr>
<tr>
<td align="left">Secondary school education</td>
<td align="center">444</td>
<td align="center">59.1</td>
</tr>
<tr>
<td align="left">Tertiary school education</td>
<td align="center">203</td>
<td align="center">27.0</td>
</tr>
<tr>
<td align="left">Not answered education</td>
<td align="center">97</td>
<td align="center">12.9</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Do you share a phone?</bold></td>
</tr>
<tr>
<td align="left">No</td>
<td align="center">634</td>
<td align="center">84.4</td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="center">74</td>
<td align="center">9.9</td>
</tr>
<tr>
<td align="left">Not answered</td>
<td align="center">43</td>
<td align="center">5.7</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>n</italic>, number.</p></fn>
<fn id="TFN0001"><p>Note: &#x2020;, The percentages may not add up to 100.0&#x0025; because of rounding.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s20010">
<title>Ithaka use</title>
<p><xref ref-type="fig" rid="F0002">Figure 2</xref> shows the cascade of Ithaka use from the point of enrolment to reporting HIV results. Approximately, three quarters, 531 (70.7&#x0025;), logged on to the app. More than half the enrolled participants, 412 (54.9&#x0025;), completed the registration process, 295 (39.3&#x0025;) enrolled participants completed the pre-test counselling and the how-to-test instructions and 168 (22.4&#x0025;) enrolled participants self-reported their results. Of the 168 participants who self-reported their results, 14 (8.3&#x0025;) reported as HIV positive.</p>
<fig id="F0002">
<label>FIGURE 2</label>
<caption><p>User journey through Ithaka: November 2018 to June 2019.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="HIVMED-22-1197-g002.tif"/>
</fig>
</sec>
<sec id="s20011">
<title>Ithaka user experience</title>
<p>Of the 336 participants who were successfully contacted for the post-test telephone survey, consent to participate was provided by 190 (56.5&#x0025;) participants, although only 112 (33.3&#x0025;) were eligible for the post-study survey, and 41 (37.3&#x0025;) completed the entire survey. To quantify the user experience, mean Likert scores approaching five represented strong agreement with the statement, whereas scores approaching one represented strong disagreement with the statement. The two statements, <italic>Ithaka made it easy to upload results</italic> and <italic>Ithaka made it easy to find a clinic</italic> had mean Likert scores of 3.8 (SD = 1.6) and 4.2 (SD = 0.9), respectively. All other user experience statements were strongly agreed with, receiving ratings that were above or equal to 4.5 (SD = 0.5&#x2013;0.7). The mean Likert scores are presented with standard deviations (SDs) in <xref ref-type="table" rid="T0002">Table 2</xref>.</p>
<table-wrap id="T0002">
<label>TABLE 2</label>
<caption><p>Mean Likert scores for user experience.</p></caption>
<table frame="hsides" rules="groups">
<thead valign="top">
<tr>
<th align="left">Outcome</th>
<th align="center">Mean Likert score (<italic>n</italic> = 41)</th>
<th align="center">SD</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Overall, Ithaka was useful.</td>
<td align="center">4.7</td>
<td align="center">0.6</td>
</tr>
<tr>
<td align="left">Overall, Ithaka was easy to use.</td>
<td align="center">4.7</td>
<td align="center">0.6</td>
</tr>
<tr>
<td align="left">Overall, Ithaka made you feel enabled.</td>
<td align="center">4.7</td>
<td align="center">0.6</td>
</tr>
<tr>
<td align="left">Overall, you trusted Ithaka.</td>
<td align="center">4.7</td>
<td align="center">0.5</td>
</tr>
<tr>
<td align="left">Ithaka made it easy to upload results.</td>
<td align="center">3.8</td>
<td align="center">1.6</td>
</tr>
<tr>
<td align="left">Ithaka made it easy to find a clinic.</td>
<td align="center">4.2</td>
<td align="center">0.9</td>
</tr>
<tr>
<td align="left">The app language was easy to understand.</td>
<td align="center">4.6</td>
<td align="center">0.5</td>
</tr>
<tr>
<td align="left">The information in the app was reliable.</td>
<td align="center">4.6</td>
<td align="center">0.7</td>
</tr>
<tr>
<td align="left">The FAQs were helpful.</td>
<td align="center">4.5</td>
<td align="center">0.7</td>
</tr>
<tr>
<td align="left">The reminder and referral functions were useful.</td>
<td align="center">4.5</td>
<td align="center">0.6</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>n</italic>, sample size; SD, standard deviation; FAQs, frequently asked questions.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>When participants were asked why they had stopped using the app, 39/41 (95.1&#x0025;) respondents stated that they used the app to completion, whilst two (4.9&#x0025;) stated that they stopped because they were unable to upload their HIVST results. All 41/41 (100.0&#x0025;) participants who responded stated that they would recommend the app to someone else, with respondents citing ease of use 12/41 (29.3&#x0025;), liking the app 4/41 (9.8&#x0025;) and privacy 2/41 (4.9&#x0025;) as the main reasons for why they would recommend it to someone else. Most of the respondents, 36/41 (87.8&#x0025;) stated that they did not experience any challenges or difficulties whilst using the app; however, 2/41 (4.9&#x0025;) respondents cited data costs as a challenge, 2/41 (4.9&#x0025;) respondents stated that they had difficulty uploading results and 1/41 (2.4&#x0025;) respondent stated that he or she had experienced challenges because of the app languages. All user experience questions are presented in <xref ref-type="table" rid="T0003">Table 3</xref>.</p>
<table-wrap id="T0003">
<label>TABLE 3</label>
<caption><p>Open-ended user experience questions.</p></caption>
<table frame="hsides" rules="groups">
<thead valign="top">
<tr>
<th align="left">Question</th>
<th align="center">Frequency</th>
<th align="center">Percentage<xref ref-type="table-fn" rid="TFN0002">&#x2020;</xref></th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" colspan="3"><bold>Why did you stop using the app? (<italic>n</italic> = 41)</bold></td>
</tr>
<tr>
<td align="left">Completed the survey at the end</td>
<td align="center">39</td>
<td align="center">95.1</td>
</tr>
<tr>
<td align="left">Failed to upload results</td>
<td align="center">2</td>
<td align="center">4.9</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Would you recommend this app to someone else? (<italic>n</italic> = 41)</bold></td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="center">41</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">No</td>
<td align="center">0</td>
<td align="center">0.0</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Why would you recommend this app to someone else? (<italic>n</italic> = 41)</bold></td>
</tr>
<tr>
<td align="left">Easy to use</td>
<td align="center">12</td>
<td align="center">29.3</td>
</tr>
<tr>
<td align="left">Liked the app</td>
<td align="center">4</td>
<td align="center">9.8</td>
</tr>
<tr>
<td align="left">Privacy</td>
<td align="center">2</td>
<td align="center">4.9</td>
</tr>
<tr>
<td align="left">Provides education</td>
<td align="center">1</td>
<td align="center">2.4</td>
</tr>
<tr>
<td align="left">Language easy to understand</td>
<td align="center">1</td>
<td align="center">2.4</td>
</tr>
<tr>
<td align="left">Reliable</td>
<td align="center">1</td>
<td align="center">2.4</td>
</tr>
<tr>
<td align="left">Low data cost</td>
<td align="center">1</td>
<td align="center">2.4</td>
</tr>
<tr>
<td align="left">No specific reason</td>
<td align="center">19</td>
<td align="center">46.3</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>What was the biggest challenge whilst using the app? (<italic>n</italic> = 41)</bold></td>
</tr>
<tr>
<td align="left">No challenge</td>
<td align="center">36</td>
<td align="center">87.8</td>
</tr>
<tr>
<td align="left">Language</td>
<td align="center">1</td>
<td align="center">2.4</td>
</tr>
<tr>
<td align="left">Data costs</td>
<td align="center">2</td>
<td align="center">4.9</td>
</tr>
<tr>
<td align="left">Uploading results</td>
<td align="center">2</td>
<td align="center">4.9</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p><italic>n</italic>, number.</p></fn>
<fn id="TFN0002"><p>Note: &#x2020;, Percentages may not add up to 100.0&#x0025; because of rounding.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec id="s0012">
<title>Discussion</title>
<p>To our knowledge, this is the first study in South Africa to evaluate the use of an mHealth app to self-report HIVST results as an outcome, independent of observation in a clinical setting. Previous feasibility studies have shown high acceptance of mHealth apps for the monitoring and evaluation of HIVSTs; however, they only evaluated usability in the presence of HCWs and did not evaluate any reporting outcomes through the app.<sup><xref ref-type="bibr" rid="CIT0016">16</xref>,<xref ref-type="bibr" rid="CIT0017">17</xref>,<xref ref-type="bibr" rid="CIT0018">18</xref>,<xref ref-type="bibr" rid="CIT0019">19</xref></sup></p>
<p>Similar to these previous studies, the Ithaka app showed high self-reported usability amongst those interviewed, whilst also confirming that participants under real-world conditions were willing and able to self-report their results via the app. The self-reporting of results by logged on participants through the Ithaka app was 22.4&#x0025;, which is acceptable, considering that it is common for apps to lose up to 80&#x0025; of their active users in the first week.<sup><xref ref-type="bibr" rid="CIT0021">21</xref></sup></p>
<p>Furthermore, the percentage of HIVST results reported through Ithaka was more than twice that of a previous tele-health intervention in South Africa, which only led to 9.8&#x0025; of participants self-reporting.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup></p>
<p>Despite this increase in self-reporting and high usability Likert scores, 43.1&#x0025; of participants who received counselling (a proxy for completing the self-test) still did not self-report their HIVST results, which leaves opportunity for improvement. Although field testing of Ithaka followed a 3-month human-centred design (including personal and journey mapping) and a 2-week pilot testing, a percentage (12.2&#x0025;) of surveyed participants did experience challenges with the Ithaka platform. This not only suggests that users may need more than a brief introduction from a peer educator but also suggests that the technology development phase requires several iterations with greater consideration for pragmatic value propositions and testing of varied content or messaging before inclusion. Going forward, focus group or follow-up interviews with participants who did not complete the app journey could be conducted to further identify areas of improvement that caused participants to cease activity on the app.</p>
<p>Similar to reports of other South African digital health interventions, for users to completely embrace Ithaka and realise its full use, marketing campaigns can be used to create awareness, followed by a more comprehensive onboarding to motivate users.<sup><xref ref-type="bibr" rid="CIT0022">22</xref></sup> Although practical reasons for stopping the use of the app, such as forgetting to log back in or not using the test yet, should be mitigated with text message reminders, which have been shown to improve the user responsiveness of other mHealth apps,<sup><xref ref-type="bibr" rid="CIT0023">23</xref>,<xref ref-type="bibr" rid="CIT0024">24</xref>,<xref ref-type="bibr" rid="CIT0025">25</xref></sup> we did not find this in our study in which registered participants received reminder messages on day 1 and day 7. Some participants cited data costs and network issues as challenges to the app, and these are well-documented barriers for any mHealth app to enter into the South African market;<sup><xref ref-type="bibr" rid="CIT0006">6</xref>,<xref ref-type="bibr" rid="CIT0022">22</xref></sup> however, Ithaka was a reverse-billed online platform that removed the barrier of data costs. As a reverse-billed platform, any and all data costs for using the platform are paid for by the service provider (Ithaka), and the end-users do not incur any costs, nor do they use any of their own data whilst on the platform.</p>
<p>There may have been some confusion by study participants regarding the meaning of reverse-billing, and this beneficial feature should be sufficiently explained to users in the future, so they know that no costs are incurred on their end whilst using the platform.</p>
<p>In South Africa, there is currently no endorsed platform for users to self-report their HIVST results, or be linked to care following a positive test,<sup><xref ref-type="bibr" rid="CIT0006">6</xref></sup> which makes the monitoring and evaluation very ineffective for the government and associated public health stakeholders.<sup><xref ref-type="bibr" rid="CIT0007">7</xref></sup> This study has shown that as a proof-of-concept, HIVST users are willing and able to self-report their HIVST results via the Ithaka app, and this sharing of information on a national scale could greatly improve HIVST monitoring and evaluation.</p>
<p>Whilst this study focussed on self-testing, which directly addresses the gap between the first 90 and the 85&#x0025; of HIV-positive South Africans who know their status, it does not address the country&#x2019;s largest deficit, as only 71&#x0025; of people who are eligible for ART are actively receiving treatment.<sup><xref ref-type="bibr" rid="CIT0026">26</xref></sup> Ithaka could continue to increase active users by sending out reminders to encourage the self-reporting of results and keep users engaged by promoting linkage to care opportunities. To improve accessibility and usability, the Ithaka platform has since been extended to WhatsApp and to support blood-based tests. The Ithaka platform has also undergone a number of processes and content changes that were implemented as a way to continue improving on the HIVST reporting rate. In addition, extensions to the tool to support and confirm linkages to care and improve initiation and viral load suppression are currently undergoing piloting and development.</p>
</sec>
<sec id="s0013">
<title>Limitations</title>
<p>This study presented some limitations. Participants were recruited through existing HIVST distribution points, so individuals may have had previous exposure to HIVST studies, and potential study fatigue may have influenced their willingness to participate. Because of this exposure, participants may have a greater base-level background knowledge of HIVST than the general population. The Ithaka app was only available to individuals with mobile phones capable of running the current iteration of the app and does not include individuals who could not access the app because of different operating systems or memory capacity. Furthermore, a peer educator helped participants log into and register on the app, which may have influenced the ease of use and initial components of the cascade.</p>
<p>The use of only one HIVST kit means that these results also cannot be generalised across all HIVST kits.</p>
<p>Additionally, only 8.3&#x0025; of participants self-reported an HIV-positive result, which is much lower than the national prevalence of 13.1&#x0025;, and this may be because of a selection or reporting bias, where individuals who may be HIV positive did not participate or report their positive results. The views presented of the user experience responses may not represent the views of the study population as only participants who completed the app journey and answered all questions were included in the post-study survey results. The low completion rate for some of the survey questions represents a minority of the group and a larger minority in relation to the general population.</p>
<p>Lastly, the post-test survey was conducted via voice call, which may have attributed to this low completion rate.</p>
</sec>
<sec id="s0014">
<title>Conclusion</title>
<p>Millions of HIVST kits have been distributed globally; however, there is currently no universally accepted platform for users to self-report their HIVST results, health behaviour and outcomes in line with the HIV care cascade. This study has shown that HIVST users outside the clinical setting were willing and able to self-report their results via the app. This could be used on a national level to improve the monitoring and reporting of HIVST programmes, leading to the optimisation of kit distribution, and targeted marketing and support. The use of an app introduces the possibility to promote and improve linkage to care, counselling and follow-up for newly tested HIV-positive users. This, together with exploring other popular channels for making digital services available such as WhatsApp, needs to be explored further to ultimately enable the development of an app that is user friendly, cost efficient and beneficial to HIV programmes.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>The authors would like to acknowledge all study participants.</p>
<sec id="s20015" sec-type="COI-statement">
<title>Competing interests</title>
<p>L.S. and M.A. work for Aviro Health and were involved in the design of the Ithaka HIVST app.</p>
</sec>
<sec id="s20016">
<title>Authors&#x2019; contributions</title>
<p>L.S., M.A., N.R., M.P. and M.M. designed the study. L.S., M.A., N.R. and M.P. collected data, L.S., N.R., M.P., S.T.L.-E. and A.E.F. were involved in the data cleaning and analysis and A.E.F., S.T.L.-E., M.P. and L.S. wrote the initial draft of the manuscript. All authors critically reviewed and approved the final draft.</p>
</sec>
<sec id="s20017">
<title>Funding information</title>
<p>This study was funded by the Bill and Melinda Gates Foundation (grant number OPP1189095) and UNITAID STAR (Grant number Unitaid-2017-17-SFH-STAR).</p>
</sec>
<sec id="s20018">
<title>Data availability</title>
<p>The data that support the findings of this study are available from the corresponding author, A.E.F., upon reasonable request.</p>
</sec>
<sec id="s20019">
<title>Disclaimer</title>
<p>The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><label>1.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wong</surname> <given-names>V</given-names></string-name>, <string-name><surname>Jenkins</surname> <given-names>E</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>N</given-names></string-name>, <string-name><surname>Ingold</surname> <given-names>H</given-names></string-name></person-group>. <article-title>To thine own test be true: HIV self-testing and the global reach for the undiagnosed</article-title>. <source>J Int AIDS Soc</source>. <year>2019</year>;<volume>22</volume>(<issue>S1</issue>):<fpage>e25256</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/jia2.25256">https://doi.org/10.1002/jia2.25256</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Figueroa</surname> <given-names>C</given-names></string-name>, <string-name><surname>Johnson</surname> <given-names>C</given-names></string-name>, <string-name><surname>Verster</surname> <given-names>A</given-names></string-name>, <string-name><surname>Baggaley</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Attitudes and acceptability on HIV self-testing among key populations: A literature review</article-title>. <source>AIDS Behav</source>. <year>2015</year>;<volume>19</volume>:<fpage>1949</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10461-015-1097-8">https://doi.org/10.1007/s10461-015-1097-8</ext-link></comment></mixed-citation></ref>
<ref id="CIT0003"><label>3.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Unitaid, World Health Organization</collab></person-group>. <source>Market and technology landscape: HIV rapid diagnostic tests for self-testing</source>. <edition>4th</edition> ed. <publisher-loc>Geneva</publisher-loc>: <publisher-name>Unitaid</publisher-name>; <year>2018</year>.</mixed-citation></ref>
<ref id="CIT0004"><label>4.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>National Department of Health South Africa</collab></person-group>. <source>National HIV self-screening guidelines 2018</source>. <publisher-loc>Pretoria</publisher-loc>; <publisher-name>Department of Health Republic of South Africa</publisher-name>; <year>2018</year>.</mixed-citation></ref>
<ref id="CIT0005"><label>5.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>UNAIDS</collab></person-group>. <source>Ending AIDS, progress towards the 90-90-90 targets</source>. <publisher-loc>Geneva</publisher-loc>: <publisher-name>UNAIDS</publisher-name>; <year>2017</year>.</mixed-citation></ref>
<ref id="CIT0006"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Venter</surname> <given-names>F</given-names></string-name>, <string-name><surname>Majam</surname> <given-names>M</given-names></string-name>, <string-name><surname>Jankelowitz</surname></string-name>, <etal>et al</etal></person-group>. <article-title>Guidelines: South African HIV self-testing policy and guidance considerations</article-title>. <source>S Afr J HIV Med</source>. <year>2017</year>;<volume>18</volume>(<issue>1</issue>):<fpage>775</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajhivmed.v18i1.775">https://doi.org/10.4102/sajhivmed.v18i1.775</ext-link></comment></mixed-citation></ref>
<ref id="CIT0007"><label>7.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Morgan</surname> <given-names>G</given-names></string-name>, <string-name><surname>Konopka</surname> <given-names>S</given-names></string-name></person-group>. <source>mHealth compendium: Volume 2</source>. <publisher-loc>Arlington, VA</publisher-loc>: <publisher-name>African Strategies for Health Project, Management Sciences for Health</publisher-name>; <year>2013</year>.</mixed-citation></ref>
<ref id="CIT0008"><label>8.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>GSMA</collab></person-group>. <source>The mobile economy sub-Saharan Africa</source>. <publisher-loc>London</publisher-loc>: <publisher-name>GMSA</publisher-name>; <year>2017</year>.</mixed-citation></ref>
<ref id="CIT0009"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wedderburn</surname> <given-names>CJ</given-names></string-name>, <string-name><surname>Murtagh</surname> <given-names>M</given-names></string-name>, <string-name><surname>Toskin</surname> <given-names>I</given-names></string-name>, <string-name><surname>Peeling</surname> <given-names>RW</given-names></string-name></person-group>. <article-title>Using electronic readers to monitor progress toward elimination of mother-to-child transmission of HIV and syphilis: An opinion piece</article-title>. <source>Int J Gynecol Obstet</source>. <year>2015</year>;<volume>130</volume>(<supplement>S1</supplement>):<fpage>S81</fpage>&#x2013;<lpage>S83</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.ijgo.2015.04.006">https://doi.org/10.1016/j.ijgo.2015.04.006</ext-link></comment></mixed-citation></ref>
<ref id="CIT0010"><label>10.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mokgatle</surname> <given-names>MM</given-names></string-name>, <string-name><surname>Madiba</surname> <given-names>S</given-names></string-name></person-group>. <article-title>High acceptability of HIV self-testing among technical vocational education and training college students in Gauteng and North West province: What are the implications for the scale up in South Africa?</article-title> <source>PLoS One</source>. <year>2017</year>;<volume>12</volume>(<issue>1</issue>):<fpage>e0169765</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0169765">https://doi.org/10.1371/journal.pone.0169765</ext-link></comment></mixed-citation></ref>
<ref id="CIT0011"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lester</surname> <given-names>RT</given-names></string-name>, <string-name><surname>Ritvo</surname> <given-names>P</given-names></string-name>, <string-name><surname>Mills</surname> <given-names>EJ</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): A randomised trial</article-title>. <source>Lancet</source>. <year>2010</year>;<volume>376</volume>(<issue>9755</issue>):<fpage>1838</fpage>&#x2013;<lpage>1845</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S0140-6736(10)61997-6">https://doi.org/10.1016/S0140-6736(10)61997-6</ext-link></comment></mixed-citation></ref>
<ref id="CIT0012"><label>12.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pop-Eleches</surname> <given-names>C</given-names></string-name>, <string-name><surname>Thirumurthy</surname> <given-names>H</given-names></string-name>, <string-name><surname>Habyarimana</surname> <given-names>JP</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: A randomized controlled trial of text message reminders</article-title>. <source>AIDS</source>. <year>2011</year>;<volume>25</volume>(<issue>6</issue>):<fpage>825</fpage>&#x2013;<lpage>834</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/QAD.0b013e32834380c1">https://doi.org/10.1097/QAD.0b013e32834380c1</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><label>13.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Muessig</surname> <given-names>KE</given-names></string-name>, <string-name><surname>Pike</surname> <given-names>EC</given-names></string-name>, <string-name><surname>Legrand</surname> <given-names>S</given-names></string-name>, <string-name><surname>Hightow-Weidman</surname> <given-names>LB</given-names></string-name></person-group>. <article-title>Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: A review</article-title>. <source>J Med Internet Res</source>. <year>2013</year>;<volume>15</volume>(<issue>1</issue>):<fpage>e1</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2196/jmir.2301">https://doi.org/10.2196/jmir.2301</ext-link></comment></mixed-citation></ref>
<ref id="CIT0014"><label>14.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kanters</surname> <given-names>S</given-names></string-name>, <string-name><surname>Park</surname> <given-names>JJH</given-names></string-name>, <string-name><surname>Chan</surname> <given-names>K</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Interventions to improve adherence to antiretroviral therapy: A systematic review and network meta-analysis</article-title>. <source>Lancet HIV</source>. <year>2017</year>;<volume>4</volume>(<issue>1</issue>):<fpage>e31</fpage>&#x2013;<lpage>e40</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S2352-3018(16)30206-5">https://doi.org/10.1016/S2352-3018(16)30206-5</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><label>15.</label><mixed-citation publication-type="conference"><person-group person-group-type="author"><string-name><surname>Majam</surname> <given-names>M</given-names></string-name>, <string-name><surname>Quaife</surname> <given-names>M</given-names></string-name>, <string-name><surname>Phatsoane</surname> <given-names>M</given-names></string-name>, <string-name><surname>Rhagnath</surname> <given-names>N</given-names></string-name>, <string-name><surname>Venter</surname> <given-names>F</given-names></string-name></person-group>. <article-title>High self-reporting of HIV self-test results through an interactive voice response telephone line in inner city Johannesburg</article-title>. <conf-name>Poster session presented at: IAS Conference on HIV Science</conf-name>, <conf-loc>Mexico</conf-loc>; <conf-date>2019 Jul 21&#x2013;24</conf-date>.</mixed-citation></ref>
<ref id="CIT0016"><label>16.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pai</surname> <given-names>NP</given-names></string-name>, <string-name><surname>Behlim</surname> <given-names>T</given-names></string-name>, <string-name><surname>Abrahams</surname> <given-names>L</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Will an unsupervised self-testing strategy for HIV work in health care workers of South Africa? A cross sectional pilot feasibility study</article-title>. <source>PLoS One</source>. <year>2013</year>;<volume>8</volume>(<issue>11</issue>):<fpage>e79772</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0079772">https://doi.org/10.1371/journal.pone.0079772</ext-link></comment></mixed-citation></ref>
<ref id="CIT0017"><label>17.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pai</surname> <given-names>PN</given-names></string-name>, <string-name><surname>Smallwood</surname> <given-names>M</given-names></string-name>, <string-name><surname>Desjardins</surname> <given-names>L</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>An unsupervised smart app-optimized HIV self-testing program in Montreal, Canada: Cross-sectional study</article-title>. <source>J Med Internet Res</source>. <year>2018</year>;<volume>20</volume>(<issue>11</issue>):<fpage>e10258</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2196/10258">https://doi.org/10.2196/10258</ext-link></comment></mixed-citation></ref>
<ref id="CIT0018"><label>18.</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>McGill University Health Centre Foundation</collab></person-group>. <source>HIV smart app [homepage on the Internet]</source>. <year>2016</year> <comment>[cited 2020 Mar 18]. Available from: <ext-link ext-link-type="uri" xlink:href="https://www.muhcfoundation.com/current-projects/hiv-smart-app/">https://www.muhcfoundation.com/current-projects/hiv-smart-app/</ext-link></comment></mixed-citation></ref>
<ref id="CIT0019"><label>19.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gous</surname> <given-names>N</given-names></string-name>, <string-name><surname>Fischer</surname> <given-names>A</given-names></string-name>, <string-name><surname>Rhagnath</surname> <given-names>N</given-names></string-name>, <string-name><surname>Phatsoane</surname> <given-names>M</given-names></string-name>, <string-name><surname>Majam</surname> <given-names>M</given-names></string-name>, <string-name><surname>Lalla-Edward</surname> <given-names>ST</given-names></string-name></person-group>. <article-title>Feasibility and acceptability of a mobile application to support HIV self-testing in Johannesburg, South Africa: A pilot study</article-title>. <source>S Afr J HIV Med</source>. <year>2020</year>;<volume>21</volume>(<issue>1</issue>):<fpage>a1088</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajhivmed.v21i1.1088">https://doi.org/10.4102/sajhivmed.v21i1.1088</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><label>20.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Republic of South Africa</collab></person-group>. <source>Government Gazette, Act no 4 of 2013: Protection of Personal Information Act, 2013</source>. <publisher-loc>Cape Town</publisher-loc>: <publisher-name>The South African Government</publisher-name>; <year>2013</year>.</mixed-citation></ref>
<ref id="CIT0021"><label>21.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sigg</surname> <given-names>S</given-names></string-name>, <string-name><surname>Lagerspetz</surname> <given-names>E</given-names></string-name>, <string-name><surname>Peltonen</surname> <given-names>E</given-names></string-name>, <string-name><surname>Nurmi</surname> <given-names>P</given-names></string-name>, <string-name><surname>Tarkoma</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Sovereignty of the apps: There&#x2019;s more to relevance than downloads</article-title>. <source>Cornell University: Comput Soc</source>. <year>2016</year>:<volume>arXiv</volume>:<fpage>1611.10161</fpage>.</mixed-citation></ref>
<ref id="CIT0022"><label>22.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Seebregts</surname> <given-names>C</given-names></string-name>, <string-name><surname>Dane</surname> <given-names>P</given-names></string-name>, <string-name><surname>Parsons</surname> <given-names>AN</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Designing for scale: Optimising the health information system architecture for mobile maternal health messaging in South Africa (MomConnect)</article-title>. <source>Br Med J Glob Health</source>. <year>2018</year>;<volume>3</volume>(<supplement>Suppl 2</supplement>):<fpage>e000563</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1136/bmjgh-2017-000563">https://doi.org/10.1136/bmjgh-2017-000563</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><label>23.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mugo</surname> <given-names>PM</given-names></string-name>, <string-name><surname>Wahome</surname> <given-names>EW</given-names></string-name>, <string-name><surname>Gichuru</surname> <given-names>EN</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Effect of text message, phone call, and in-person appointment reminders on uptake of repeat HIV testing among outpatients screened for acute HIV infection in Kenya: A randomized controlled trial</article-title>. <source>PLoS One</source>. <year>2016</year>;<volume>11</volume>(<issue>4</issue>):<fpage>e0153612</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0153612">https://doi.org/10.1371/journal.pone.0153612</ext-link></comment></mixed-citation></ref>
<ref id="CIT0024"><label>24.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Arora</surname> <given-names>S</given-names></string-name>, <string-name><surname>Peters</surname> <given-names>AL</given-names></string-name>, <string-name><surname>Agy</surname> <given-names>C</given-names></string-name>, <string-name><surname>Menchine</surname> <given-names>M</given-names></string-name></person-group>. <article-title>A mobile health intervention for inner city patients with poorly controlled diabetes: Proof-of-concept of the TExT-MED program</article-title>. <source>Diabetes Technol Ther</source>. <year>2012</year>;<volume>14</volume>(<issue>6</issue>):<fpage>492</fpage>&#x2013;<lpage>496</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1089/dia.2011.0252">https://doi.org/10.1089/dia.2011.0252</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><label>25.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Fischer</surname> <given-names>AE</given-names></string-name>, <string-name><surname>Sebidi</surname> <given-names>J</given-names></string-name>, <string-name><surname>Barron</surname> <given-names>P</given-names></string-name>, <string-name><surname>Lalla-Edward</surname> <given-names>ST</given-names></string-name></person-group>. <article-title>The MomConnect nurses and midwives support platform (NurseConnect): A qualitative process evaluation</article-title>. <source>JMIR Mhealth Uhealth</source>. <year>2019</year>;<volume>7</volume>(<issue>2</issue>):<fpage>e11644</fpage> <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2196/11644">https://doi.org/10.2196/11644</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><label>26.</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Human Sciences Research Council</collab></person-group>. <source>The fifth South African National HIV prevalence, incidence, behaviour and communication survey, 2017: HIV impact assessment summary report [homepage on the Internet]</source>. <year>2018</year> <comment>[cited 2020 Apr 5]. Available from: <ext-link ext-link-type="uri" xlink:href="https://www.aidshealth.org/wp-content/uploads/2018/08/hsrc-survey-2018-summary.pdf">https://www.aidshealth.org/wp-content/uploads/2018/08/hsrc-survey-2018-summary.pdf</ext-link></comment></mixed-citation></ref>
</ref-list>
<app-group>
<app id="app001">
<title>Appendix 1</title>
<sec id="s0020">
<title></title>
<fig id="F0003">
<label>FIGURE 1-A1</label>
<caption><p>Post-study survey.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="HIVMED-22-1197-g003.tif"/>
</fig>
</sec>
</app>
</app-group>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Fischer AE, Phatsoane M, Majam M, et al. Uptake of the Ithaka mobile application in Johannesburg, South Africa, for human immunodeficiency virus self-testing result reporting. S Afr J HIV Med. 2021;22(1), a1197. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajhivmed.v22i1.1197">https://doi.org/10.4102/sajhivmed.v22i1.1197</ext-link></p></fn>
</fn-group>
</back>
</article>