<?xml version="1.0" encoding="utf-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:hal="http://hal.archives-ouvertes.fr/" xmlns:gml="http://www.opengis.net/gml/3.3/" xmlns:gmlce="http://www.opengis.net/gml/3.3/ce" version="1.1" xsi:schemaLocation="http://www.tei-c.org/ns/1.0 http://api.archives-ouvertes.fr/documents/aofr-sword.xsd">
  <teiHeader>
    <fileDesc>
      <titleStmt>
        <title>HAL TEI export of hal-02526355</title>
      </titleStmt>
      <publicationStmt>
        <distributor>CCSD</distributor>
        <availability status="restricted">
          <licence target="https://creativecommons.org/publicdomain/zero/1.0/">CC0 1.0 - Universal</licence>
        </availability>
        <date when="2026-05-21T02:39:27+02:00"/>
      </publicationStmt>
      <sourceDesc>
        <p part="N">HAL API Platform</p>
      </sourceDesc>
    </fileDesc>
  </teiHeader>
  <text>
    <body>
      <listBibl>
        <biblFull>
          <titleStmt>
            <title xml:lang="en">Testing Chatbots Using Metamorphic Relations</title>
            <author role="aut">
              <persName>
                <forename type="first">Josip</forename>
                <surname>Bozic</surname>
              </persName>
              <email type="md5">ba8005c9e85145cc0ba00723b5e0583b</email>
              <email type="domain">ist.tugraz.at</email>
              <idno type="idhal" notation="numeric">994797</idno>
              <idno type="halauthorid" notation="string">1086258-994797</idno>
              <affiliation ref="#struct-65509"/>
            </author>
            <author role="aut">
              <persName>
                <forename type="first">Franz</forename>
                <surname>Wotawa</surname>
              </persName>
              <email type="md5">b64ab0a96f9bac7db681f9973ce61b5d</email>
              <email type="domain">ist.tugraz.at</email>
              <idno type="idhal" notation="numeric">994796</idno>
              <idno type="halauthorid" notation="string">1086257-994796</idno>
              <affiliation ref="#struct-65509"/>
            </author>
            <editor role="depositor">
              <persName>
                <forename>Hal</forename>
                <surname>Ifip</surname>
              </persName>
              <email type="md5">2073ac78024b6e13f2714db96e9b1e63</email>
              <email type="domain">inria.fr</email>
            </editor>
          </titleStmt>
          <editionStmt>
            <edition n="v1" type="current">
              <date type="whenSubmitted">2020-03-31 15:14:22</date>
              <date type="whenModified">2020-03-31 15:54:59</date>
              <date type="whenReleased">2020-03-31 15:54:59</date>
              <date type="whenProduced">2019-10-15</date>
              <date type="whenEndEmbargoed">2022-01-01</date>
              <ref type="file" target="https://inria.hal.science/hal-02526355v1/document">
                <date notBefore="2022-01-01"/>
              </ref>
              <ref type="file" subtype="author" n="1" target="https://inria.hal.science/hal-02526355v1/file/482770_1_En_3_Chapter.pdf" id="file-2526355-2397700">
                <date notBefore="2022-01-01"/>
              </ref>
            </edition>
            <respStmt>
              <resp>contributor</resp>
              <name key="200187">
                <persName>
                  <forename>Hal</forename>
                  <surname>Ifip</surname>
                </persName>
                <email type="md5">2073ac78024b6e13f2714db96e9b1e63</email>
                <email type="domain">inria.fr</email>
              </name>
            </respStmt>
          </editionStmt>
          <publicationStmt>
            <distributor>CCSD</distributor>
            <idno type="halId">hal-02526355</idno>
            <idno type="halUri">https://inria.hal.science/hal-02526355</idno>
            <idno type="halBibtex">bozic:hal-02526355</idno>
            <idno type="halRefHtml">&lt;i&gt;31th IFIP International Conference on Testing Software and Systems (ICTSS)&lt;/i&gt;, Oct 2019, Paris, France. pp.41-55, &lt;a target="_blank" href="https://dx.doi.org/10.1007/978-3-030-31280-0_3"&gt;&amp;#x27E8;10.1007/978-3-030-31280-0_3&amp;#x27E9;&lt;/a&gt;</idno>
            <idno type="halRef">31th IFIP International Conference on Testing Software and Systems (ICTSS), Oct 2019, Paris, France. pp.41-55, &amp;#x27E8;10.1007/978-3-030-31280-0_3&amp;#x27E9;</idno>
            <availability status="restricted">
              <licence target="https://creativecommons.org/licenses/by/4.0/">CC BY 4.0 - Attribution<ref corresp="#file-2526355-2397700"/></licence>
            </availability>
          </publicationStmt>
          <seriesStmt>
            <idno type="stamp" n="IFIP-LNCS" corresp="IFIP">IFIP - Lecture Notes in Computer Science</idno>
            <idno type="stamp" n="IFIP">IFIP - International Federation for Information Processing</idno>
            <idno type="stamp" n="IFIP-TC" corresp="IFIP">IFIP Technical Committees </idno>
            <idno type="stamp" n="IFIP-WG" corresp="IFIP">Working Groups</idno>
            <idno type="stamp" n="IFIP-TC6" corresp="IFIP-TC">TC 6: Communication Systems</idno>
            <idno type="stamp" n="IFIP-WG6-1" corresp="IFIP-WG">Architectures and Protocols for Distributed Systems</idno>
            <idno type="stamp" n="IFIP-ICTSS">IFIP-ICTSS</idno>
            <idno type="stamp" n="IFIP-LNCS-11812" corresp="IFIP-LNCS">Testing Software and Systems</idno>
          </seriesStmt>
          <notesStmt>
            <note type="commentary">Part 1: Test and Artificial Intelligence</note>
            <note type="audience" n="2">International</note>
            <note type="invited" n="0">No</note>
            <note type="popular" n="0">No</note>
            <note type="peer" n="1">Yes</note>
            <note type="proceedings" n="1">Yes</note>
          </notesStmt>
          <sourceDesc>
            <biblStruct>
              <analytic>
                <title xml:lang="en">Testing Chatbots Using Metamorphic Relations</title>
                <author role="aut">
                  <persName>
                    <forename type="first">Josip</forename>
                    <surname>Bozic</surname>
                  </persName>
                  <email type="md5">ba8005c9e85145cc0ba00723b5e0583b</email>
                  <email type="domain">ist.tugraz.at</email>
                  <idno type="idhal" notation="numeric">994797</idno>
                  <idno type="halauthorid" notation="string">1086258-994797</idno>
                  <affiliation ref="#struct-65509"/>
                </author>
                <author role="aut">
                  <persName>
                    <forename type="first">Franz</forename>
                    <surname>Wotawa</surname>
                  </persName>
                  <email type="md5">b64ab0a96f9bac7db681f9973ce61b5d</email>
                  <email type="domain">ist.tugraz.at</email>
                  <idno type="idhal" notation="numeric">994796</idno>
                  <idno type="halauthorid" notation="string">1086257-994796</idno>
                  <affiliation ref="#struct-65509"/>
                </author>
              </analytic>
              <monogr>
                <title level="m">Lecture Notes in Computer Science</title>
                <meeting>
                  <title>31th IFIP International Conference on Testing Software and Systems (ICTSS)</title>
                  <date type="start">2019-10-15</date>
                  <date type="end">2019-10-17</date>
                  <settlement>Paris</settlement>
                  <country key="FR">France</country>
                </meeting>
                <editor>Christophe Gaston</editor>
                <editor>Nikolai Kosmatov</editor>
                <editor>Pascale Le Gall</editor>
                <imprint>
                  <publisher>Springer International Publishing</publisher>
                  <biblScope unit="serie">Testing Software and Systems</biblScope>
                  <biblScope unit="volume">LNCS-11812</biblScope>
                  <biblScope unit="pp">41-55</biblScope>
                  <date type="datePub">2019</date>
                </imprint>
              </monogr>
              <idno type="doi">10.1007/978-3-030-31280-0_3</idno>
            </biblStruct>
          </sourceDesc>
          <profileDesc>
            <langUsage>
              <language ident="en">English</language>
            </langUsage>
            <textClass>
              <keywords scheme="author">
                <term xml:lang="en">Chatbots</term>
                <term xml:lang="en">Functional testing</term>
                <term xml:lang="en">Metamorphic testing</term>
              </keywords>
              <classCode scheme="halDomain" n="info">Computer Science [cs]</classCode>
              <classCode scheme="halDomain" n="info.info-ni">Computer Science [cs]/Networking and Internet Architecture [cs.NI]</classCode>
              <classCode scheme="halTypology" n="COMM">Conference papers</classCode>
              <classCode scheme="halOldTypology" n="COMM">Conference papers</classCode>
              <classCode scheme="halTreeTypology" n="COMM">Conference papers</classCode>
            </textClass>
            <abstract xml:lang="en">
              <p>Modern-day demands for services often require an availability on a 24/7 basis as well as online accessibility around the globe. For this sake, personalized software systems, called chatbots, are applied. Chatbots offer services, goods or information in natural language. These programs respond to the user in real-time and offer an intuitive and simple interface to interact with. Advantages like these makes them increasingly popular. Chatbots can even act as substitutes for humans for specific purposes. Since the chatbot market is growing, chatbots might outperform and replace classical web applications in the future. For this reason, ensuring correct functionality of chatbots is of high and increasing importance. However, since different implementations and user behavior result in unpredictable results, the chatbot’s output is difficult to predict and classify as well. In fact, testing of chatbots represents a challenge because of the unavailability of a test oracle. In this paper, we introduce a metamorphic testing approach for chatbots. In general, metamorphic testing can be applied to situations where no expected values are available. In addition, we discuss how to obtain test cases for chatbots, i.e. sequences of interactions with a chatbot, in an according manner. We demonstrate our approach using a hotel booking system and discuss first experimental results.</p>
            </abstract>
            <particDesc>
              <org type="consortium">TC 6</org>
              <org type="consortium">WG 6.1</org>
            </particDesc>
          </profileDesc>
        </biblFull>
      </listBibl>
    </body>
    <back>
      <listOrg type="structures">
        <org type="institution" xml:id="struct-65509" status="VALID">
          <idno type="ROR">https://ror.org/00d7xrm67</idno>
          <orgName>Graz University of Technology [Graz]</orgName>
          <orgName type="acronym">TU Graz</orgName>
          <desc>
            <address>
              <addrLine>Rechbauerstr. 12,  8010 Graz</addrLine>
              <country key="AT"/>
            </address>
            <ref type="url">https://www.tugraz.at/en/home/</ref>
          </desc>
        </org>
      </listOrg>
    </back>
  </text>
</TEI>