Logo des Repositoriums

Auflistung nach Autor:in "Elsweiler, David"

1 - 4 von 4
  • Zeitschriftenartikel
    Comparing Wizard of Oz & Observational Studies for Conversational IR Evaluation
    (Datenbank-Spektrum: Vol. 20, No. 1, 2020) Elsweiler, David; Frummet, Alexander; Harvey, Morgan
    Systematic and repeatable measurement of information systems via test collections, the Cranfield model, has been the mainstay of Information Retrieval since the 1960s. However, this may not be appropriate for newer, more interactive systems, such as Conversational Search agents. Such systems rely on Machine Learning technologies, which are not yet sufficiently advanced to permit true human-like dialogues, and so research can be enabled by simulation via human agents. In this work we compare dialogues obtained from two studies with the same context, assistance in the kitchen, but with different experimental setups, allowing us to learn about and evaluate conversational IR systems. We discover that users adapt their behaviour when they think they are interacting with a system and that human-like conversations in one of the studies were unpredictable to an extent we did not expect. Our results have implications for the development of new studies in this area and, ultimately, the design of future conversational agents.
  • Konferenzbeitrag
    Evaluating personal information management behaviour using Markov models
    (WM2009: 5th conference on professional knowledge management, 2009) Elsweiler, David; Mandl, Stefan; Azzopardi, Leif
    Personal Knowledge Management (PKM) and Personal Information Management (PIM) are two related research problems currently being examined by different, although potentially overlapping communities of researchers. We believe that the crossfertilisation of ideas between these communities could lead to progress in both fields. With this aim in mind, in this position statement we outline our research project, which will use mathematical modelling techniques to help understand and evaluate Personal Information Management behaviour. Evaluation is a major challenge in PIM research and the methods currently available to researchers each have associated problems. In this work, we will discuss the feasibility of using Markov Models to overcome some of these difficulties. Here, we outline some of the challenges involved in PIM evaluation, describe the theory behind the approach and explain how to validate the approach through experimentation in a practical setting.
  • Konferenzbeitrag
    Improving Organic Recollection with Memory Prosthetics
    (Interaktive Kulturen : Workshop-Band : Proceedings der Workshops der Mensch & Computer 2010 - 10. Fachübergreifende Konferenz für Interaktive und Kooperative Medien, DeLFI 2010 - die 8. E-Learning Fachtagung Informatik der Gesellschaft für Informatik e.V. und der Entertainment Interfaces 2010, 2010) Elsweiler, David; Jones, Gareth
  • Konferenzbeitrag
    Personal Knowledge Management: Understanding, Supporting, and Evaluating the Management of Personal Knowledge, Information and Data
    (Interaktive Kulturen : Workshop-Band : Proceedings der Workshops der Mensch & Computer 2010 - 10. Fachübergreifende Konferenz für Interaktive und Kooperative Medien, DeLFI 2010 - die 8. E-Learning Fachtagung Informatik der Gesellschaft für Informatik e.V. und der Entertainment Interfaces 2010, 2010) Elsweiler, David; Haller, Heiko; Kindsmüller, Martin Christof; Pircher, Richard