Logo des Repositoriums

Auflistung nach Schlagwort "Information retrieval"

1 - 6 von 6
  • Zeitschriftenartikel
    Design Principles for Systematic Search Systems: A Holistic Synthesis of a Rigorous Multi-cycle Design Science Research Journey
    (Business & Information Systems Engineering: Vol. 61, No. 1, 2019) Sturm, Benjamin; Sunyaev, Ali
    Rigorous systematic literature searches are often described as complex, error-prone and time-consuming because of a prevailing lack of adequate technological assistance. Nonetheless, one of the first steps when conducting a rigorous literature review is finding an appropriate literature sample. The quality of this literature sample is an important factor for the overall quality of the literature review. This article investigates how to design innovative IT systems that effectively facilitate systematic literature searches. Applying the design science research paradigm, the research method consists of multiple design cycles of artifact development, evaluation, and refinement. In doing so, six design principles are derived that intend to increase the comprehensiveness, precision, and reproducibility of systematic literature searches. The results could be helpful for research and practice. The derived design knowledge builds a foundation for future research on systematic search systems and enables new methodological contributions. The results could also guide the development of innovative search systems and features that, eventually, increase the quality and efficiency of information accumulation in different contexts.
  • Zeitschriftenartikel
    Design Principles for Systematic Search Systems: A Holistic Synthesis of a Rigorous Multi-cycle Design Science Research Journey
    (Business & Information Systems Engineering: Vol. 61, No. 1, 2019) Sturm, Benjamin; Sunyaev, Ali
    Rigorous systematic literature searches are often described as complex, error-prone and time-consuming because of a prevailing lack of adequate technological assistance. Nonetheless, one of the first steps when conducting a rigorous literature review is finding an appropriate literature sample. The quality of this literature sample is an important factor for the overall quality of the literature review. This article investigates how to design innovative IT systems that effectively facilitate systematic literature searches. Applying the design science research paradigm, the research method consists of multiple design cycles of artifact development, evaluation, and refinement. In doing so, six design principles are derived that intend to increase the comprehensiveness, precision, and reproducibility of systematic literature searches. The results could be helpful for research and practice. The derived design knowledge builds a foundation for future research on systematic search systems and enables new methodological contributions. The results could also guide the development of innovative search systems and features that, eventually, increase the quality and efficiency of information accumulation in different contexts.
  • Zeitschriftenartikel
    Evaluating Explainability Methods Intended for Multiple Stakeholders
    (KI - Künstliche Intelligenz: Vol. 35, No. 0, 2021) Martin, Kyle; Liret, Anne; Wiratunga, Nirmalie; Owusu, Gilbert; Kern, Mathias
    Explanation mechanisms for intelligent systems are typically designed to respond to specific user needs, yet in practice these systems tend to have a wide variety of users. This can present a challenge to organisations looking to satisfy the explanation needs of different groups using an individual system. In this paper we present an explainability framework formed of a catalogue of explanation methods, and designed to integrate with a range of projects within a telecommunications organisation. Explainability methods are split into low-level explanations and high-level explanations for increasing levels of contextual support in their explanations. We motivate this framework using the specific case-study of explaining the conclusions of field network engineering experts to non-technical planning staff and evaluate our results using feedback from two distinct user groups; domain-expert telecommunication engineers and non-expert desk agent staff. We also present and investigate two metrics designed to model the quality of explanations - Meet-In-The-Middle (MITM) and Trust-Your-Neighbours (TYN). Our analysis of these metrics offers new insights into the use of similarity knowledge for the evaluation of explanations.
  • Zeitschriftenartikel
    Limitations of Automatic Patent IR
    (Datenbank-Spektrum: Vol. 14, No. 1, 2014) Jürgens, Julia J.; Womser-Hacker, Christa
    In the last years, the interest of the IR-community in patent retrieval has risen. Various experiments have been undertaken and the problems of the field experienced in-depth. Results show that the paramount steps in the patent retrieval process are difficult to automate. This paper gives an overview over the methods that have been tested in the domain including their results and promotes a complementary, more interactive approach to patent retrieval. At last, promising areas for future research are described.
  • Zeitschriftenartikel
    Search Engine for Children: User-Centered Design
    (Datenbank-Spektrum: Vol. 17, No. 1, 2017) Gossen, Tatiana; Kotzyba, Michael; Nürnberger, Andreas
    Children are a fast growing user group on the Internet. Among different online activities, children use web search engines in order to gather information related to their personal interests and school activities. Children’s knowledge, cognitive abilities and fine motor skills are different from those of adults. Therefore, they may experience difficulties with search engines that are built using standard information retrieval algorithms and search interfaces for adults. Special or targeted search engines for children are essential in order to better support children in their search tasks. However, the design of search solutions for children is not an easy task. Not only are children’s abilities different from the abilities of adults, children also undergo relatively fast changes in their abilities. In order to tackle this challenge, an age-adaptable information terminal for children with a special focus on the search user interface (SUI) has been developed in three stages following a user-centered design. Specifically, it addresses the changing characteristics of the users by providing a means of adaptation. Several user studies have been conducted with children during the development to ensure the usability of the information terminal.
  • Textdokument
    Word Embeddings for Practical Information Retrieval
    (INFORMATIK 2017, 2017) Galke, Lukas; Saleh, Ahmed; Scherp, Ansgar
    We assess the suitability of word embeddings for practical information retrieval scenarios. Thus, we assume that users issue ad-hoc short queries where we return the first twenty retrieved documents after applying a boolean matching operation between the query and the documents. We compare the performance of several techniques that leverage word embeddings in the retrieval models to compute the similarity between the query and the documents, namely word centroid similarity, paragraph vectors, Word Mover’s distance, as well as our novel inverse document frequency (IDF) re-weighted word centroid similarity. We evaluate the performance using the ranking metrics mean average precision, mean reciprocal rank, and normalized discounted cumulative gain. Additionally, we inspect the retrieval models’ sensitivity to document length by using either only the title or the full-text of the documents for the retrieval task. We conclude that word centroid similarity is the best competitor to state-of-the-art retrieval models. It can be further improved by re-weighting the word frequencies with IDF before aggregating the respective word vectors of the embedding. The proposed cosine similarity of IDF re-weighted word vectors is competitive to the TF-IDF baseline and even outperforms it in case of the news domain with a relative percentage of 15%.