Methods For Evaluating Interactive Information Retrieval Systems With Users
DOWNLOAD
Download Methods For Evaluating Interactive Information Retrieval Systems With Users PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Methods For Evaluating Interactive Information Retrieval Systems With Users book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages. If the content not found or just blank you must refresh this page
Methods For Evaluating Interactive Information Retrieval Systems With Users
DOWNLOAD
Author : Diane Kelly
language : en
Publisher: Now Publishers Inc
Release Date : 2009
Methods For Evaluating Interactive Information Retrieval Systems With Users written by Diane Kelly and has been published by Now Publishers Inc this book supported file pdf, txt, epub, kindle and other format this book has been release on 2009 with Database management categories.
Provides an overview and instruction on the evaluation of interactive information retrieval systems with users.
Information Retrieval Evaluation
DOWNLOAD
Author : Donna K. Harman
language : en
Publisher: Morgan & Claypool Publishers
Release Date : 2011
Information Retrieval Evaluation written by Donna K. Harman and has been published by Morgan & Claypool Publishers this book supported file pdf, txt, epub, kindle and other format this book has been release on 2011 with Computers categories.
Evaluation has always played a major role in information retrieval, with the early pioneers such as Cyril Cleverdon and Gerard Salton laying the foundations for most of the evaluation methodologies in use today. The retrieval community has been extremely fortunate to have such a well-grounded evaluation paradigm during a period when most of the human language technologies were just developing. This lecture has the goal of explaining where these evaluation methodologies came from and how they have continued to adapt to the vastly changed environment in the search engine world today. The lecture starts with a discussion of the early evaluation of information retrieval systems, starting with the Cranfield testing in the early 1960s, continuing with the Lancaster "user" study for MEDLARS, and presenting the various test collection investigations by the SMART project and by groups in Britain. The emphasis in this chapter is on the how and the why of the various methodologies developed. The second chapter covers the more recent "batch" evaluations, examining the methodologies used in the various open evaluation campaigns such as TREC, NTCIR (emphasis on Asian languages), CLEF (emphasis on European languages), INEX (emphasis on semi-structured data), etc. Here again the focus is on the how and why, and in particular on the evolving of the older evaluation methodologies to handle new information access techniques. This includes how the test collection techniques were modified and how the metrics were changed to better reflect operational environments. The final chapters look at evaluation issues in user studies -- the interactive part of information retrieval, including a look at the search log studies mainly done by the commercial search engines. Here the goal is to show, via case studies, how the high-level issues of experimental design affect the final evaluations. Table of Contents: Introduction and Early History / "Batch" Evaluation Since 1992 / Interactive Evaluation / Conclusion
Interactive Ir User Study Design Evaluation And Reporting
DOWNLOAD
Author : Jiqun Liu
language : en
Publisher: Springer Nature
Release Date : 2022-05-31
Interactive Ir User Study Design Evaluation And Reporting written by Jiqun Liu and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2022-05-31 with Computers categories.
Since user study design has been widely applied in search interactions and information retrieval (IR) systems evaluation studies, a deep reflection and meta-evaluation of interactive IR (IIR) user studies is critical for sharpening the instruments of IIR research and improving the reliability and validity of the conclusions drawn from IIR user studies. To this end, we developed a faceted framework for supporting user study design, reporting, and evaluation based on a systematic review of the state-of-the-art IIR research papers recently published in several top IR venues (n=462). Within the framework, we identify three major types of research focuses, extract and summarize facet values from specific cases, and highlight the under-reported user study components which may significantly affect the results of research. Then, we employ the faceted framework in evaluating a series of IIR user studies against their respective research questions and explain the roles and impacts of the underlying connections and "collaborations" among different facet values. Through bridging diverse combinations of facet values with the study design decisions made for addressing research problems, the faceted framework can shed light on IIR user study design, reporting, and evaluation practices and help students and young researchers design and assess their own studies.
Interactive Information Seeking Behaviour And Retrieval
DOWNLOAD
Author : Ian Ruthven
language : en
Publisher: Facet Publishing
Release Date : 2011
Interactive Information Seeking Behaviour And Retrieval written by Ian Ruthven and has been published by Facet Publishing this book supported file pdf, txt, epub, kindle and other format this book has been release on 2011 with Computers categories.
Information retrieval (IR) is a complex human activity supported by sophisticated systems. Information science has contributed much to the design and evaluation of previous generations of IR system development and to our general understanding of how such systems should be designed and yet, due to the increasing success and diversity of IR systems, many recent textbooks concentrate on IR systems themselves and ignore the human side of searching for information. This book is the first text to provide an information science perspective on IR. Unique in its scope, the book covers the whole spectrum of information retrieval, including: history and background information behaviour and seeking task-based information searching and retrieval approaches to investigating information interaction and behaviour information representation access models evaluation interfaces for IR interactive techniques web retrieval, ranking and personalization recommendation, collaboration and social search multimedia: interfaces and access. Readership: Senior undergraduates and masters' level students of all information and library studies courses and practising LIS professionals who need to better appreciate how IR systems are designed, implemented and evaluated.
Information Retrieval Evaluation
DOWNLOAD
Author : Donna Harman
language : en
Publisher: Springer Nature
Release Date : 2022-05-31
Information Retrieval Evaluation written by Donna Harman and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2022-05-31 with Computers categories.
Evaluation has always played a major role in information retrieval, with the early pioneers such as Cyril Cleverdon and Gerard Salton laying the foundations for most of the evaluation methodologies in use today. The retrieval community has been extremely fortunate to have such a well-grounded evaluation paradigm during a period when most of the human language technologies were just developing. This lecture has the goal of explaining where these evaluation methodologies came from and how they have continued to adapt to the vastly changed environment in the search engine world today. The lecture starts with a discussion of the early evaluation of information retrieval systems, starting with the Cranfield testing in the early 1960s, continuing with the Lancaster "user" study for MEDLARS, and presenting the various test collection investigations by the SMART project and by groups in Britain. The emphasis in this chapter is on the how and the why of the various methodologies developed. The second chapter covers the more recent "batch" evaluations, examining the methodologies used in the various open evaluation campaigns such as TREC, NTCIR (emphasis on Asian languages), CLEF (emphasis on European languages), INEX (emphasis on semi-structured data), etc. Here again the focus is on the how and why, and in particular on the evolving of the older evaluation methodologies to handle new information access techniques. This includes how the test collection techniques were modified and how the metrics were changed to better reflect operational environments. The final chapters look at evaluation issues in user studies -- the interactive part of information retrieval, including a look at the search log studies mainly done by the commercial search engines. Here the goal is to show, via case studies, how the high-level issues of experimental design affect the final evaluations. Table of Contents: Introduction and Early History / "Batch" Evaluation Since 1992 / Interactive Evaluation / Conclusion
Information Retrieval
DOWNLOAD
Author : Ayse Goker
language : en
Publisher: Wiley
Release Date : 2009-12-15
Information Retrieval written by Ayse Goker and has been published by Wiley this book supported file pdf, txt, epub, kindle and other format this book has been release on 2009-12-15 with Technology & Engineering categories.
This book is an essential reference to cutting-edge issues and future directions in information retrieval Information retrieval (IR) can be defined as the process of representing, managing, searching, retrieving, and presenting information. Good IR involves understanding information needs and interests, developing an effective search technique, system, presentation, distribution and delivery. The increased use of the Web and wider availability of information in this environment led to the development of Web search engines. This change has brought fresh challenges to a wider variety of users’ needs, tasks, and types of information. Today, search engines are seen in enterprises, on laptops, in individual websites, in library catalogues, and elsewhere. Information Retrieval: Searching in the 21st Century focuses on core concepts, and current trends in the field. This book focuses on: Information Retrieval Models User-centred Evaluation of Information Retrieval Systems Multimedia Resource Discovery Image Users’ Needs and Searching Behaviour Web Information Retrieval Mobile Search Context and Information Retrieval Text Categorisation and Genre in Information Retrieval Semantic Search The Role of Natural Language Processing in Information Retrieval: Search for Meaning and Structure Cross-language Information Retrieval Performance Issues in Parallel Computing for Information Retrieval This book is an invaluable reference for graduate students on IR courses or courses in related disciplines (e.g. computer science, information science, human-computer interaction, and knowledge management), academic and industrial researchers, and industrial personnel tracking information search technology developments to understand the business implications. Intermediate-advanced level undergraduate students on IR or related courses will also find this text insightful. Chapters are supplemented with exercises to stimulate further thinking.
Interactive Information Retrieval In Digital Environments
DOWNLOAD
Author : Xie, Iris
language : en
Publisher: IGI Global
Release Date : 2008-04-30
Interactive Information Retrieval In Digital Environments written by Xie, Iris and has been published by IGI Global this book supported file pdf, txt, epub, kindle and other format this book has been release on 2008-04-30 with Computers categories.
"This book includes the integration of existing frameworks on user-oriented information retrieval systems across multiple disciplines; the comprehensive review of empirical studies of interactive information retrieval systems for different types of users, tasks, and subtasks; and the discussion of how to evaluate interactive information retrieval systems. "--Provided by publisher.
Test Collection Based Evaluation Of Information Retrieval Systems
DOWNLOAD
Author : Mark Sanderson
language : en
Publisher: Now Publishers Inc
Release Date : 2010-06-03
Test Collection Based Evaluation Of Information Retrieval Systems written by Mark Sanderson and has been published by Now Publishers Inc this book supported file pdf, txt, epub, kindle and other format this book has been release on 2010-06-03 with Computers categories.
Use of test collections and evaluation measures to assess the effectiveness of information retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 years since that work started, use of test collections is a de facto standard of evaluation. This monograph surveys the research conducted and explains the methods and measures devised for evaluation of retrieval systems, including a detailed look at the use of statistical significance testing in retrieval experimentation. This monograph reviews more recent examinations of the validity of the test collection approach and evaluation measures as well as outlining trends in current research exploiting query logs and live labs. At its core, the modern-day test collection is little different from the structures that the pioneering researchers in the 1950s and 1960s conceived of. This tutorial and review shows that despite its age, this long-standing evaluation method is still a highly valued tool for retrieval research.
Special Issue Evaluation Of Interactive Information Retrieval Systems
DOWNLOAD
Author : Pia Borlund
language : en
Publisher:
Release Date : 2007
Special Issue Evaluation Of Interactive Information Retrieval Systems written by Pia Borlund and has been published by this book supported file pdf, txt, epub, kindle and other format this book has been release on 2007 with categories.
Introduction To Information Retrieval
DOWNLOAD
Author : Christopher D. Manning
language : en
Publisher: Cambridge University Press
Release Date : 2008-07-07
Introduction To Information Retrieval written by Christopher D. Manning and has been published by Cambridge University Press this book supported file pdf, txt, epub, kindle and other format this book has been release on 2008-07-07 with Computers categories.
Class-tested and coherent, this textbook teaches classical and web information retrieval, including web search and the related areas of text classification and text clustering from basic concepts. It gives an up-to-date treatment of all aspects of the design and implementation of systems for gathering, indexing, and searching documents; methods for evaluating systems; and an introduction to the use of machine learning methods on text collections. All the important ideas are explained using examples and figures, making it perfect for introductory courses in information retrieval for advanced undergraduates and graduate students in computer science. Based on feedback from extensive classroom experience, the book has been carefully structured in order to make teaching more natural and effective. Slides and additional exercises (with solutions for lecturers) are also available through the book's supporting website to help course instructors prepare their lectures.