Evaluation of library intelligence tools in terms of accuracy, privacy and rights
Introduction
The programme “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” addresses a practical task within Library Management, Information Services and Knowledge Discovery. Training draws on reader needs, catalogues, resources and usage data and uses techniques for analysing needs, describing and retrieving resources and evaluating the service to link the analysis to a traceable decision and action.
The participant develops a use case design and human validation matrix over 5 training days, then tests it in a practical case on “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” involving an unavailable resource, an incomplete description or poor search results. The output is reviewed against retrieval accuracy, resource use and request fulfilment time and the next step for applying it in the workplace is identified.
Objectives
By the end of the programme, participants work towards the following:
- Define the scope of Evaluation of library intelligence tools in terms of accuracy, privacy and rights and the requirements for completing the task.
- Prepare and check the practical exercise inputs using reader needs, catalogues, resources and usage data.
- Apply the following method: analysing needs, describing and retrieving resources and evaluating the service to produce a use case design and human validation matrix.
- Test the outcome in the event of an unavailable resource, an incomplete description or poor search results and document the correction.
- Present and assess the output using retrieval accuracy, resource use and request fulfilment time and define an implementation plan.
Programme topics
Day 1: Defining the scope of the exercise and completion requirements
- Translate the programme title “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” into a task, a defined scope and a reviewable output
- Define the task and the data permitted for use
- Identify the data and stakeholders required from reader needs, catalogues, resources and usage data
Day 2: Preparing data and evidence and establishing a baseline
- Prepare case data for “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” and check its completeness and consistency
- Document assumptions and the source of each input in a use case design and human validation matrix
- Identify the gap between the current situation and the target outcome using retrieval accuracy, resource use and request fulfilment time
Day 3: Developing the solution and carrying out the specialist task
- Measure errors, bias and output limitations
- Produce the first version of a use case design and human validation matrix to support “Evaluation of library intelligence tools in terms of accuracy, privacy and rights”
- Link each result to its source using analysing needs, describing and retrieving resources and evaluating the service
Day 4: Testing alternatives and exceptions and reviewing the output
- Complete a practical case on “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” involving an unavailable resource, an incomplete description or poor search results
- Assign a human reviewer and an acceptance or rejection decision
- Record discrepancies, errors, validity limits and corrective decisions in a use case design and human validation matrix
Day 5: Presenting the practical output and workplace transfer plan
- Present a use case design and human validation matrix resulting from “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” and review it with the training group
- Measure completion of the practical exercise using retrieval accuracy, resource use and request fulfilment time and trace the evidence
- Develop an implementation plan specifying the responsible person, deadline, approval decision and outcome monitoring mechanism
Outputs
- a use case design and human validation matrix tailored to the subject of “Evaluation of library intelligence tools in terms of accuracy, privacy and rights”, with traceability of data, assumptions and decisions.
- Results of testing a practical case on “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” involving an unavailable resource, an incomplete description or poor search results, with documented findings and how they were addressed.
- An implementation plan that measures retrieval accuracy, resource use and request fulfilment time and identifies the responsible person, deadline and review mechanism.
Who should attend
- Library, information and digital reference specialists
- Team members assigned to implement or review “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” whose responsibilities relate to Library Management, Information Services and Knowledge Discovery.
Participation requirements and delivery methodology
- Experience or a work assignment related to Library Management, Information Services and Knowledge Discovery that enables participation in practical exercises and discussion of alternatives.
- Training and hypothetical data are used. Personal data and confidential documents are excluded from classroom exercises.
- Practical workshops, evidence reviews and case simulations addressing Evaluation of library intelligence tools in terms of accuracy, privacy and rights, with the output developed progressively throughout the programme.
- The output is assessed for completeness, consistency of sources and its ability to measure retrieval accuracy, resource use and request fulfilment time.
Conclusion
The programme “Evaluation of library intelligence tools in terms of accuracy, privacy and rights” concludes with a presentation of a use case design and human validation matrix and an explanation of the underlying evidence, decisions and alternatives. Application limits and outstanding findings are recorded and converted into a follow-up plan with a responsible person, a deadline and a clear measure.
