Testing the accuracy of smart systems before they are introduced into the public service
Introduction
The programme “Testing the accuracy of smart systems before they are introduced into the public service” focuses on a specific practical need within Digital Transformation Management and Business Process Redesign. The course begins with Determination of the purpose and acceptance limits of the smart system and its exercises progress through to Preparation of pre-operational testing report and acceptance portals.
Participants work on a training case related to the programme topic to produce a practical portfolio covering the results of: Determination of the purpose and acceptance limits of the smart system ; Design of a test package representing service cases ; Measurement of accuracy, errors and disparity between categories ; Review of critical situations and the role of human intervention ; Preparation of pre-operational testing report and acceptance portals. Alternatives, constraints and decision evidence are reviewed. The results are then adapted to the organization’s authority arrangements and policies before implementation.
Objectives
By the end of the programme, participants work towards the following in a practical case:
- Determination of the purpose and acceptance limits of the smart system
- Design of a test package representing service cases
- Measurement of accuracy, errors and disparity between categories
- Review of critical situations and the role of human intervention
- Preparation of pre-operational testing report and acceptance portals
Programme topics
Day 1: Determination of the purpose and acceptance limits of the smart system
A practical exercise tailored to this day’s topic: Determination of the purpose and acceptance limits of the smart system.
Day 2: Design of a test package representing service cases
A practical exercise tailored to this day’s topic: Design of a test package representing service cases.
Day 3: Measurement of accuracy, errors and disparity between categories
- A measure is defined by data source, baseline, periodic update and responsible clear verification.
- Compare the outcome with the target and examine the quality of the manual before selecting a corrective action.
Day 4: Review of critical situations and the role of human intervention
- Identification of the scenario, its causes and impact, and the officer in office and the responsibility for reviewing them.
- Testing of a processing officer, a follow-up indicator and a standard for the escalation of residual risks.
Day 5: Preparation of pre-operational testing report and acceptance portals
- Identification of the recipient of the communication, the decision requested and the facts supporting the recommendation.
- Review the clarity of the wording and consistency of the figures and highlight what needs to be answered or adopted.
Outputs
- A practical portfolio covering the results of: Determination of the purpose and acceptance limits of the smart system ; Design of a test package representing service cases ; Measurement of accuracy, errors and disparity between categories ; Review of critical situations and the role of human intervention ; Preparation of pre-operational testing report and acceptance portals.
- A documented practical portfolio covering the programme topics, including decisions, evidence and limitations of use.
- A workplace transfer plan identifying the person responsible for the next step, a trial date and a criterion for verifying the outcome.
Who should attend
- Digital transformation and government service officers, process and data owners and beneficiary experience development teams
- Team members assigned to prepare or review the outputs specified in the programme topics, according to their experience and roles.
Participation requirements and delivery methodology
- Experience or a work assignment related to Digital Transformation Management and Business Process Redesign, with programme suitability reviewed with the Training Department.
- Hypothetical data and cases are used. Disclosure of personal data or confidential documents is not required.
- Exercises, practical cases, discussion of alternatives and review of the practical output, based on each training day’s topic.
- The output is assessed for completeness, fitness for purpose and practicality. Specialist aspects are reviewed by authorized professionals.
Conclusion
The programme concludes with presentation and review of the practical output and a link between the next step and the participant’s workplace. The focus is on Preparation of pre-operational testing report and acceptance portals and documenting what requires amendment or approval before actual implementation.
