Frequently Asked Questions
Guidance
Is it necessary to evaluate all training?
No! We would encourage you to take a pragmatic approach to evaluation. This is about assessing the value of the potential outcome against the resource, including time and money, it will take to undertake any evaluation.
The pragmatic approach, within the JSB M&E Evaluation Guidance, provides detailed information on using this approach and how to go about it.
What evaluation model should I be using?
This is a decision for the MATC Area. We are not recommending a particular evaluation model.
There are many theoretical evaluation models that you can look at in more detail to help you decide on the best approach for your Area. Listed below are just a few of the commonly known models. All are similar in terms of a continuous process, being participative, covering learning, behaviour and outcomes.
- - CIRO approach (developed by Warr, Bird & Rackham in 1970)
- - Hamblin approach (1974)
- - Kirkpatrick approach (developed by Dr Donald Kirkpatrick in 1959)
- - Bell system approach (developed by Jackson & Kulp in 1979)
- - Parker approach (1973).
If you would like more advice on these models, please contact the M&E team.
Training Plans
What does, the Minimum Provision of Training agreed between the JSB and HMCS in respect of magistrate training, mean?
This forms part of the Protocol (Memorandum of Understanding) that the JSB and HMCS agree, on an annual basis, for the provision of national training for magistrates. This agreement is intended to ensure that appropriate provision for all magistrates’ training, to support them in their judicial function, will continue. The agreement is sent out to MATC Chairmen and Justices’ Clerks annually so that this is taken into account when annual Area magistrate training plans are being prepared for the next financial year.
What is the Resource Planning Tool?
It is an Excel spreadsheet that is a simple way of planning Area magistrate training for each financial year. This records the training planned, the actual training undertaken, variations between the two and a summary of the resources expended.
What is the purpose of the Resource Planning Tool?
The Resource Planning Tool ensures that information about the quantity and quality of magistrate training, and the resources used to deliver it, are recorded in a consistent way across England and Wales. This enables stakeholders to see what is happening with magistrate training locally and nationally.
What is an Out-turn Report?
Each year the M&E team will require an out-turn report from Areas detailing a summary of actual resources deployed, training delivered and outlining any variations from the last financial year. Submitting a full completed Resource Planning Tool will automate this process for Areas.
What is the MATC Annual Report?
Each year MATCs are required to submit an annual report to the M&E team, by the 30 September, of magistrate training activity for the preceding financial year. The content of this report is fully covered in the MATC Good Practice Guidance paras 10.4 – 10.5. Guidance on completing the report is provided by the M&E team each year.
Frameworks
What is the Framework of Standards for Magistrate Training and Development?
The framework of standards is based on national occupational standards. Although the standards are called “Framework of Standards for Magistrate Training and Development”, the standards are in fact generic. They set out a professional approach to all aspects of the training cycle.
The standards are designed for use by all those who identify, commission, design, deliver and evaluate magistrate training. The framework is in five sections, which represents the training cycle:
- stage 1 - Identification of training needs
- stage 2 - Design of training solutions
- stage 3 - Delivery of training solutions
- stage 4 - Application of training in the court environment
- stage 5 - Evaluation of training solutions.
For each of the five stages there are standards and guidance/examples, explaining how, and in what way, the standards for training can be met. Full details on the standards are available. Appendix 7 has a list of frequently asked questions about the standards 
[400KB].
How do I self-assess against the standards?
Self-assessment against the Framework of Standards for Magistrate Training and Development is an opportunity for each MATC Area to measure their effectiveness against common standards. The self-assessment should be a comprehensive, critical review of all aspects of magistrate training in the MATC Area against the standards. It is important that this self-assessment should be undertaken throughout the year and not just when the M&E team formally request the Area self-assessment documents.
Is there separate information for MATC members and BTDC members on using the standards?
The Magistrates’ Association asked the JSB to provide some practical advice for MATCs and BTDCs in how they could use the framework of standards. This guidance provides examples of how members can become more involved in the monitoring and evaluation of magistrate training.
Is there a Monitoring and Evaluation Strategy?
The Monitoring and Evaluation Strategy sets out the M&E team’s approach which is based on three tiers:
- tier one: Setting standards.
- tier two: Local self-assessment against the standards.
- tier three: Critical evaluation by the M&E team.
Full details on the M&E strategy are available.
What will M&E team evaluators be specifically looking at when they observe an Area magistrate training event?
Observing a training event is part of the M&E strategy and helps to get a complete picture of training practice in the MATC Area (stages 2-3 of the Framework of Standards refer). For full-day events, M&E evaluators observe for half a day, usually up until the lunch period, as this is usually ample time to get a picture of training practice in the Area.
As a trainer’s performance is the responsibility of the appropriate Justices’ Clerk, evaluators do not assess or provide feedback to the trainer(s) on their individual performance. However, evaluators are happy to discuss their observations against the standards criteria. The observation notes taken by the evaluator will form part of the Area Summary of Findings report. A copy of the observation template is available.
Help and Assistance FAQs
What help and assistance is available to Areas from the M&E team?
We are committed to supporting Areas in the continual improvement process. We can provide practical advice on all aspects of training. We are also happy to facilitate or contribute to relevant meetings or workshops.
See what M&E can do for you for more information.
How can I contact the M&E team?
If you wish to contact the M&E team, please see contact details.
Feedback
We would like this website to provide you with the information you need. If you have any specific feedback, or ideas about additional things you would like to see on this website, please let us have you comments.