Unit of Competency Mapping – Information for Teachers/Assessors – Information for Learners

DEFEVL004 Mapping and Delivery Guide
Evaluate a training and assessment system

Version 1.0
Issue Date: April 2024


Qualification -
Unit of Competency DEFEVL004 - Evaluate a training and assessment system
Description
Employability Skills
Learning Outcomes and Application This unit describes the skills required to evaluate an external or internal training and assessment system.This unit applies to those who have responsibility for evaluating training and assessment strategies of an organisation.The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.Those undertaking this unit would work autonomously while performing complex tasks in a familiar context.No licensing, legislative or certification requirements apply to unit at the time of publication.
Duration and Setting X weeks, nominally xx hours, delivered in a classroom/online/blended learning setting.

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.
Prerequisites/co-requisites
Competency Field Evaluation
Development and validation strategy and guide for assessors and learners Student Learning Resources Handouts
Activities 		Slides
PPT 		Assessment 1 Assessment 2 Assessment 3 Assessment 4
Elements of Competency Performance Criteria              
Element: Plan a system evaluation
  • Identify and confirm the purpose and role of the evaluation with client and stakeholders.
  • Define the system in terms of location, purpose, and personnel.
  • Identify and prioritise the needs of the stakeholders of the system.
  • Identify, obtain and develop the necessary evaluation resources.
  • Validate the evaluation plan with stakeholders including:
       
Element: methodology
       
Element: responsibility of appropriate personnel for conducting and participating in evaluations
       
Element: criteria
       
Element: responsibilities for implementation of the evaluation plans
       
Element: means of protection of participants
       
Element: agreement for data collection, storage and retrieval
       
Element: procedures for editing and disseminating reports
       
Element: agreement of the financing
  • Establish the evidence required for making decisions of system improvement.
  • Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.
  • Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.
       
Element: Conduct the evaluation
  • Collect evidence in accordance with agreed evaluation procedures.
  • Identify and record potentially useful information which is not identified in the evaluation plan.
  • Collate and process data relevant to the evaluation.
  • Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.
       
Element: Report on evaluation findings
  • Document issues and conclusions arising from the analysis conducted.
  • Make recommendations to stakeholders on areas of possible improvement.
  • Discuss preliminary findings with stakeholders.
  • Prepare a range of reports to meet the differing needs of stakeholders.
       
Element: Plan a system evaluation
  • Identify and confirm the purpose and role of the evaluation with client and stakeholders.
  • Define the system in terms of location, purpose, and personnel.
  • Identify and prioritise the needs of the stakeholders of the system.
  • Identify, obtain and develop the necessary evaluation resources.
  • Validate the evaluation plan with stakeholders including:
  • methodology
  • responsibility of appropriate personnel for conducting and participating in evaluations
  • responsibilities for implementation of the evaluation plans
  • means of protection of participants
  • agreement for data collection, storage and retrieval
  • procedures for editing and disseminating reports
  • agreement of the financing
  • Establish the evidence required for making decisions of system improvement.
  • Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.
  • Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.
       
Element: Conduct the evaluation
  • Collect evidence in accordance with agreed evaluation procedures.
  • Identify and record potentially useful information which is not identified in the evaluation plan.
  • Collate and process data relevant to the evaluation.
  • Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.
       
Element: Report on evaluation findings
  • Document issues and conclusions arising from the analysis conducted.
  • Make recommendations to stakeholders on areas of possible improvement.
  • Discuss preliminary findings with stakeholders.
  • Prepare a range of reports to meet the differing needs of stakeholders.
       


Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Plan a system evaluation

1.1 Identify and confirm the purpose and role of the evaluation with client and stakeholders.

1.2 Define the system in terms of location, purpose, and personnel.

1.3 Identify and prioritise the needs of the stakeholders of the system.

1.4 Identify, obtain and develop the necessary evaluation resources.

1.5 Validate the evaluation plan with stakeholders including:

methodology

responsibility of appropriate personnel for conducting and participating in evaluations

criteria

responsibilities for implementation of the evaluation plans

means of protection of participants

agreement for data collection, storage and retrieval

procedures for editing and disseminating reports

agreement of the financing

1.6 Establish the evidence required for making decisions of system improvement.

1.7 Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

1.8 Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

2. Conduct the evaluation

2.1 Collect evidence in accordance with agreed evaluation procedures.

2.2 Identify and record potentially useful information which is not identified in the evaluation plan.

2.3 Collate and process data relevant to the evaluation.

2.4 Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

3. Report on evaluation findings

3.1 Document issues and conclusions arising from the analysis conducted.

3.2 Make recommendations to stakeholders on areas of possible improvement.

3.3 Discuss preliminary findings with stakeholders.

3.4 Prepare a range of reports to meet the differing needs of stakeholders.

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

evaluating information management systems, policies and procedures of an organisation

selecting relevant evaluation information and documentation

accessing and interpreting the organisation's standards and values

analysing records/notes of the evaluation process

explaining the evaluation process

giving clear and precise instructions and advice

discussing the evaluation process with other relevant people

seeking information relevant to the evaluation

discussing the evaluation outcome with the stakeholders

interpreting training program requirements

developing resources to support the evaluation process

communicating with key stakeholders

producing and maintaining documentation

planning projects, work programs

coordinating the work of self and others

investigating training and workforce data

determining and implementing improvement

writing evaluation reports

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

program design considerations (cost, equality, technically valid, ethics)

quantitative and qualitative methods for monitoring and evaluation

data management

Training Packages and accredited courses, and what comprises quality training and assessment services

how training and/or assessment organisations operate

terminology relating to quality evaluation processes

evaluation models/methods

records management systems of the organisation

relevant policy, legislation, codes of practice and national standards, including Commonwealth and state/territory legislation

vocational education and training systems

WHS relating to planning and conducting an evaluation

vocational education regulations

Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assignment, checklist) and due date here

Assessment task 1: [title]      Due date:

(add new lines for each of the assessment tasks)

Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Plan a system evaluation

1.1 Identify and confirm the purpose and role of the evaluation with client and stakeholders.

1.2 Define the system in terms of location, purpose, and personnel.

1.3 Identify and prioritise the needs of the stakeholders of the system.

1.4 Identify, obtain and develop the necessary evaluation resources.

1.5 Validate the evaluation plan with stakeholders including:

methodology

responsibility of appropriate personnel for conducting and participating in evaluations

criteria

responsibilities for implementation of the evaluation plans

means of protection of participants

agreement for data collection, storage and retrieval

procedures for editing and disseminating reports

agreement of the financing

1.6 Establish the evidence required for making decisions of system improvement.

1.7 Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

1.8 Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

2. Conduct the evaluation

2.1 Collect evidence in accordance with agreed evaluation procedures.

2.2 Identify and record potentially useful information which is not identified in the evaluation plan.

2.3 Collate and process data relevant to the evaluation.

2.4 Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

3. Report on evaluation findings

3.1 Document issues and conclusions arising from the analysis conducted.

3.2 Make recommendations to stakeholders on areas of possible improvement.

3.3 Discuss preliminary findings with stakeholders.

3.4 Prepare a range of reports to meet the differing needs of stakeholders.

Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.

Observation Checklist

Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice Yes No Comments/feedback
Identify and confirm the purpose and role of the evaluation with client and stakeholders. 
Define the system in terms of location, purpose, and personnel. 
Identify and prioritise the needs of the stakeholders of the system. 
Identify, obtain and develop the necessary evaluation resources. 
Validate the evaluation plan with stakeholders including: 
 
 
 
 
 
 
 
Establish the evidence required for making decisions of system improvement. 
Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information. 
Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation. 
Collect evidence in accordance with agreed evaluation procedures. 
Identify and record potentially useful information which is not identified in the evaluation plan. 
Collate and process data relevant to the evaluation. 
Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system. 
Document issues and conclusions arising from the analysis conducted. 
Make recommendations to stakeholders on areas of possible improvement. 
Discuss preliminary findings with stakeholders. 
Prepare a range of reports to meet the differing needs of stakeholders. 
Identify and confirm the purpose and role of the evaluation with client and stakeholders. 
Define the system in terms of location, purpose, and personnel. 
Identify and prioritise the needs of the stakeholders of the system. 
Identify, obtain and develop the necessary evaluation resources. 
Validate the evaluation plan with stakeholders including: 
methodology 
responsibility of appropriate personnel for conducting and participating in evaluations 
responsibilities for implementation of the evaluation plans 
means of protection of participants 
agreement for data collection, storage and retrieval 
procedures for editing and disseminating reports 
agreement of the financing 
Establish the evidence required for making decisions of system improvement. 
Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information. 
Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation. 
Collect evidence in accordance with agreed evaluation procedures. 
Identify and record potentially useful information which is not identified in the evaluation plan. 
Collate and process data relevant to the evaluation. 
Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system. 
Document issues and conclusions arising from the analysis conducted. 
Make recommendations to stakeholders on areas of possible improvement. 
Discuss preliminary findings with stakeholders. 
Prepare a range of reports to meet the differing needs of stakeholders. 

Forms

Assessment Cover Sheet

DEFEVL004 - Evaluate a training and assessment system
Assessment task 1: [title]

Student name:

Student ID:

I declare that the assessment tasks submitted for this unit are my own work.

Student signature:

Result: Competent Not yet competent

Feedback to student

 

 

 

 

 

 

 

 

Assessor name:

Signature:

Date:

Assessment Record Sheet

DEFEVL004 - Evaluate a training and assessment system

Student name:

Student ID:

Assessment task 1: [title] Result: Competent Not yet competent

(add lines for each task)

Feedback to student:

 

 

 

 

 

 

 

 

Overall assessment result: Competent Not yet competent

Assessor name:

Signature:

Date:

Student signature:

Date: