NTISthis.com

Evidence Guide: DEFEVL004 - Evaluate a training and assessment system

Student: __________________________________________________

Signature: _________________________________________________

Tips for gathering evidence to demonstrate your skills

The important thing to remember when gathering evidence is that the more evidence the better - that is, the more evidence you gather to demonstrate your skills, the more confident an assessor can be that you have learned the skills not just at one point in time, but are continuing to apply and develop those skills (as opposed to just learning for the test!). Furthermore, one piece of evidence that you collect will not usualy demonstrate all the required criteria for a unit of competency, whereas multiple overlapping pieces of evidence will usually do the trick!

From the Wiki University

 

DEFEVL004 - Evaluate a training and assessment system

What evidence can you provide to prove your understanding of each of the following citeria?

Plan a system evaluation

  1. Identify and confirm the purpose and role of the evaluation with client and stakeholders.
  2. Define the system in terms of location, purpose, and personnel.
  3. Identify and prioritise the needs of the stakeholders of the system.
  4. Identify, obtain and develop the necessary evaluation resources.
  5. Validate the evaluation plan with stakeholders including:
Identify and confirm the purpose and role of the evaluation with client and stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Define the system in terms of location, purpose, and personnel.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify and prioritise the needs of the stakeholders of the system.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify, obtain and develop the necessary evaluation resources.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Validate the evaluation plan with stakeholders including:

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

methodology

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

responsibility of appropriate personnel for conducting and participating in evaluations

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

criteria

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

responsibilities for implementation of the evaluation plans

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

means of protection of participants

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

agreement for data collection, storage and retrieval

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

procedures for editing and disseminating reports

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

agreement of the financing

  1. Establish the evidence required for making decisions of system improvement.
  2. Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.
  3. Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.
Establish the evidence required for making decisions of system improvement.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Conduct the evaluation

  1. Collect evidence in accordance with agreed evaluation procedures.
  2. Identify and record potentially useful information which is not identified in the evaluation plan.
  3. Collate and process data relevant to the evaluation.
  4. Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.
Collect evidence in accordance with agreed evaluation procedures.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify and record potentially useful information which is not identified in the evaluation plan.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Collate and process data relevant to the evaluation.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Report on evaluation findings

  1. Document issues and conclusions arising from the analysis conducted.
  2. Make recommendations to stakeholders on areas of possible improvement.
  3. Discuss preliminary findings with stakeholders.
  4. Prepare a range of reports to meet the differing needs of stakeholders.
Document issues and conclusions arising from the analysis conducted.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Make recommendations to stakeholders on areas of possible improvement.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Discuss preliminary findings with stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Prepare a range of reports to meet the differing needs of stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Plan a system evaluation

  1. Identify and confirm the purpose and role of the evaluation with client and stakeholders.
  2. Define the system in terms of location, purpose, and personnel.
  3. Identify and prioritise the needs of the stakeholders of the system.
  4. Identify, obtain and develop the necessary evaluation resources.
  5. Validate the evaluation plan with stakeholders including:
  6. methodology
  7. responsibility of appropriate personnel for conducting and participating in evaluations
  8. responsibilities for implementation of the evaluation plans
  9. means of protection of participants
  10. agreement for data collection, storage and retrieval
  11. procedures for editing and disseminating reports
  12. agreement of the financing
  13. Establish the evidence required for making decisions of system improvement.
  14. Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.
  15. Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.
Identify and confirm the purpose and role of the evaluation with client and stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Define the system in terms of location, purpose, and personnel.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify and prioritise the needs of the stakeholders of the system.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify, obtain and develop the necessary evaluation resources.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Validate the evaluation plan with stakeholders including:

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

methodology

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

responsibility of appropriate personnel for conducting and participating in evaluations

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

responsibilities for implementation of the evaluation plans

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

means of protection of participants

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

agreement for data collection, storage and retrieval

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

procedures for editing and disseminating reports

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

agreement of the financing

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Establish the evidence required for making decisions of system improvement.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Conduct the evaluation

  1. Collect evidence in accordance with agreed evaluation procedures.
  2. Identify and record potentially useful information which is not identified in the evaluation plan.
  3. Collate and process data relevant to the evaluation.
  4. Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.
Collect evidence in accordance with agreed evaluation procedures.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Identify and record potentially useful information which is not identified in the evaluation plan.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Collate and process data relevant to the evaluation.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Report on evaluation findings

  1. Document issues and conclusions arising from the analysis conducted.
  2. Make recommendations to stakeholders on areas of possible improvement.
  3. Discuss preliminary findings with stakeholders.
  4. Prepare a range of reports to meet the differing needs of stakeholders.
Document issues and conclusions arising from the analysis conducted.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Make recommendations to stakeholders on areas of possible improvement.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Discuss preliminary findings with stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Prepare a range of reports to meet the differing needs of stakeholders.

Completed
Date:

Teacher:		 Evidence:

 

 

 

 

 

 

 

Assessed

Teacher: ___________________________________ Date: _________

Signature: ________________________________________________

Comments:

 

 

 

 

 

 

 

 

Instructions to Assessors

Evidence Guide

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Plan a system evaluation

1.1 Identify and confirm the purpose and role of the evaluation with client and stakeholders.

1.2 Define the system in terms of location, purpose, and personnel.

1.3 Identify and prioritise the needs of the stakeholders of the system.

1.4 Identify, obtain and develop the necessary evaluation resources.

1.5 Validate the evaluation plan with stakeholders including:

methodology

responsibility of appropriate personnel for conducting and participating in evaluations

criteria

responsibilities for implementation of the evaluation plans

means of protection of participants

agreement for data collection, storage and retrieval

procedures for editing and disseminating reports

agreement of the financing

1.6 Establish the evidence required for making decisions of system improvement.

1.7 Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

1.8 Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

2. Conduct the evaluation

2.1 Collect evidence in accordance with agreed evaluation procedures.

2.2 Identify and record potentially useful information which is not identified in the evaluation plan.

2.3 Collate and process data relevant to the evaluation.

2.4 Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

3. Report on evaluation findings

3.1 Document issues and conclusions arising from the analysis conducted.

3.2 Make recommendations to stakeholders on areas of possible improvement.

3.3 Discuss preliminary findings with stakeholders.

3.4 Prepare a range of reports to meet the differing needs of stakeholders.

Required Skills and Knowledge

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Plan a system evaluation

1.1 Identify and confirm the purpose and role of the evaluation with client and stakeholders.

1.2 Define the system in terms of location, purpose, and personnel.

1.3 Identify and prioritise the needs of the stakeholders of the system.

1.4 Identify, obtain and develop the necessary evaluation resources.

1.5 Validate the evaluation plan with stakeholders including:

methodology

responsibility of appropriate personnel for conducting and participating in evaluations

criteria

responsibilities for implementation of the evaluation plans

means of protection of participants

agreement for data collection, storage and retrieval

procedures for editing and disseminating reports

agreement of the financing

1.6 Establish the evidence required for making decisions of system improvement.

1.7 Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

1.8 Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

2. Conduct the evaluation

2.1 Collect evidence in accordance with agreed evaluation procedures.

2.2 Identify and record potentially useful information which is not identified in the evaluation plan.

2.3 Collate and process data relevant to the evaluation.

2.4 Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

3. Report on evaluation findings

3.1 Document issues and conclusions arising from the analysis conducted.

3.2 Make recommendations to stakeholders on areas of possible improvement.

3.3 Discuss preliminary findings with stakeholders.

3.4 Prepare a range of reports to meet the differing needs of stakeholders.

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

evaluating information management systems, policies and procedures of an organisation

selecting relevant evaluation information and documentation

accessing and interpreting the organisation's standards and values

analysing records/notes of the evaluation process

explaining the evaluation process

giving clear and precise instructions and advice

discussing the evaluation process with other relevant people

seeking information relevant to the evaluation

discussing the evaluation outcome with the stakeholders

interpreting training program requirements

developing resources to support the evaluation process

communicating with key stakeholders

producing and maintaining documentation

planning projects, work programs

coordinating the work of self and others

investigating training and workforce data

determining and implementing improvement

writing evaluation reports

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

program design considerations (cost, equality, technically valid, ethics)

quantitative and qualitative methods for monitoring and evaluation

data management

Training Packages and accredited courses, and what comprises quality training and assessment services

how training and/or assessment organisations operate

terminology relating to quality evaluation processes

evaluation models/methods

records management systems of the organisation

relevant policy, legislation, codes of practice and national standards, including Commonwealth and state/territory legislation

vocational education and training systems

WHS relating to planning and conducting an evaluation

vocational education regulations