DEFEVL004
Evaluate a training and assessment system


Application

This unit describes the skills required to evaluate an external or internal training and assessment system.

This unit applies to those who have responsibility for evaluating training and assessment strategies of an organisation.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work autonomously while performing complex tasks in a familiar context.

No licensing, legislative or certification requirements apply to unit at the time of publication.


Elements and Performance Criteria

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Plan a system evaluation

1.1 Identify and confirm the purpose and role of the evaluation with client and stakeholders.

1.2 Define the system in terms of location, purpose, and personnel.

1.3 Identify and prioritise the needs of the stakeholders of the system.

1.4 Identify, obtain and develop the necessary evaluation resources.

1.5 Validate the evaluation plan with stakeholders including:

methodology

responsibility of appropriate personnel for conducting and participating in evaluations

criteria

responsibilities for implementation of the evaluation plans

means of protection of participants

agreement for data collection, storage and retrieval

procedures for editing and disseminating reports

agreement of the financing

1.6 Establish the evidence required for making decisions of system improvement.

1.7 Identify, develop and assess validity and reliability of evidence gathering instruments, procedures and sources of information.

1.8 Link cost effective methods utilising an appropriate evaluation model to the purpose of the evaluation.

2. Conduct the evaluation

2.1 Collect evidence in accordance with agreed evaluation procedures.

2.2 Identify and record potentially useful information which is not identified in the evaluation plan.

2.3 Collate and process data relevant to the evaluation.

2.4 Interpret evidence at the individual and aggregate levels and identify strengths and weaknesses of the system.

3. Report on evaluation findings

3.1 Document issues and conclusions arising from the analysis conducted.

3.2 Make recommendations to stakeholders on areas of possible improvement.

3.3 Discuss preliminary findings with stakeholders.

3.4 Prepare a range of reports to meet the differing needs of stakeholders.

Evidence of Performance

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

evaluating information management systems, policies and procedures of an organisation

selecting relevant evaluation information and documentation

accessing and interpreting the organisation's standards and values

analysing records/notes of the evaluation process

explaining the evaluation process

giving clear and precise instructions and advice

discussing the evaluation process with other relevant people

seeking information relevant to the evaluation

discussing the evaluation outcome with the stakeholders

interpreting training program requirements

developing resources to support the evaluation process

communicating with key stakeholders

producing and maintaining documentation

planning projects, work programs

coordinating the work of self and others

investigating training and workforce data

determining and implementing improvement

writing evaluation reports


Evidence of Knowledge

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

program design considerations (cost, equality, technically valid, ethics)

quantitative and qualitative methods for monitoring and evaluation

data management

Training Packages and accredited courses, and what comprises quality training and assessment services

how training and/or assessment organisations operate

terminology relating to quality evaluation processes

evaluation models/methods

records management systems of the organisation

relevant policy, legislation, codes of practice and national standards, including Commonwealth and state/territory legislation

vocational education and training systems

WHS relating to planning and conducting an evaluation

vocational education regulations


Assessment Conditions

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.


Foundation Skills

The foundation skills demands of this unit have been mapped for alignment with the Australian Core Skills Framework (ACSF). The following tables outline the performance levels indicated for successful attainment of the unit.

ACSF levels indicative of performance:

Further information on ACSF and the foundation skills underpinning this unit can be found in the Foundation Skills Guide on the GSA website.


Competency Field

Evaluation