DEFSIM007 - Conduct simulator performance evaluation assessment tool

Assessor Resource

DEFSIM007
Conduct simulator performance evaluation

Assessment tool

Version 1.0
Issue Date: April 2024

This unit describes the knowledge and skills required to evaluate the operational performance of components and/or elements of a simulator. This includes identifying the performance evaluation requirement, conducting the operational performance evaluation, analysing the results, and the documentation and certification processes. In the context of this unit, simulators are used to replicate land, air, sea and undersea systems to facilitate training and development.

The simulator components include the complete simulator, power distribution and control systems, computers and peripheral hardware, image generator and visual display systems, motion and control loading systems, sound systems and weapons systems.

The simulator elements include subjective tests and credit sequences which affect the operational performance of the simulator.

The outcomes of the performance evaluation include immediate fault finding and repair, scheduling the simulator for routine maintenance or calibration of simulator systems.

This unit was developed in a Defence environment but may be relevant to others who work in this field.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work independently, or as part of a team, with minimal supervision, while performing complex tasks, including complex problem solving, in a limited range of contexts. They would use discretion and judgement and take responsibility for the quality of their outputs.

No licensing, legislative or certification requirements apply to this unit at the time of publication.

You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)

Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

ELEMENTS	PERFORMANCE CRITERIA
Elements describe the essential outcomes	Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.
1. Identify evaluation requirement	1.1 Identify the type of simulator evaluation to be undertaken. 1.2 Identify the components and/or elements to be evaluated. 1.3 Consult simulator documentation. 1.4 Identify evaluation parameters to be met. 1.5 Prepare simulator for performance evaluation.
2. Undertake performance evaluation	2.1 Conduct performance evaluation. 2.2 Collect and collate evaluation data.
3. Analyse performance results	3.1 Conduct analysis of performance data. 3.2 Identify performance abnormalities. 3.4 Identify cause of performance variations. 3.5 Determine remedial action if necessary.
4. Finalise performance evaluation process	4.1 Complete certification and other documentation for future application. 4.2 Report abnormalities as required.

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

undertaking research and analysis related to simulator operational performance

following logical, complex analysis techniques

using measuring instruments including thermal array recorders, sound analysers, light and chroma meters and acoustic calibrators

following configuration management processes

using tools including signal generators

using appropriate information technology and software including at least one of proprietary simulator management databases, proprietary motion control loading system calibration software, proprietary sound analysis software and proprietary simulator performance test systems

identifying, reviewing and analysing information that may impact on the simulator operational performance

identifying simulator performance abnormalities

determining simulator operational performance remedial action

negotiating and communicating effectively with key stakeholders

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

operational capabilities and limitations of the relevant simulator

simulator operating modules comprising the simulator system being worked on

subjective tests and credit sequences which affect the operational performance of the simulator

calibration methodologies related to the simulator being evaluated

legislative and regulatory requirements related to the simulator being evaluated

organisational policy and procedures related to the relevant simulator

configuration management related to the simulator being evaluated

product knowledge related to systems and/or equipment in service

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.

Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here

Assessment task 1: [title] Due date:

(add new lines for each of the assessment tasks)

Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

ELEMENTS	PERFORMANCE CRITERIA
Elements describe the essential outcomes	Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.
1. Identify evaluation requirement	1.1 Identify the type of simulator evaluation to be undertaken. 1.2 Identify the components and/or elements to be evaluated. 1.3 Consult simulator documentation. 1.4 Identify evaluation parameters to be met. 1.5 Prepare simulator for performance evaluation.
2. Undertake performance evaluation	2.1 Conduct performance evaluation. 2.2 Collect and collate evaluation data.
3. Analyse performance results	3.1 Conduct analysis of performance data. 3.2 Identify performance abnormalities. 3.4 Identify cause of performance variations. 3.5 Determine remedial action if necessary.
4. Finalise performance evaluation process	4.1 Complete certification and other documentation for future application. 4.2 Report abnormalities as required.