This unit describes the skills required to plan a test and evaluation process which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; and degree of control. It includes the requirement to identify the scope of the testing process, to determine the testing methodology and to prepare the plan.
This unit was developed for Defence test and evaluation workers, but is applicable to any individuals who work in this field.
The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.
Those undertaking this unit would work independently or as part of a team, under direct and indirect supervision, use discretion and judgement, and take responsibility for the quality of their output. They would perform sophisticated tasks in a range of contexts.
No licensing, legislative or certification requirements apply to unit at the time of publication.
You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)
Evidence Required
List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.
ELEMENTS
PERFORMANCE CRITERIA
Elements describe the essential outcomes
Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.
1. Identify testing requirements and undertake scoping
1.1 Analyse the need for testing.
1.2 Undertake definition study where necessary, to determine scope of testing process.
1.3 Complete scoping, identifying rationale for the testing that includes purpose and outcomes.
1.4 Identify and canvas stakeholders to ensure that their requirements are addressed in planning.
2. Determine testing methodology
2.1 Undertake research and analysis to identify impacts and risks, constraining factors and alternate options.
2.2 Analyse methodology technical feasibility, supportability and cost effectiveness and report outcome to key stakeholders.
2.3 Assess alternatives for testing design.
2.4 Identify and report preferred option that fits organisational requirements.
2.5 Consult relevant specialists to determine extent of potential risks.
2.6 Prepare business case and obtain approvals to proceed with test development.
3. Develop test and evaluation plans
3.1 Define aims, objectives and impacts in test plan and timeframes.
3.2 Identify resources to complete quality deliverables on time and within budget.
3.3 Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures.
3.4 Record testing outcomes in measurable and achievable forms.
3.5 Develop indicators to monitor test performance and seek agreement by relevant parties.
3.6 Investigate potential risks and identify them in the plan.
3.7 Establish a risk management process to analyse information and options.
3.8 Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements.
3.9 Address management of test parameters in the plan and design evaluation criteria.
3.10 Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists.
4. Finalise test plans
4.1 Maintain security and confidentiality of data.
4.2 Promulgate and maintain test plans.
Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.
applying risk management techniques
negotiating timelines, roles and responsibilities with stakeholders and team members
scheduling testing activities
use planning techniques related to testing and evaluation that may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control
using public relations strategies to promote and gain endorsement
Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.
approval processes
integrated logistics support
legislation, organisational policy and procedures that may impact on the test and evaluation process
management tools suited to implementing testing processes
organisational change management
principles relating to the implementation phase of testing processes
resource plans
resource scheduling packages
test and evaluation implementation methods which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control
work breakdown structures (WBS)
Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.
Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.
Submission Requirements
List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here
Assessment task 1: [title] Due date:
(add new lines for each of the assessment tasks)
Assessment Tasks
Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.
ELEMENTS
PERFORMANCE CRITERIA
Elements describe the essential outcomes
Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.
1. Identify testing requirements and undertake scoping
1.1 Analyse the need for testing.
1.2 Undertake definition study where necessary, to determine scope of testing process.
1.3 Complete scoping, identifying rationale for the testing that includes purpose and outcomes.
1.4 Identify and canvas stakeholders to ensure that their requirements are addressed in planning.
2. Determine testing methodology
2.1 Undertake research and analysis to identify impacts and risks, constraining factors and alternate options.
2.2 Analyse methodology technical feasibility, supportability and cost effectiveness and report outcome to key stakeholders.
2.3 Assess alternatives for testing design.
2.4 Identify and report preferred option that fits organisational requirements.
2.5 Consult relevant specialists to determine extent of potential risks.
2.6 Prepare business case and obtain approvals to proceed with test development.
3. Develop test and evaluation plans
3.1 Define aims, objectives and impacts in test plan and timeframes.
3.2 Identify resources to complete quality deliverables on time and within budget.
3.3 Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures.
3.4 Record testing outcomes in measurable and achievable forms.
3.5 Develop indicators to monitor test performance and seek agreement by relevant parties.
3.6 Investigate potential risks and identify them in the plan.
3.7 Establish a risk management process to analyse information and options.
3.8 Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements.
3.9 Address management of test parameters in the plan and design evaluation criteria.
3.10 Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists.
4. Finalise test plans
4.1 Maintain security and confidentiality of data.
4.2 Promulgate and maintain test plans.
Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.
applying risk management techniques
negotiating timelines, roles and responsibilities with stakeholders and team members
scheduling testing activities
use planning techniques related to testing and evaluation that may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control
using public relations strategies to promote and gain endorsement
Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.
approval processes
integrated logistics support
legislation, organisational policy and procedures that may impact on the test and evaluation process
management tools suited to implementing testing processes
organisational change management
principles relating to the implementation phase of testing processes
resource plans
resource scheduling packages
test and evaluation implementation methods which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control
work breakdown structures (WBS)
Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.
Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.
Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.
Observation Checklist
Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice
Yes
No
Comments/feedback
Analyse the need for testing.
Undertake definition study where necessary, to determine scope of testing process.
Complete scoping, identifying rationale for the testing that includes purpose and outcomes.
Identify and canvas stakeholders to ensure that their requirements are addressed in planning.
Undertake research and analysis to identify impacts and risks, constraining factors and alternate options.
Analyse methodology technical feasibility, supportability and cost effectiveness and report outcome to key stakeholders.
Assess alternatives for testing design.
Identify and report preferred option that fits organisational requirements.
Consult relevant specialists to determine extent of potential risks.
Prepare business case and obtain approvals to proceed with test development.
Define aims, objectives and impacts in test plan and timeframes.
Identify resources to complete quality deliverables on time and within budget.
Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures.
Record testing outcomes in measurable and achievable forms.
Develop indicators to monitor test performance and seek agreement by relevant parties.
Investigate potential risks and identify them in the plan.
Establish a risk management process to analyse information and options.
Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements.
Address management of test parameters in the plan and design evaluation criteria.
Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists.
Maintain security and confidentiality of data.
Promulgate and maintain test plans.
Analyse the need for testing.
Undertake definition study where necessary, to determine scope of testing process.
Complete scoping, identifying rationale for the testing that includes purpose and outcomes.
Identify and canvas stakeholders to ensure that their requirements are addressed in planning.
Undertake research and analysis to identify impacts and risks, constraining factors and alternate options.
Analyse methodology technical feasibility, supportability and cost effectiveness and report outcome to key stakeholders.
Assess alternatives for testing design.
Identify and report preferred option that fits organisational requirements.
Consult relevant specialists to determine extent of potential risks.
Prepare business case and obtain approvals to proceed with test development.
Define aims, objectives and impacts in test plan and timeframes.
Identify resources to complete quality deliverables on time and within budget.
Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures.
Record testing outcomes in measurable and achievable forms.
Develop indicators to monitor test performance and seek agreement by relevant parties.
Investigate potential risks and identify them in the plan.
Establish a risk management process to analyse information and options.
Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements.
Address management of test parameters in the plan and design evaluation criteria.
Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists.
Maintain security and confidentiality of data.
Promulgate and maintain test plans.
Forms
Assessment Cover Sheet
DEFTST001 - Plan testing and evaluation processes
Assessment task 1: [title]
Student name:
Student ID:
I declare that the assessment tasks submitted for this unit are my own work.
Student signature:
Result: Competent Not yet competent
Feedback to student
Assessor name:
Signature:
Date:
Assessment Record Sheet
DEFTST001 - Plan testing and evaluation processes
Student name:
Student ID:
Assessment task 1: [title] Result: Competent Not yet competent
(add lines for each task)
Feedback to student:
Overall assessment result: Competent Not yet competent