DEFTST001
Plan testing and evaluation processes


Application

This unit describes the skills required to plan a test and evaluation process which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; and degree of control. It includes the requirement to identify the scope of the testing process, to determine the testing methodology and to prepare the plan.

This unit was developed for Defence test and evaluation workers, but is applicable to any individuals who work in this field.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work independently or as part of a team, under direct and indirect supervision, use discretion and judgement, and take responsibility for the quality of their output. They would perform sophisticated tasks in a range of contexts.

No licensing, legislative or certification requirements apply to unit at the time of publication.


Elements and Performance Criteria

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Identify testing requirements and undertake scoping

1.1 Analyse the need for testing.

1.2 Undertake definition study where necessary, to determine scope of testing process.

1.3 Complete scoping, identifying rationale for the testing that includes purpose and outcomes.

1.4 Identify and canvas stakeholders to ensure that their requirements are addressed in planning.

2. Determine testing methodology

2.1 Undertake research and analysis to identify impacts and risks, constraining factors and alternate options.

2.2 Analyse methodology technical feasibility, supportability and cost effectiveness and report outcome to key stakeholders.

2.3 Assess alternatives for testing design.

2.4 Identify and report preferred option that fits organisational requirements.

2.5 Consult relevant specialists to determine extent of potential risks.

2.6 Prepare business case and obtain approvals to proceed with test development.

3. Develop test and evaluation plans

3.1 Define aims, objectives and impacts in test plan and timeframes.

3.2 Identify resources to complete quality deliverables on time and within budget.

3.3 Determine test methods by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures.

3.4 Record testing outcomes in measurable and achievable forms.

3.5 Develop indicators to monitor test performance and seek agreement by relevant parties.

3.6 Investigate potential risks and identify them in the plan.

3.7 Establish a risk management process to analyse information and options.

3.8 Clarify and agree on skills, roles and responsibilities of team members and stakeholders, and identify reporting requirements.

3.9 Address management of test parameters in the plan and design evaluation criteria.

3.10 Design and document planning process utilising management tools, in accordance with test and users’ requirements, in consultation with specialists.

4. Finalise test plans

4.1 Maintain security and confidentiality of data.

4.2 Promulgate and maintain test plans.

Evidence of Performance

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

applying risk management techniques

negotiating timelines, roles and responsibilities with stakeholders and team members

scheduling testing activities

use planning techniques related to testing and evaluation that may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control

using public relations strategies to promote and gain endorsement


Evidence of Knowledge

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

approval processes

integrated logistics support

legislation, organisational policy and procedures that may impact on the test and evaluation process

management tools suited to implementing testing processes

organisational change management

principles relating to the implementation phase of testing processes

resource plans

resource scheduling packages

test and evaluation implementation methods which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control

work breakdown structures (WBS)


Assessment Conditions

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.


Foundation Skills

The foundation skills demands of this unit have been mapped for alignment with the Australian Core Skills Framework (ACSF). The following tables outline the performance levels indicated for successful attainment of the unit.

Further information on ACSF and the foundation skills underpinning this unit can be found in the Foundation Skills Guide on the GSA website.


Competency Field

Testing