Assessor Resource

DEFTST006
Analyse test data

Assessment tool

Version 1.0
Issue Date: April 2024


This unit describes the skills required to analyse data collected during a test and evaluation process. It includes establishing trends and relationships in the data, and establishing the acceptability of the data.

This unit was developed for Defence test and evaluation workers, but is applicable to any individuals who work in this field.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work independently or as part of a team, under direct and indirect supervision, use discretion and judgement, and take responsibility for the quality of their output. They would perform complex tasks in a range of contexts.

No licensing, legislative or certification requirements apply to unit at the time of publication.

You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)


Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Perform scientific calculations

1.1 Ensure consistency of raw data with expectations and reasonable ranges.

1.2 Calculate scientific quantities.

1.3 Determine calculated quantities and estimations.

1.4 Present results using the appropriate units, uncertainties and number of significant figures.

2. Analyse trends and relationships in data

2.1 Determine relationships between sets of data.

2.2 Prepare and analyse data to determine if a process is in control.

2.3 Identify possible causes for out of control condition.

3. Determine variation and/or uncertainty in data distributions

3.1 Organise raw data into appropriate frequency distributions.

3.2 Calculate statistical properties for ungrouped and grouped data.

3.3 Interpret statistical properties to determine characteristics of sample or population.

3.4 Calculate standard deviations and confidence limits for means and replicates.

3.5 Determine uncertainty in measurements using statistical analysis.

3.6 Determine data acceptability using statistical tests and organisational procedures.

4. Check for aberrant results

4.1 Identify results that cannot be reconciled with documentation, testing procedures and/or expected outcomes.

4.2 Determine appropriate actions in consultation with supervisor as required.

5. Maintain results

5.1 Store, retrieve and manipulate data following document traceability procedures.

5.2 Present results in an appropriate format.

5.3 Verify entry of data and results.

5.4 Maintain security and confidentiality of data.

5.5 Prepare reports in a format and style consistent with their intended use and organisational guidelines.

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

completing mathematical calculations involving fractions, decimals, ratios, proportions and percent

evaluating mathematical formulae

interpreting scientific properties

preparing and interpreting graphs and data

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

characteristics of a valid measurement

procedures for data traceability

procedures for maintaining and filing records, security of data

procedures for verifying data and rectifying mistakes

relevant scientific terminology

sources of uncertainty in measurements

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.

Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here

Assessment task 1: [title]      Due date:

(add new lines for each of the assessment tasks)

Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Perform scientific calculations

1.1 Ensure consistency of raw data with expectations and reasonable ranges.

1.2 Calculate scientific quantities.

1.3 Determine calculated quantities and estimations.

1.4 Present results using the appropriate units, uncertainties and number of significant figures.

2. Analyse trends and relationships in data

2.1 Determine relationships between sets of data.

2.2 Prepare and analyse data to determine if a process is in control.

2.3 Identify possible causes for out of control condition.

3. Determine variation and/or uncertainty in data distributions

3.1 Organise raw data into appropriate frequency distributions.

3.2 Calculate statistical properties for ungrouped and grouped data.

3.3 Interpret statistical properties to determine characteristics of sample or population.

3.4 Calculate standard deviations and confidence limits for means and replicates.

3.5 Determine uncertainty in measurements using statistical analysis.

3.6 Determine data acceptability using statistical tests and organisational procedures.

4. Check for aberrant results

4.1 Identify results that cannot be reconciled with documentation, testing procedures and/or expected outcomes.

4.2 Determine appropriate actions in consultation with supervisor as required.

5. Maintain results

5.1 Store, retrieve and manipulate data following document traceability procedures.

5.2 Present results in an appropriate format.

5.3 Verify entry of data and results.

5.4 Maintain security and confidentiality of data.

5.5 Prepare reports in a format and style consistent with their intended use and organisational guidelines.

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

completing mathematical calculations involving fractions, decimals, ratios, proportions and percent

evaluating mathematical formulae

interpreting scientific properties

preparing and interpreting graphs and data

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

characteristics of a valid measurement

procedures for data traceability

procedures for maintaining and filing records, security of data

procedures for verifying data and rectifying mistakes

relevant scientific terminology

sources of uncertainty in measurements

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.

Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.

Observation Checklist

Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice Yes No Comments/feedback
Ensure consistency of raw data with expectations and reasonable ranges. 
Calculate scientific quantities. 
Determine calculated quantities and estimations. 
Present results using the appropriate units, uncertainties and number of significant figures. 
Determine relationships between sets of data. 
Prepare and analyse data to determine if a process is in control. 
Identify possible causes for out of control condition. 
Organise raw data into appropriate frequency distributions. 
Calculate statistical properties for ungrouped and grouped data. 
Interpret statistical properties to determine characteristics of sample or population. 
Calculate standard deviations and confidence limits for means and replicates. 
Determine uncertainty in measurements using statistical analysis. 
Determine data acceptability using statistical tests and organisational procedures. 
Identify results that cannot be reconciled with documentation, testing procedures and/or expected outcomes. 
Determine appropriate actions in consultation with supervisor as required. 
Store, retrieve and manipulate data following document traceability procedures. 
Present results in an appropriate format. 
Verify entry of data and results. 
Maintain security and confidentiality of data. 
Prepare reports in a format and style consistent with their intended use and organisational guidelines. 
Store, retrieve and manipulate data following document traceability procedures. 
Present results in an appropriate format. 
Verify entry of data and results. 
Maintain security and confidentiality of data. 
Prepare reports in a format and style consistent with their intended use and organisational guidelines. 
Ensure consistency of raw data with expectations and reasonable ranges 
 
 
 
Determine relationships between sets of data 
 
 
Organise raw data into appropriate frequency distributions 
 
 
 
 
 
Identify results that cannot be reconciled with documentation, testing procedures and/or expected outcomes 
Store, retrieve and manipulate data following document traceability procedures 
 
 
 
 

Forms

Assessment Cover Sheet

DEFTST006 - Analyse test data
Assessment task 1: [title]

Student name:

Student ID:

I declare that the assessment tasks submitted for this unit are my own work.

Student signature:

Result: Competent Not yet competent

Feedback to student

 

 

 

 

 

 

 

 

Assessor name:

Signature:

Date:

Assessment Record Sheet

DEFTST006 - Analyse test data

Student name:

Student ID:

Assessment task 1: [title] Result: Competent Not yet competent

(add lines for each task)

Feedback to student:

 

 

 

 

 

 

 

 

Overall assessment result: Competent Not yet competent

Assessor name:

Signature:

Date:

Student signature:

Date: