Assessor Resource

MSS407003A
Analyse process changes

Assessment tool

Version 1.0
Issue Date: April 2024


This unit applies to team leaders, technical experts and people with a similar sphere of influence/scope of authority and responsibility who are already have a knowledge of statistics used in managing operations and of process capability improvement and some knowledge of factorial design, the selection and analysis of appropriate metrics, and the discrimination between valid and invalid interpretations of data. Where this is not the caseMSS404050A Undertake process capability improvements and MSS404052A Apply statistics to operational processes may be completed to supply the necessary statistical skills.

If this unit is being applied to a complex change process or a complex operations process, it may be an advantage to have completed MSS405052A Design an experiment before completing this unit. Where this unit is being applied in a six sigma environment then knowledge and skill in six sigma techniques may also be an advantage. MSS405053A Manage application of six sigma for process control and improvement can be completed to supply these skills.

The unit applies to reviews of both intended and unintended consequences of change and the effectiveness of the implementation of the change. This unit is not intended to be applied to a technical or engineering review of a major capital expenditure or similar.

This unit takes a largely quantitative approach to the review. For skills associated with a more qualitative review refer to MSS407005A Undertake a qualitative review of a process change.

This unit may also be applied to service organisations applying competitive systems and practices principles.

This unit of competency covers the skills and knowledge required to quantitatively analyse past changes made in an organisation’s the operations, systems, process or environment to ensure the quantum of expected change has been achieved and that gains are maintained and are used as a basis for further gains.

The unit includes statistical and other mathematical analysis of data, methods for capturing data on implemented changes (quantitative and qualitative) and producing useful information from this data. It includes consultation with stakeholders both for data validation and consensus decision-making for future improvements.

You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)

Prerequisites

Not applicable.

Employability Skills

This unit contains employability skills.



Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

The evidence guide provides advice on assessment and must be read in conjunction with the performance criteria, required skills and knowledge, range statement and the Assessment Guidelines for the Training Package.

Critical aspects for assessment and evidence required to demonstrate competency in this unit

A person who demonstrates competency in this unit must be able to provide evidence of the ability to:

analyse process changes

identify changes

gather data and information over a period and range that will provide a valid basis for analysis

select and use appropriate data analysis tools

present information in a suitable form

obtain a consensus view of the results of the change

determine the lessons to be learned and future improvements to be undertaken.

Context of and specific resources for assessment

Assessment of performance must be undertaken in a workplace using or implementing one or more competitive systems and practices.

Access may be required to:

workplace procedures and plans relevant to work area

specifications and documentation relating to planned, currently being implemented, or implemented changes to work processes and procedures relevant to the assessee

documentation and information in relation to production, waste, overheads and hazard control/management

reports from supervisors/managers

case studies and scenarios to assess responses to contingencies.

Method of assessment

A holistic approach should be taken to the assessment.

Competence in this unit may be assessed by using a combination of the following to generate evidence:

demonstration in the workplace

workplace projects

suitable simulation

case studies/scenarios (particularly for assessment of contingencies, improvement scenarios, and so on)

targeted questioning

reports from supervisors, peers and colleagues (third-party reports)

portfolio of evidence.

In all cases it is expected that practical assessment will be combined with targeted questioning to assess underpinning knowledge.

Where applicable, reasonable adjustment must be made to work environments and training situations to accommodate ethnicity, age, gender, demographics and disability.

Guidance information for assessment

Assessment processes and techniques must be culturally appropriate and appropriate to the language and literacy capacity of the candidate and the work being performed.

Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here

Assessment task 1: [title]      Due date:

(add new lines for each of the assessment tasks)

Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

Required skills

Required skills include:

researching past performance of plant, operations, products and procedures, including metrics used

identifying trends, causal relationships and correlations in metrics

communicating and explaining quantitative data with others across a range of numeracy and literacy levels

analysing views and reasons put forward by others on past performance and relating to evidence

analysing views and reasons put forward by others for future changes and improvements and form recommendations

identifying key HSE strategies and risks for area of responsibility and identifying sources of expert assistance

preparing submissions and presenting case for future changes

Required knowledge

Required knowledge includes:

competitive systems and practices principles, processes and techniques

organisational goals, products and processes

processes and procedures for continuous improvement in the workplace

statistical process control (SPC) and principles

methods of determining the impact of a change using quantitative analysis of process data, including advanced statistical/mathematical analysis and basic qualitative techniques

organisation metrics

sources of data (actual and possible) within the organisation and the value stream

range of typical metrics, their applications and limitations

The range statement relates to the unit of competency as a whole. It allows for different work environments and situations that may affect performance. Bold italicised wording, if used in the performance criteria, is detailed below. Essential operating conditions that may be present with training and assessment (depending on the work situation, needs of the candidate, accessibility of the item, and local industry and regional contexts) may also be included.

Competitive systems and practices

Competitive systems and practices may include, but are not limited to:

lean operations

agile operations

preventative and predictive maintenance approaches

monitoring and data gathering systems, such as Systems Control and Data Acquisition (SCADA) software, Enterprise Resource Planning (ERP) systems, Materials Resource Planning (MRP) and proprietary systems

statistical process control systems, including six sigma and three sigma

Just in Time (JIT), kanban and other pull-related operations control systems

supply, value, and demand chain monitoring and analysis

5S

continuous improvement (kaizen)

breakthrough improvement (kaizen blitz)

cause/effect diagrams

overall equipment effectiveness (OEE)

takt time

process mapping

problem solving

run charts

standard procedures

current reality tree

Competitive systems and practices should be interpreted so as to take into account:

the stage of implementation of competitive systems and practices

the size of the enterprise

the work organisation, culture, regulatory environment and the industry sector

Codes of practice/standards

Where changes include areas covered by industry codes of practice, and/or Australian/international standards, the latest version must be used

Gather prior data

Where all suitable data was not collected prior to the change a suitable proxy for the data will be needed

HSE

All changes implemented are expected to be at least neutral, or preferably beneficial, in their impact on HSE

Change

Changes may:

be to plant, operations, products, procedures or practice

arise from continuous improvement (or an improvement event/project) or implementing new products, technology or systems

may have been intended to make an improvement or to implement new products, technology or systems

include the implementation of a change

Changes do not include an engineering review of a major capital expenditure or similar review

Initiation of change

Changes need to be identified as either deliberately or not deliberately initiated. Where a change was not deliberately initiated then the causal factors for the change need to be identified

Correlated metrics

Correlated metrics include:

any metric which appears to show a chronological correlation with the change being analysed. These metrics need to be examined to determine if the change has a causal relationship or is simply coincidental

Presentation of information

Information may be presented:

in appropriate visual forms (e.g. graphs, charts and noticeboards

verbally or other forms able to be understood and used by stakeholders

Stakeholders

Stakeholders may include:

work team members

value stream members

managers

Results of change

The change results may include:

an initial improvement followed by a return to previous performance

continued improvement

continued detriment or other variations over time

Improvements

Improvements may:

be to operations, process, plant, procedures or practice

include changes to ensure positive benefits are maintained

Sustaining improvement

Improvement may be sustained by including it in:

standard procedures and work instructions

standard practice

other relevant documents and practices

Team leader

Team leader may include:

any person who may have either a permanent or an ad hoc role in facilitating the function of a team in a workplace

Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.

Observation Checklist

Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice Yes No Comments/feedback
Identify changes which have occurred 
Select a change or group of related changes to analyse 
Determine the initiation of the selected change 
Identify relevant metrics and predicted values for these metrics 
Gather data for these metrics prior to the change 
Gather data and information on the implementation of the change 
Gather data for these metrics after the change 
Survey all key metrics and identify any where variations may correlate with the change being analysed 
Discuss results of change with key stakeholders and identify other possible (qualitative or quantitative) results of the change 
Analyse this data to determine the results of the change 

Forms

Assessment Cover Sheet

MSS407003A - Analyse process changes
Assessment task 1: [title]

Student name:

Student ID:

I declare that the assessment tasks submitted for this unit are my own work.

Student signature:

Result: Competent Not yet competent

Feedback to student

 

 

 

 

 

 

 

 

Assessor name:

Signature:

Date:

Assessment Record Sheet

MSS407003A - Analyse process changes

Student name:

Student ID:

Assessment task 1: [title] Result: Competent Not yet competent

(add lines for each task)

Feedback to student:

 

 

 

 

 

 

 

 

Overall assessment result: Competent Not yet competent

Assessor name:

Signature:

Date:

Student signature:

Date: