Lean Six Sigma Training Guide

If you are planning to take a Lean Six Sigma Black Belt exam and researched internet and realized that Six Sigma certification training courses are too pricey and study materials are not within your budget either, then here is a Solution. This is a free lean six sigma training guide which will help you prepare for American Society for Quality (ASQ) Lean Six Sigma Certification Exam. The six sigma training guide below includes links covering ASQ version of Lean Six Sigma Body of Knowledge. Good Luck!

Lean Six Sigma Black Belt  Certification Exam Preparation Guide based on ASQ Body of Knowledge

This guide will help ASQ Lean Six Sigma Black Belt candidates prepare for a certification exam for FREE. Although this guide is based on the ASQ Lean Six Sigma Black Belt BOK, it will still be useful for candidates seeking lower belt (green belt, yellow belt) certifications.

About ASQ

ASQ (American Society for Quality) is a global community of people dedicated to quality who share the ideas and tools that make our world work better. With individual and organizational members around the world, ASQ has the reputation and reach to bring together the diverse quality champions who are transforming the world’s corporations, organizations and communities to meet tomorrow’s critical challenges.

ASQ provides the quality community with training, professional certifications, and knowledge to a vast network of members of the global quality community. Headquartered in Milwaukee, Wisconsin, USA, ASQ champions people passionate about quality in more than 150 countries. ASQ Global operates National Service Centers in India, China, and Mexico, and has a regional service center in the United Arab Emirates, serving the Middle East and North Africa region. ASQ’s global offices provide local access to the quality community, career development, credentials, knowledge, and information services.

I. Enterprise-Wide Deployment

A. Enterprise-wide view

1. History of continuous improvement

Describe the origins of continuous improvement and its impact on other improvement models. (Remember)

General History of Six Sigma

http://www.sixsigmatrainingfree.com/general-history-of-six-sigma–continuous-improvement.html

http://www.sixsigmainstitute.com/sixsigma/index_6sigma.shtml

2. Value and foundations of Six Sigma

Describe the value of Six Sigma, its philosophy, history and goals. (Understand)

https://en.wikipedia.org/wiki/Six_Sigma

http://www.dummies.com/how-to/content/six-sigma-for-dummies-cheat-sheet.html

http://www.skymark.com/resources/methods/sixsigmaquality.asp

3. Value and foundations of Lean

Describe the value of Lean, its philosophy, history and goals. (Understand)

http://www.strategosinc.com/just_in_time.htm

http://en.wikipedia.org/wiki/Lean_manufacturing

http://leanmanufacturingtools.org/39/lean-thinking-lean-principles/

4. Integration of Lean and Six Sigma

Describe the relationship between Lean and Six Sigma. (Understand)

http://www.beyondlean.com/lean-six-sigma.html

http://en.wikipedia.org/wiki/Lean_Six_Sigma

https://elms.faa.gov/skillsoft/Content/oper_11_a01_bs_enusA1.htm

5. Business processes and systems

Describe the relationship among various business processes (design, production, purchasing, accounting, sales, etc.) and the impact these relationships can have on business systems. (Understand)

http://www.thecqi.org/Documents/community/South%20Western/Wessex%20Branch/Systems%20and%20Processes%20article%20by%20David%20Hoyle%20Oct09%20(2).pdf

6. Six sigma and Lean applications

Describe how these tools are applied to processes in all types of enterprises: manufacturing, service, transactional, product and process design, innovation, etc. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_11_a01_bs_enusA1.htm

B. Leadership

1. Enterprise leadership responsibilities

Describe the responsibilities of executive leaders and how they affect the deployment of Six Sigma in terms of providing resources, managing change, communicating ideas, etc. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_11_a03_bs_enusA1.htm

2. Organizational roadblocks

Describe the impact an organization’s culture and inherent structure can have on the success of Six Sigma, and how deployment failure can result from the lack of resources, management support, etc.; identify and apply various techniques to overcome these barriers. (Apply)

http://blog.simplilearn.com/quality-management/organizational-roadblocks-to-lean-six-sigma-how-to-deal-with-them

http://www.sixsigmaonline.org/six-sigma-training-certification-information/articles/common-six-sigma-roadblocks-business-enterprises-experience.html

http://www.isixsigma.com/new-to-six-sigma/roles-responsibilities/champions-role-successful-six-sigma-deployments/

3. Change management

Describe and use various techniques for facilitating and managing organizational change. (Apply)

http://www.lce.com/All_Aboard_LeanSix_Sigma_is_a_journey_best_travelled_with_change_management_561-item.html

4. Six Sigma projects and kaizen events

Describe how projects and kaizen events are selected, when to use Six Sigma instead of other problem-solving approaches, and the importance of aligning their objectives with organizational goals. (Apply)

https://www.iienet2.org/uploadedfiles/Webcasts/KaizenPIDWebinar050410.pdf

5. Six Sigma roles and responsibilities

Describe the roles and responsibilities of Six Sigma participants: black belt, master black belt, green belt, champion, process owners and project sponsors. (Understand)

http://www.sixsigmatrainingfree.com/lean-six-sigma-belt-roles-and-responsibilities.html

II. Organizational Process Management and Measures [9 Questions]

A. Impact on stakeholders

Describe the impact Six Sigma projects can have on customers, suppliers and other stakeholders. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_12_a01_bs_enusA1.htm

B. Critical to x (CTx) requirements

Define and describe various CTx requirements (critical to quality (CTQ), cost (CTC), process (CTP), safety (CTS), delivery (CTD), etc.) and the importance of aligning projects with those requirements. (Apply)

http://www.visionraval.com/six-sigma-critical-to-x-overview/

http://www.isixsigma.com/dictionary/critical-to-quality-ctq/

C. Benchmarking

Define and distinguish between various types of benchmarking, including best practices, competitive, collaborative, etc. (Apply)

http://www.isixsigma.com/methodology/benchmarking/understanding-purpose-and-use-benchmarking/

http://www.slideshare.net/guestbd4baa8/six-sigma-benchmarking

https://elms.faa.gov/skillsoft/Content/oper_12_a01_bs_enusA1.htm

D. Business performance measures

Define and describe various business performance measures, including balanced scorecard, key performance indicators (KPIs), the financial impact of customer loyalty, etc. (Understand)

http://www.angoss.com/wp-content/uploads/2011/05/Key_Performance_Indicators_Six_Sigma_and_Data_Mining.pdf

https://elms.faa.gov/skillsoft/Content/oper_12_a02_bs_enusA1.htm (Skillsoft free training course)

http://www.qualitydigest.com/mar07/articles/04_article.shtml

http://www.sixsigmaonline.org/six-sigma-training-certification-information/articles/six-sigma-customer-satisfaction-and-loyalty.html

http://www.sixsigmaonline.org/six-sigma-training-certification-information/articles/tips-for-creating-key-performance-indicators.html

http://hbr.org/2007/07/using-the-balanced-scorecard-as-a-strategic-management-system/ar/1 (Balanced scorecard)

http://balancedscorecard.org/Resources/AbouttheBalancedScorecard/tabid/55/Default.aspx (Balanced scorecard)

http://en.wikipedia.org/wiki/Balanced_scorecard (Balanced scorecard)

E. Financial measures

Define and use financial measures, including revenue growth, market share, margin, cost of quality (COQ), net present value (NPV), return on investment (ROI), cost-benefit analysis, etc. (Apply)

http://www.managementstudyguide.com/measuring-financial-benefits-of-six-sigma.htm

http://www.mathsisfun.com/money/net-present-value.html (PV, FV and NPV)

https://elms.faa.gov/skillsoft/Content/oper_12_a02_bs_enusA1.htm#ExpectedDuration (ROI, PV, Cost Benefit, Margin, Revenue Growth, Revenue)

http://www.mathsisfun.com/money/net-present-value.html (PV, FV and NPV)

III. Team Management [16 Questions]

A. Team formation

1. Team types and constraints

Define and describe various types of teams (e.g., formal, informal, virtual, cross-functional, self-directed, etc.), and determine what team model will work best for a given situation. Identify constraining factors including geography, technology, schedules, etc. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_13_a01_bs_enusA1.htm#Overview

http://www.managementstudyguide.com/types-of-teams.htm

2. Team roles

Define and describe various team roles and responsibilities, including leader, facilitator, coach, individual member, etc. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_13_a01_bs_enusA1.htm#Overview

3. Team member selection

Define and describe various factors that influence the selection of team members, including required skills sets, subject matter expertise, availability, etc. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_13_a01_bs_enusA1.htm#Overview

4. Launching teams

Identify and describe the elements required for launching a team, including having management support, establishing clear goals, ground rules and timelines, and how these elements can affect the team’s success. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_13_a01_bs_enusA1.htm#Overview

B. Team facilitation

1. Team motivation

Describe and apply techniques that motivate team members and support and sustain their participation and commitment. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_13_a02_bs_enusA1.htm

2. Team stages

Facilitate the team through the classic stages of development: forming, storming, norming, performing and adjourning. (Apply)

http://www.projectsmart.co.uk/the-five-stages-of-team-development-a-case-study.php

http://www.isixsigma.com/implementation/teams/success-development-stages-six-sigma-teams/

3. Team communication       

Identify and use appropriate communication methods (both within the team and from the team to various stakeholders) to report progress, conduct milestone reviews and support the overall success of the project. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_13_a02_bs_enusA1.htm

C. Team dynamics

Identify and use various techniques (e.g., coaching, mentoring, intervention, etc.) to overcome various group dynamic challenges, including overbearing/dominant or reluctant participants, feuding and other forms of unproductive disagreement, unquestioned acceptance of opinions as facts, groupthink, floundering, rushing to accomplish or finish, digressions, tangents, etc. (Evaluate)

http://www.mindtools.com/pages/article/improving-group-dynamics.htm

http://www1.wfh.org/publication/files/pdf-1245.pdf

http://pattan.net-website.s3.amazonaws.com/images/2014/01/28/04_Tyree_7_of_7.pdf (Ten common group problems)

D. Time management for teams

Select and use various time management techniques including publishing agendas with time limits on each entry, adhering to the agenda, requiring pre-work by attendees, ensuring that the right people and resources are available, etc. (Apply)

E. Team decision-making tools

Define, select and use tools such as brainstorming, nominal group technique, multi-voting, etc. (Apply)

http://www.mindtools.com/brainstm.html (Brain-storming)

http://www.sswm.info/category/planning-process-tools/decision-making/decision-making-tools/deciding-community/nominal-gro (Nominal group technique)

http://asq.org/learn-about-quality/decision-making-tools/overview/multivoting.html (Multi-voting)

F. Management and planning tools

Define, select and apply the following tools: affinity diagrams, tree diagrams, process decision program charts (PDPC), matrix diagrams, interrelationship digraphs, prioritization matrices and activity network diagrams. (Apply)

http://asq.org/learn-about-quality/new-management-planning-tools/overview/overview.html (Seven New Management and Planning Tools in Six Sigma)

http://www.whatissixsigma.net/seven-management-planning-tools/ (Seven New Management and Planning Tools in Six Sigma)

http://en.wikipedia.org/wiki/Seven_Management_and_Planning_Tools (Seven New Management and Planning Tools in Six Sigma)

http://asq.org/healthcare-use/links-resources/affinity-diagram-example.html (Affinity diagram/KJ method)

http://asq.org/learn-about-quality/new-management-planning-tools/overview/tree-diagram.html (Tree diagram)

http://asq.org/learn-about-quality/new-management-planning-tools/overview/process-decision-program-chart.html (process decision program charts (PDPC))

http://asq.org/learn-about-quality/new-management-planning-tools/overview/matrix-diagram.html (Matrix Diagram)

http://asq.org/learn-about-quality/new-management-planning-tools/overview/relations-diagram.html (Relations Diagram or Digraph)

http://asq.org/learn-about-quality/new-management-planning-tools/overview/arrow-diagram.html (Arrow Diagram)

G. Team performance evaluation and reward

Measure team progress in relation to goals, objectives and other metrics that support team success and reward and recognize the team for its accomplishments. (Analyze)

https://elms.faa.gov/skillsoft/Content/oper_13_a03_bs_enusA1.htm

IV. Define [15 Questions]

A. Voice of the customer

1. Customer identification

Segment customers for each project and show how the project will impact both internal and external customers. (Apply)

http://www.six-sigma-material.com/Voice-of-the-Customer.html

https://elms.faa.gov/skillsoft/Content/oper_14_a01_bs_enusA1.htm

http://www.isixsigma.com/methodology/voc-customer-focus/voice-customer-have-you-asked-enough-questions/

http://www.slideshare.net/satya_yudha/voc-yudha

2. Customer feedback

Identify and select the appropriate data collection method (surveys, focus groups, interviews, observation, etc.) to gather customer feedback to better understand customer needs, expectations and requirements. Ensure that the instruments used are reviewed for validity and reliability to avoid introducing bias or ambiguity in the responses. (Apply)

http://www.isixsigma.com/methodology/voc-customer-focus/choosing-best-method-listening-customer/

http://www.isixsigma.com/methodology/voc-customer-focus/turning-customer-data-critical-satisfaction-data/

3. Customer requirements   

Define, select and use appropriate tools to determine customer requirements, such as CTQ flow-down, quality function deployment (QFD) and the Kano model. (Apply)

http://www.micquality.com/six_sigma_glossary/ctq_flowdown.htm (CTQ flow-down/tree)

http://www.mindtools.com/pages/article/ctq-trees.htm (CTQ flow-down/tree)

http://www.me.utexas.edu/~me366j/QFD/Notes.html (Quality Function Deployment)

http://video.mit.edu/watch/lecture-4-quality-function-deployment-qfd-and-house-of-quality-12209/ (Quality Function Deployment_video)

http://asq.org/learn-about-quality/qfd-quality-function-deployment/overview/kano-model.html (Kano Model)

B. Project charter

1. Problem statement

Develop and evaluate the problem statement in relation to the project’s baseline performance and improvement goals. (Create)

http://www.managementstudyguide.com/defining-project-problem-statement.htm

2. Project scope

Develop and review project boundaries to ensure that the project has value to the customer. (Analyze)

http://www.managementstudyguide.com/defining-scope-of-project.htm

3. Goals and objectives

Develop the goals and objectives for the project on the basis of the problem statement and scope. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_14_a02_bs_enusA1.htm

4. Project performance measures

Identify and evaluate performance measurements (e.g., cost, revenue, schedule, etc.) that connect critical elements of the process to key outputs. (Analyze)

https://elms.faa.gov/skillsoft/Content/oper_14_a02_bs_enusA1.htm

C. Project tracking

Identify, develop and use project management tools, such as schedules, Gantt charts, toll-gate reviews, etc., to track project progress. (Create)

https://elms.faa.gov/skillsoft/Content/oper_14_a02_bs_enusA1.htm

V. Measure [26 Questions]

A. Process characteristics

1. Input and output variables

Identify these process variables and evaluate their relationships using SIPOC and other tools. (Evaluate)

http://asq.org/service/body-of-knowledge/tools-sipoc (Sipoc)

http://en.wikipedia.org/wiki/Ishikawa_diagram (Ishikawa / Fishbone diagram)

http://www.six-sigma-material.com/Correlation-Matrix.html (Cause and Effect Matrix)

2. Process flow metrics

Evaluate process flow and utilization to identify waste and constraints by analyzing work in progress (WIP), work in queue (WIQ), touch time, takt time, cycle time, throughput, etc. (Evaluate)

3. Process analysis tools

Analyze processes by developing and using value stream maps, process maps, flowcharts, procedures, work instructions, spaghetti diagrams, circle diagrams, etc. (Analyze)

http://www.nwlean.net/toolsCD/VSM/4%20steps%20to%20VSM.pdf (Value Stream Maps)

http://www.six-sigma-material.com/Process-Maps.html (Process Map)

http://www.dummies.com/how-to/content/how-to-break-down-process-flow-for-a-six-sigma-ini.html (Process mapping)

http://www.sixsigmatrainingfree.com/commonly-used-lean-six-sigma-flowchart-symbols.html (Flowchart symbols)

http://www.breezetree.com/article-excel-flowchart-shapes.htm (Flowchart symbols)

https://www.moresteam.com/toolbox/value-added-flow-chart.cfm (Value Added Flowchart)

http://www2.bgsu.edu/colleges/technology/faculty/sinn/LSSQTT%20Tool%2017.pdf (Procedures / SOP)

http://www.sixsigmatraining.org/lean-six-sigma/lean-six-sigma-improvement-and-work-design-part-4.html (Work Instructions)

http://www.systems2win.com/solutions/jobInstructions.htm (Work Instructions)

http://asq.org/learn-about-quality/process-analysis-tools/overview/spaghetti-diagram.html (Spaghetti Diagram)

B. Data collection

1. Types of data

Define, classify and evaluate qualitative and quantitative data, continuous (variables) and discrete (attributes) data and convert attributes data to variables measures when appropriate. (Evaluate)

http://www.six-sigma-material.com/Data-Classification.html

2. Measurement scales

Define and apply nominal, ordinal, interval and ratio measurement scales. (Apply)

http://www.six-sigma-material.com/Data-Classification.html

3. Sampling methods

Define and apply the concepts related to sampling (e.g., representative selection, homogeneity, bias, etc.). Select and use appropriate sampling methods (e.g., random sampling, stratified sampling, systematic sampling, etc.) that ensure the integrity of data. (Evaluate)

http://www.six-sigma-material.com/Samples.html

http://www.micquality.com/six_sigma_glossary/sampling_methods.htm

http://www.isixsigma.com/tools-templates/sampling-data/how-determine-sample-size-determining-sample-size/

http://www.isixsigma.com/tools-templates/sampling-data/basic-sampling-strategies-sample-vs-population-data/

http://changingminds.org/explanations/research/sampling/choosing_sampling.htm

http://www.ssc.wisc.edu/~jraymo/links/soc357/class8_F09.pdf

http://psychology.ucdavis.edu/faculty_sites/sommerb/sommerdemo/sampling/types.htm

http://www.micquality.com/six_sigma_glossary/bias.htm (Bias)

http://meera.snre.umich.edu/links-resources/meera-evaluation-glossary/homogeneous-sample (Homogeneity)

http://www.sixsigmadaily.com/terms/inferential-statistics (Inferential Statistics)

4. Collecting data

Develop data collection plans, including consideration of how the data will be collected (e.g., check sheets, data coding techniques, automated data collection, etc.) and how it will be used. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_15_a02_bs_enusA1.htm

C. Measurement systems

1. Measurement methods

Define and describe measurement methods for both continuous and discrete data. (Understand)

https://elms.faa.gov/skillsoft/Content/OPER0195A1.htm

2. Measurement systems analysis

Use various analytical methods (e.g., repeatability and reproducibility (R&R), correlation, bias, linearity, precision to tolerance, percent agreement, etc.) to analyze and interpret measurement system capability for variables and attributes measurement systems. (Evaluate)

https://www.moresteam.com/toolbox/measurement-system-analysis.cfm

http://world-class-quality.com/images/article/20081125225625_MSA%20QW%20Dec06%20article.pdf

http://www.pdfsixsigma.com/support-files/2.3.4_Variable_and_Attribute_MSA.pdf

http://www.conceptmachine.com/files/zeiss/GR&R%20Studies.pdf

http://www.micquality.com/six_sigma_glossary/precision_tolerance_ratio.htm (P/T)

http://www.qualitytrainingportal.com/resources/msa/attribute_measurements.htm

http://www.miconleansixsigma.com/kappa-statistic.html (Kappa)

3. Measurement systems in the enterprise

Identify how measurement systems can be applied in marketing, sales, engineering, research and development (R&D), supply chain management, customer satisfaction and other functional areas. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_15_a03_bs_enusA1.htm

4. Metrology

Define and describe elements of metrology, including calibration systems, traceability to reference standards, the control and integrity of standards and measurement devices, etc. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_15_a03_bs_enusA1.htm

D. Basic statistics

1. Basic terms

Define and distinguish between population parameters and sample statistics (e.g., proportion, mean, standard deviation, etc.) (Apply)

http://www.six-sigma-material.com/Central-Tendency.html (Measures of Central Tendency)

http://www.six-sigma-material.com/Measures-of-Dispersion.html (Measures of Dispersion)

http://bobhall.tamu.edu/FiniteMath/Module8/Introduction.html (Basic Statistics Terms)

http://stattrek.com/sampling/populations-and-samples.aspx (Population vs sample)

http://www.mathsisfun.com/algebra/proportions.html (Proportions)

2. Central limit theorem

Describe and use this theorem and apply the sampling distribution of the mean to inferential statistics for confidence intervals, control charts, etc. (Apply)

http://www.micquality.com/six_sigma_glossary/central_limit_theorem.htm

http://www.dummies.com/how-to/content/how-to-use-the-central-limit-theorem-for-six-sigma.html

3. Descriptive statistics

Calculate and interpret measures of dispersion and central tendency and construct and interpret frequency distributions and cumulative frequency distributions. (Evaluate)

http://www.yale.edu/ynhti/curriculum/units/1986/5/86.05.03.x.html

http://www.statcan.gc.ca/edu/power-pouvoir/ch8/5214814-eng.htm (Frequency and cumulative frequency distributions)

4. Graphical methods

Construct and interpret diagrams and charts, including box-and-whisker plots, run charts, scatter diagrams, histograms, normal probability plots, etc. (Evaluate)

http://www.skymark.com/resources/tools/management_tools.asp

http://www.regentsprep.org/regents/math/algebra/ad3/boxwhisk.htm (Box -and-whisker plot)

http://www.micquality.com/six_sigma_glossary/run_charts.htm (Run Charts)

http://www.dummies.com/how-to/content/how-to-draw-correlations-from-scatter-plots-in-six.html (Scatter Diagram)

https://www.moresteam.com/toolbox/histogram.cfm (Histogram)

http://www.skymark.com/resources/tools/normal_test_plot.asp (Normal Probability Plot)

http://www.processma.com/resource/graphical_analysis.htm (Various Graphs)

http://sixsigmaimprovements.blogspot.com/2012/05/graphical-analysis.html (Various Graphs)

http://realleansixsigmaquality.com/cms/images/ch3svol1.pdf (Six sigma charts and graphs)

5. Valid statistical conclusions

Define and distinguish between enumerative (descriptive) and analytic (inferential) statistical studies and evaluate their results to draw valid conclusions. (Evaluate)

https://statistics.laerd.com/statistical-guides/descriptive-inferential-statistics.php (Descriptive and Inferential Statistics)

E. Probability

1. Basic concepts

Describe and apply probability concepts such as independence, mutually exclusive events, multiplication rules, complementary probability, joint occurrence of events, etc. (Apply)

http://www.discover6sigma.org/post/2005/09/basic-probability-theory/

http://www.cliffsnotes.com/math/statistics/probability/classic-theory

http://onlinestatbook.com/2/probability/basic.html

http://www-math.bgsu.edu/~albert/m115/probability/outline.html

http://www.mathsisfun.com/data/probability.html (What is probability?)

http://www.mathsisfun.com/data/probability-events-types.html (Probability Events)

http://www.mathsisfun.com/data/probability-complement.html (Complementary Probability)

https://www.khanacademy.org/math/probability/independent-dependent-probability

2. Commonly used distributions

Describe, apply and interpret the following distributions: normal, Poisson, binomial, chi square, Student’s t and F distributions. (Evaluate)

http://www.isixsigma.com/tools-templates/statistical-analysis/understanding-statistical-distributions-six-sigma/

http://www.micquality.com/6sigma101/glossary/continuous_distributions.htm#2

http://www.six-sigma-material.com/Normal-Distribution.html (Normal distribution)

http://www.qimacros.com/hypothesis-test/data-normality-test/ (Normality test)

http://www.umass.edu/wsp/resources/poisson/ (Poisson distribution)

http://www.six-sigma-material.com/Binomial-Distribution.html (Binomial distribution)

http://people.richland.edu/james/lecture/m170/ch12-int.html (Chi squared distribution)

http://stattrek.com/probability-distributions/t-distribution.aspx (T student distribution)

http://people.richland.edu/james/lecture/m170/ch13-f.html (F distribution)

3. Other distributions

Describe when and how to use the following distributions: hypergeometric, bivariate, exponential, lognormal and Weibull. (Apply)

http://www.six-sigma-material.com/Hypergeometric-Distribution.html (Hypergeometric distribution)

http://www.micquality.com/six_sigma_glossary/bivariate_distribution.htm (Bivariate distribution)

http://www.public.iastate.edu/~riczw/stat330s11/lecture/lec13.pdf (Exponential distribution)

http://www.free-six-sigma.com/lognormal-distribution.html (Lognormal distribution)

http://www.weibull.com/hotwire/issue14/relbasics14.htm (Weibull distribution)

http://www.six-sigma-material.com/Uniform-Distribution.html (Uniform distribution)

http://www.isixsigma.com/tools-templates/normality/tips-recognizing-and-transforming-non-normal-data/ (Non-normal distributions)

F. Process capability

1. Process capability indices

Define, select and calculate Cp and Cpk to assess process capability. (Evaluate)

http://www.six-sigma-material.com/Process-Capability-Indices.html

http://www.processma.com/resource/capability_analysis.htm

http://www.isixsigma.com/tools-templates/capability-indices-process-capability/cp-cpk-pp-and-ppk-know-how-and-when-use-them/

http://www.cita.org.hk/wp-content/uploads/pms/TrainingMaterials/ProcessCapability.pdf

2. Process performance indices

Define, select and calculate Pp, Ppk and Cpm to assess process performance. (Evaluate)

http://www.six-sigma-material.com/Process-Capability-Indices.html

http://www.processma.com/resource/capability_analysis.htm

http://www.isixsigma.com/tools-templates/capability-indices-process-capability/cp-cpk-pp-and-ppk-know-how-and-when-use-them/

http://www.cita.org.hk/wp-content/uploads/pms/TrainingMaterials/ProcessCapability.pdf

3. Short-term and long-term capability

Describe and use appropriate assumptions and conventions when only short-term data or attributes data are available and when long-term data are available. Interpret the relationship between long-term and short-term capability. (Evaluate)

http://www.dummies.com/how-to/content/short-and-long-term-capability-indices-for-six-sig.htm

http://www.cita.org.hk/wp-content/uploads/pms/TrainingMaterials/ProcessCapability.pdf

4. Process capability for non-normal data

Identify non-normal data and determine when it is appropriate to use Box-Cox or other transformation techniques. (Apply)

http://www.isixsigma.com/tools-templates/capability-indices-process-capability/process-capability-calculations-non-normal-data/

http://www.isixsigma.com/tools-templates/normality/tips-recognizing-and-transforming-non-normal-data/

5. Process capability for attributes data

Calculate the process capability and process sigma level for attributes data. (Apply)

http://asqdallas.org/wp-content/uploads/2012/12/AdvProcessCapability-V2.pdf

6. Process capability studies

Describe and apply elements of designing and conducting process capability studies, including identifying characteristics and specifications, developing sampling plans and verifying stability and normality. (Evaluate)

https://qualityamerica.com/knowledgecenter/statisticalprocesscontrol/how_to_perform_a_process_capability_study.asp

http://www.qimacros.com/lean-six-sigma-articles/stability-analysis-vs-capability-analysis/ (Stability)

http://statisticaloutsourcingservices.com/Capability.pdf

7. Process performance vs. specification

Distinguish between natural process limits and specification limits, and calculate process performance metrics such as percent defective, parts per million (PPM), defects per million opportunities (DPMO), defects per unit (DPU), process sigma, rolled throughput yield (RTY), etc. (Evaluate)

http://asq.org/quality-progress/2009/08/34-per-million/perusing-process-performance-metrics.html

VI. Analyze [24 Questions]

A.Measuring and modeling relationships between variables

1. Correlation coefficient

Calculate and interpret the correlation coefficient and its confidence interval, and describe the difference between correlation and causation. (Analyze)

NOTE: Serial correlation will not be tested.

http://www.cliffsnotes.com/math/statistics/bivariate-relationships/correlation

2. Regression

Calculate and interpret regression analysis, and apply and interpret hypothesis tests for regression statistics. Use the regression model for estimation and prediction, analyze the uncertainty in the estimate, and perform a residuals analysis to validate the model. (Evaluate)

NOTE: Models that have non-linear parameters will not be tested.

http://www.cliffsnotes.com/math/statistics/bivariate-relationships/simple-linear-regression

3. Multivariate tools

Use and interpret multivariate tools such as principal components, factor analysis, discriminant analysis, multiple analysis of variance (MANOVA), etc., to investigate sources of variation. (Analyze)

https://elms.faa.gov/skillsoft/Content/oper_16_a02_bs_enusA1.htm

http://www.micquality.com/six_sigma_glossary/multivariate_analysis.htm

4. Multi-vari studies

Use and interpret charts of these studies and determine the difference between positional, cyclical and temporal variation. (Analyze)

http://www.sixsigmaonline.org/Flash_Videos/Supplemental/Printable/08_multivari.pdf

http://0dev.blog.com/2011/06/21/all-about-positional-cyclical-and-temporal-variations/

5. Attributes data analysis

Analyze attributes data using logit, probit, logistic regression, etc., to investigate sources of variation. (Analyze)

https://elms.faa.gov/skillsoft/Content/oper_16_a02_bs_enusA1.htm

http://en.wikipedia.org/wiki/Logistic_regression (Logistic Regression)

http://www.sjsu.edu/people/james.lee/courses/JS203/s1/Binary%20Logistic%20Regression%20Lecture%209.ppt (Binary Logistic Regression)

http://www.theanalysisfactor.com/logistic-regression-models-for-multinomial-and-ordinal-variables/ (Multinominal and Ordinal Regression)

http://rt.uits.iu.edu/visualization/analytics/docs/cdvm-docs/cdvm1.php (Logit vs Probit models)

B. Hypothesis testing

1. Terminology

Define and interpret the significance level, power, type I and type II errors of statistical tests. (Evaluate)

http://www.six-sigma-material.com/Alpha-and-Beta-Risks.html (Alpha and Beta risks)

http://apcentral.collegeboard.com/apc/members/courses/teachers_corner/22815.html (Power 1-Beta)

2. Statistical vs. practical significance

Define, compare and interpret statistical and practical significance. (Evaluate)

http://www.dmaictools.com/dmaic-analyze/hypothesis-testing

3. Sample size

Calculate sample size for common hypothesis tests (e.g., equality of means, equality of proportions, etc.). (Apply)

https://people.richland.edu/james/lecture/m170/ch08-n.html

http://www.isixsigma.com/tools-templates/sampling-data/how-determine-sample-size-determining-sample-size/

http://www.itl.nist.gov/div898/handbook/prc/section2/prc222.htm

http://www.itl.nist.gov/div898/handbook/ppc/section3/ppc333.htm

http://en.wikipedia.org/wiki/Sample_size_determination

4. Point and interval estimates

Define and distinguish between confidence and prediction intervals. Define and interpret the efficiency and bias of estimators. Calculate tolerance and confidence intervals. (Evaluate)

http://blog.minitab.com/blog/adventures-in-statistics/when-should-i-use-confidence-intervals-prediction-intervals-and-tolerance-intervals

http://www.sas.com/resources/whitepaper/wp_4430.pdf

5. Tests for means, variances and proportions

Use and interpret the results of hypothesis tests for means, variances and proportions. (Evaluate)

http://www.sixsigmatrainingfree.com/choosing-a-right-parametric-test.html (Choosing a right test)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/one-sample-z-test (One sample Z test)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/one-sample-t-test (One sample T test)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/two-sample-z-test-for-comparing-two-means (Two sample Z test for comparing two means)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/two-sample-t-test-for-comparing-two-means (Two sample T test for comparing two means / DF for separate s: the smaller of n 1– 1 and n 2– 1 DF for pooled s: df = n 1+ n 2– 2)

http://apcentral.collegeboard.com/apc/members/courses/teachers_corner/49013.html (Why to pool variances)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/paired-difference-t-test (Paired T test)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/test-for-a-single-population-proportion (Z test for a single population proportion)

http://www.cliffsnotes.com/math/statistics/univariate-inferential-tests/test-for-comparing-two-proportions (Z test for a comparing two proportions)

http://www.itl.nist.gov/div898/handbook/eda/section3/eda358.htm (Chi squared test for the variance)

http://people.richland.edu/james/lecture/m113/f_test.html  (F test for Equality of two variances)

6. Analysis of variance (ANOVA)

Select, calculate and interpret the results of ANOVAs. (Evaluate)

http://psychnut.com/statistics/even-more-about-1-way-anova/

http://www.psychstat.missouristate.edu/introbook/sbk27.htm

7. Goodness-of-fit (chi square) tests

Define, select and interpret the results of these tests. (Evaluate)

http://math.hws.edu/javamath/ryan/ChiSquare.html

8. Contingency tables

Select, develop and use contingency tables to determine statistical significance. (Evaluate)

http://math.hws.edu/javamath/ryan/ChiSquare.html

9. Non-parametric tests

Select, develop and use various non-parametric tests, including Mood’s Median, Levene’s test, Kruskal-Wallis, Mann-Whitney, etc. (Evaluate)

http://www.micquality.com/6sigma101/glossary/nonparametric_tests.htm (Nonparametric tests)

http://www.isixsigma.com/tools-templates/hypothesis-testing/understanding-uses-moods-median-test/ (Mood’s Median)

http://en.wikipedia.org/wiki/Levene’s_test (Lavene’s )

http://udel.edu/~mcdonald/statkruskalwallis.html (Kruskal-Wallis)

http://www.isixsigma.com/tools-templates/hypothesis-testing/making-sense-mann-whitney-test-median-comparison/ (Mann-Whitney)

http://www.statisticslectures.com/topics/friedman/ (Friedman)

http://www.scribd.com/fullscreen/75935945?access_key=key-1vck0xmn5rty1fu6jiop (1 sample sign test)

http://www.unm.edu/~marcusj/WilcoxonSR.pdf (Wilcoxon Signed Rank Test)

C. Failure mode and effects analysis (FMEA)

Describe the purpose and elements of FMEA, including risk priority number (RPN), and evaluate FMEA results for processes, products and services. Distinguish between design FMEA (DFMEA) and process FMEA (PFMEA), and interpret results from each. (Evaluate)

http://www.isixsigma.com/tools-templates/fmea/quick-guide-failure-mode-and-effects-analysis/

http://asq.org/learn-about-quality/process-analysis-tools/overview/fmea.html

http://en.wikipedia.org/wiki/Failure_mode_and_effects_analysis

http://www.differencebetween.net/technology/difference-between-dfmea-and-pfmea/ (DFMEA vs FMEA)

http://www.qualitytrainingportal.com/resources/fmea/fmea_dfmea_or_pfmea.htm (DFMEA vs FMEA)

D. Additional analysis methods

1. Gap analysis

Use various tools and techniques (gap analysis, scenario planning, etc.) to compare the current and future state in terms of pre-defined metrics. (Analyze)

http://www.sixsigmaonline.org/six-sigma-training-certification-information/articles/gap-analysis.html

https://www.captechconsulting.com/blog/kyle-fondren/process-power-tools-%E2%80%93-conducting-gap-analysis-while-modeling-the-future-state

http://www.brighthubpm.com/six-sigma/47750-how-is-a-gap-analysis-used-in-the-six-sigma-process/

2. Root cause analysis

Define and describe the purpose of root cause analysis, recognize the issues involved in identifying a root cause, and use various tools (e.g., the 5 whys, Pareto charts, fault tree analysis, cause and effect diagrams, etc.) for resolving chronic problems. (Evaluate)

http://www.isixsigma.com/tools-templates/cause-effect/determine-root-cause-5-whys/ (5 whys)

http://asq.org/learn-about-quality/cause-analysis-tools/overview/pareto.html (Pareto Chart)

http://www.mindtools.com/pages/article/newTED_01.htm (Pareto Analysis)

https://workspace.imperial.ac.uk/insolex/Public/12%20Cause%20N%20Effect%20N%20FTA.pdf (Cause and Effect/ Fishbone / Ishikawa Diagram & Fault Tree Analysis)

http://en.wikipedia.org/wiki/Ishikawa_diagram (Cause and Effect/ Fishbone / Ishikawa Diagram)

3. Waste analysis

Identify and interpret the 7 classic wastes (overproduction, inventory, defects, over-processing, waiting, motion and transportation) and other forms of waste such as resource under-utilization, etc. (Analyze)

http://leanmanufacturingtools.org/77/the-seven-wastes-7-mudas/

http://leanimprovement.blogspot.com/2012/04/tim-woods-7-1-wastes-taken-from-toyota.html

http://www.lean.org/Common/LexiconTerm.aspx?termid=324&height=550&width=700

VII. Improve [23 Questions]

A. Design of experiments (DOE)

1. Terminology

Define basic DOE terms, including independent and dependent variables, factors and levels, response, treatment, error, etc. (Understand)

http://www.micquality.com/six_sigma_glossary/design_of_experiments.htm

https://elms.faa.gov/skillsoft/Content/oper_17_a01_bs_enusA1.htm

https://onlinecourses.science.psu.edu/stat503/node/67

http://www.itl.nist.gov/div898/handbook/pri/section7/pri7.htm

2. Design principles

Define and apply DOE principles, including power and sample size, balance, repetition, replication, order, efficiency, randomization, blocking, interaction, confounding, resolution, etc. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_17_a01_bs_enusA1.htm

https://elms.faa.gov/skillsoft/Content/OPER0211A1.htm

https://elms.faa.gov/skillsoft/Content/oper_09_a01_bs_enusA1.htm

3. Planning experiments

Plan, organize and evaluate experiments by determining the objective, selecting factors, responses and measurement methods, choosing the appropriate design, etc. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_17_a01_bs_enusA1.htm

http://www.micquality.com/six_sigma_glossary/balanced_design.htm (Balanced Design)

http://www.itl.nist.gov/div898/handbook/pri/section3/pri337.htm (Center Point)

4. One-factor experiments

Design and conduct completely randomized, randomized block and Latin square designs and evaluate their results. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_17_a02_bs_enusA1.htm

5. Two-level fractional factorial experiments

Design, analyze and interpret these types of experiments and describe how confounding affects their use. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_17_a02_bs_enusA1.htm

http://www.slideshare.net/tabraham/fractional-factorial-designs

6. Full factorial experiments

Design, conduct and analyze full factorial experiments. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_17_a02_bs_enusA1.htm

B. Waste elimination

Select and apply tools and techniques for eliminating or preventing waste, including pull systems, kanban, 5S, standard work, poka-yoke, etc. (Analyze)

http://www.lean.org/Library/BatchProcessesByArtSmalley.pdf (Pull systems)

http://www.lean-manufacturing-inventory.com/pushvspull.aspx (Pull and Push Systems)

http://www.maine.gov/dhhs/btc/training-material/Lean-Pull.pdf ((Pull and Push Systems))

http://en.wikipedia.org/wiki/Kanban (Kanban)

http://www.epa.gov/lean/environment/methods/fives.htm (5S)

http://blog.gembaacademy.com/2007/02/06/standard-work_06/ (Standard Work)

http://www.systems2win.com/c/time_definitions.htm (Standard Work and other Lean Terms)

http://www.jeffroutzahn.com/Microsoft%20Word%20-%20What%20can%20I%20do%20for%20you.pdf (Standard Work p.7)

http://en.wikipedia.org/wiki/Poka-yoke (Poka-yoke)

C. Cycle-time reduction

Use various tools and techniques for reducing cycle time, including continuous flow, single-minute exchange of die (SMED), etc. (Analyze)

http://en.wikipedia.org/wiki/Continuous-flow_manufacturing (Continuous-flow manufacturing)

http://rasmusson.wordpress.com/2008/04/16/batch-vs-continuous-flow-processing/ (Continuous-flow manufacturing)

http://www.leanproduction.com/smed.html (single-minute exchange of die (SMED))

D. Kaizen and kaizen blitz

Define and distinguish between these two methods and apply them in various situations. (Apply)

http://www.epa.gov/lean/environment/methods/kaizen.htm (Kaizen)

http://en.wikipedia.org/wiki/Kaizen (Kaizen)

http://www.slideshare.net/anandsubramaniam/kaizen-events-blitz-kaikaku-lean-projects (Kaizen and Kaizen Blitz)

http://asq.org/healthcare-use/why-quality/kaizen-blitz.html (Kaizen Blitz Road Map)

E. Theory of constraints (TOC)

Define and describe this concept and its uses. (Understand)

http://www.leanproduction.com/theory-of-constraints.html (Theory of Constraints)

http://www.mindtools.com/pages/article/toc.htm (Theory of Constraints)

http://www.isixsigma.com/methodology/theory-of-constraints/differences-between-theory-constraints-and-six-sigma/ (Six Sigma and Theory of Constraints)

F. Implementation

Develop plans for implementing the improved process (i.e., conduct pilot tests, simulations, etc.), and evaluate results to select the optimum solution. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_17_a03_bs_enusA1.htm

G. Risk analysis and mitigation

Use tools such as feasibility studies, SWOT analysis (strengths, weaknesses, opportunities and threats), PEST analysis (political, environmental, social and technological) and consequential metrics to analyze and mitigate risk. (Apply)

http://www.mindtools.com/pages/article/newTMC_05.htm (SWOT Analysis)

http://www.businessballs.com/swotanalysisfreetemplate.htm (SWOT Analysis)

http://www.businessballs.com/pestanalysisfreetemplate.htm (PEST Analysis)

VIII. Control [21 Questions]

A. Statistical process control (SPC)

1. Objectives

Define and describe the objectives of SPC, including monitoring and controlling process performance, tracking trends, runs, etc., and reducing variation in a process. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_18_a01_bs_enusA1.htm

https://elms.faa.gov/skillsoft/Content/oper_09_a03_bs_enusA1.htm  (Common cause and special cause variation)

2. Selection of variables

Identify and select critical characteristics for control chart monitoring. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a01_bs_enusA1.htm

3. Rational subgrouping

Define and apply the principle of rational subgrouping. (Apply)

http://www.qualityamerica.com/Knowledgecenter/statisticalprocesscontrol/rational_subgroups.asp

4. Control chart selection

Select and use the following control charts in various situations:

individual and moving range (ImR), p, np, c, u, short-run SPC and moving average. (Apply)

http://www.statit.com/services/SPCOverview_mfg.pdf (Control chart types)

http://www.six-sigma-material.com/SPC-Charts.html (SPC Charts)

http://v5.books.elsevier.com/bookscat/samples/9780750665292/9780750665292.PDF (Cusum control chart)

http://www.integral-concepts.com/docs/What%20is%20a%20CUSUM%20Chart%20and%20When%20Should%20I%20Use%20One.pdf (Cusum control chart)

http://www.qualityamerica.com/Knowledgecenter/statisticalprocesscontrol/when_to_use_an_ewma_chart.asp (EWMA chart)

http://www.itl.nist.gov/div898/handbook/pmc/section3/pmc324.htm (EWMA chart)

5. Control chart analysis

Interpret control charts and distinguish between common and special causes using rules for determining statistical control. (Analyze)

http://en.wikipedia.org/wiki/Western_Electric_rules

http://en.wikipedia.org/wiki/Nelson_rules

https://elms.faa.gov/skillsoft/Content/player/OPER0222/output/html/jop0222a.htm

https://www.moresteam.com/toolbox/statistical-process-control-spc.cfm

http://www.qualityamerica.com/Knowledgecenter/statisticalprocesscontrol/tampering.asp (Tampering)

B. Other control tools          

1. Total productive maintenance (TPM)

Define the elements of TPM and describe how it can be used to control the improved process. (Understand)

http://www.epa.gov/lean/environment/methods/tpm.htm

http://www.businessleaners.com/wp-content/uploads/2011/12/BL-Visual-Factory.pdf

http://en.wikipedia.org/wiki/Total_productive_maintenance

2. Visual factory

Define the elements of a visual factory and describe how they can help control the improved process. (Understand)

http://www.micquality.com/six_sigma_glossary/visual_factory.htm

http://www.kaizen-news.com/go-lean-visual-factory/

http://www.businessleaners.com/wp-content/uploads/2011/12/BL-Visual-Factory.pdf

C. Maintain controls

1. Measurement system re-analysis

Review and evaluate measurement system capability as process capability improves, and ensure that measurement capability is sufficient for its intended use. (Evaluate)

https://elms.faa.gov/skillsoft/Content/oper_18_a02_bs_enusA1.htm

2. Control plan

Develop a control plan for ensuring the ongoing success of the improved process including the transfer of responsibility from the project team to the process owner. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a02_bs_enusA1.htm

D. Sustain improvements

1. Lessons learned

Document the lessons learned from all phases of a project and identify how improvements can be replicated and applied to other processes in the organization. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a03_bs_enusA1.htm

2. Training plan deployment

Develop and implement training plans to ensure continued support of the improved process. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a03_bs_enusA1.htm

3. Documentation

Develop or modify documents including standard operating procedures (SOPs), work instructions, etc., to ensure that the improvements are sustained over time. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a03_bs_enusA1.htm

4. Ongoing evaluation

Identify and apply tools for ongoing evaluation of the improved process, including monitoring for new constraints, additional opportunities for improvement, etc. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_18_a03_bs_enusA1.htm

IX. Design for Six Sigma (DFSS) Frameworks and Methodologies [7 Questions]

A. Common DFSS methodologies

Identify and describe these methodologies. (Understand)

1. DMADV (define, measure, analyze, design and validate)

http://www.whatissixsigma.net/six-sigma-dmadv/

http://www.isixsigma.com/new-to-six-sigma/design-for-six-sigma-dfss/dmaic-versus-dmadv/

http://www.villanovau.com/resources/six-sigma/six-sigma-methodology-dmadv/#.U81tXONdUpk

http://www.slideshare.net/anandsubramaniam/dmaic-vs-dmadv

2. DMADOV (define, measure, analyze, design, optimize and validate)

http://innovationfunda.blogspot.com/2009/08/dfss-methodologies-dmadv-dmadvv-dmadov.html

B. Design for X (DFX)

Describe design constraints, including design for cost, design for manufacturability and producibility, design for test, design for maintainability, etc. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_02_a04_bs_enusA1.htm

C. Robust design and process

Describe the elements of robust product design, tolerance design and statistical tolerancing. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_19_a01_bs_enusA1.htm

D. Special design tools

1. Strategic

Describe how Porter’s five forces analysis, portfolio architecting and other tools can be used in strategic design and planning. (Understand)

https://elms.faa.gov/skillsoft/Content/oper_19_a02_bs_enusA1.htm

2. Tactical

Describe and use the theory of inventive problem-solving (TRIZ), systematic design, critical parameter management and Pugh analysis in designing products or processes. (Apply)

https://elms.faa.gov/skillsoft/Content/oper_19_a02_bs_enusA1.htm

Levels of Cognition based on Bloom’s Taxonomy – Revised (2001)

In addition to content specifics, the subtext for each topic in this BOK also indicates the intended complexity level of the test questions for that topic. These levels are from “Levels of Cognition” (from Bloom’s Taxonomy – Revised, 2001). They are in rank order – from least complex to most complex.

Remember

Recall or recognize terms, definitions, facts, ideas, materials, patterns, sequences, methods, principles, etc.

Understand

Read and understand descriptions, communications, reports, tables, diagrams, directions, regulations, etc.

Apply

Know when and how to use ideas, procedures, methods, formulas, principles, theories, etc.

Analyze

Break down information into its constituent parts and recognize their relationship to one another and how they are organized; identify sublevel factors or salient data from a complex scenario.

Evaluate

Make judgments about the value of proposed ideas, solutions, etc., by comparing the proposal to specific criteria or standards.

Create

Put parts or elements together in such a way as to reveal a pattern or structure not clearly there before; identify which data or information from a complex set is appropriate to examine further or from which supported conclusions can be drawn