4S Akademi - QAI - Software Testing Principles and Concepts
Download as PPTX, PDF1 like507 views
The document outlines key principles and concepts related to software testing, emphasizing vocabulary, defect understanding, and quality assurance versus quality control. It explains the roles of Software Quality Assurance (SQA) and Software Quality Control (SQC), highlighting their responsibilities in ensuring quality throughout the software development lifecycle. Additionally, it discusses the cost of quality, distinguishing between preventive, appraisal, and failure costs, and the importance of improving software quality to enhance customer satisfaction.
4S Akademi - QAI - Software Testing Principles and Concepts
- 2. Skill Category 1 Software Testing Principles and Concepts
- 3. Topics ⢠The following topics will be discussed in this Skill Category: ⢠Vocabulary & Quality Basics ⢠Understanding Defects ⢠Process and Testing Published Standards ⢠Software Testing ⢠Software Development Life Cycle (SDLC) Models ⢠Agile Development Methodologies ⢠Testing Throughout the SDLC ⢠Testing Schools of Thought and Approaches ⢠Test Categories and Testing Techniques 3
- 4. ⢠Understand the technical terms used to describe various testing techniques, tools, principles, concepts and activities Testing Vocabulary Terminology Requirements-based Testing Risk-based Testing Model-based Testing Exploratory Testing Keyword-driven Testing contingency 4
- 5. Quality 101
- 6. ⢠Activities that modify the development process to prevent the introduction of flaws ⢠Staff function ⢠Implements managementâs quality policies ⢠Responsible for continuous improvement of the software development process ⢠Proactive approach focused on defect prevention ⢠Examples: ⢠Defining change control procedures ⢠Analyzing metrics to identify opportunities for process improvement ⢠Facilitating quality improvement activities Quality Assurance 6
- 7. ⢠Activities within the development process to detect the introduction of flaws ⢠Test planning and execution ⢠Quality control measures a product against the existence of an attribute ⢠Determines whether the product conforms to a standard or procedure (also known as compliance checking). ⢠Proactive approach focused on defect detection ⢠Examples: ⢠Writing and executing test cases and scripts ⢠Participating in verification and validation activities ⢠Reporting defects to identify opportunities for process improvement ⢠Conducting post-project reviews Quality Control 7
- 8. Quality Assurance or Quality Control? Inspection of source code. Unit testing to validate that the program works. Analysis of defects to determine the stage of origin. Analyze metrics collected that measure the effectiveness of system and unit Testing Exercise QA ďą ďą ďą ďą QC ďą ďą ďą ďą 8
- 9. The responsibilities of this job include facilitation, process configuration, measurement, and risk analysis. a) Quality Control b) Quality Assurance The responsibilities of this job include conducting inspections, reviews, testing and focusing on the product. a) Quality Control b) Quality Assurance Exercise 9
- 10. ⢠Your department has always been titled the SQA (Software Quality Assurance) Group. The primary activity of your group is software testing with some minor QA responsibility. Your company is currently reorganizing and you have decided it is a good time to clearly delineate the QC and QA functions. Describe the activities of these two unique groups. Essay (10 Minutes) 10
- 11. SQA is an activity that establishes and evaluates the processes that produce products. The SQA role is to observe that documented standards, processes, and procedures are followed. SQA would also establish software metrics in order to measure the effectiveness of this process. SQA: ⢠helps establish processes. ⢠sets up measurement programs to evaluate processes. ⢠identifies weaknesses in processes and improves them. ⢠is a management responsibility, frequently performed by a staff function. ⢠is concerned with all of the products that will ever be produced by a process. ⢠sometimes called quality control over quality control because it evaluates whether quality control is working. ⢠SQA personnel should never perform quality control unless it is to validate quality control. SQC (testing) takes an active role with Verification and Validation. For example, verification of the requirements would involve inspection (reading) and looking for clarity and completeness. SQC would also verify that any documented requirement standards are followed. SQCâs role is in verifying the output of this process while SQAâs role is to make sure the process is followed correctly. The major SQC role during this process will be testing. SQC would: ⢠relate to a specific product or service. ⢠verifies whether specific attribute(s) are in, or are not in, a specific product or service. ⢠identifies defects for the primary purpose of correcting defects. ⢠is the responsibility of the team/worker. ⢠is concerned with a specific product. Essay (10 Minutes) 11
- 12. Questions? 12
- 13. There are five perspectives of Quality. ⢠Transcendent â I know it when I see it ⢠Product Based â Possesses desired features ⢠User Based â Fitness for use ⢠Development and Manufacturing Based â Conforms to requirements ⢠Value Based â At an acceptable cost The Perspectives of Quality 13
- 14. Quality in Perception is more important to the final customer. How Quality is Defined 14 Producerâs View of Quality Customerâs View of Quality QUALITY IN FACT QUALITY IN PERCEPTION Doing the right thing. Delivering the right product. Doing it the right way. Satisfying our customerâs needs. Doing it right the first time. Meeting the customerâs expectations. Doing it on time. Treating every customer with integrity, courtesy, and respect.
- 15. An organizationâs quality policy must define and view quality from their customer's perspectives. If there are conflicts, they must be resolved. Two Working Definitions: The Two Quality Gaps 15 Producerâs View Meets requirements Consumerâs View Fit for use Start Producer Gap Customer Gap Quality as delivered
- 16. ⢠Focus on the Customer ⢠Customer Satisfaction is the essence of a Quality Product ⢠Customer may be internal or external ⢠Internal customer receives anything passed between groups ⢠External customer uses the products or services provided by the organization Quality Message 16
- 17. There are many ways to improve Software Quality ⢠Software Quality Objectives ⢠Software Quality Assurance Activities ⢠Testing Strategy ⢠Software Engineering Guidelines ⢠Formal and Informal Technical Reviews ⢠Audits ⢠Process Improvement ⢠Change Control Processes ⢠Measurement, Prototyping, and Proof Improving Software Quality 17
- 18. ⢠Money spent beyond the cost to build the product right the first time ⢠Frequently referred to today as Cost of Non Quality or Cost of Poor Performance Cost of Quality 18 Failure Cost Appraisal Cost Prevention Cost Cost of Production CostofQuality Testing is a part of the cost of quality BuildCost Total Production Cost
- 19. ⢠Preventive Costs - Costs associated with preventing errors ⢠Training ⢠Establishing methods and procedures ⢠Tool acquisition ⢠Appraisal Costs - Costs associated with the detection of errors ⢠Inspections ⢠Testing ⢠Failure Costs - Costs associated with defective products delivered to customers ⢠Analyze, correct and retest defects ⢠Staffing Help Desk ⢠Damage caused by defect ⢠Damage caused by defect ⢠Idle users Cost of Quality 19
- 20. Mark âPâ for Prevention; âAâ for Appraisal; âFâ for Failure: 1) Conducting Reviews and Inspections 2) Implementing Standards 3) Conducting Rework 4) Attending Training/Education 5) Planning for Quality 6) Code Inspection 7) Cancelled Projects 8) Failure & Recovery of Data 9) Defect Reporting Standards 10) Quality Improvement 11) Testing 12) Conducting a Post Project Review 13) Lost Benefits Cost of Quality 20 A P F P P A F F P P A A F
- 21. Which of the following is NOT a category of the Cost of Quality? a) Failure Cost b) Appraisal Cost c) Build Cost d) Preventive Cost In defining the cost of quality, appraisal costs are BEST described as: a) Costs incurred to review completed products against requirements b) Costs which can not be recouped c) All costs associated with defective products d) None of the above Exercise 21
- 22. ⢠Cost of Quality will vary from Organization to Organization Cost of Quality â Iceberg Diagram 22 Rework Testing Costs Rejects Waste Customer Returns Inspection Costs Recalls Excessive Overtime Pricing or Billing Errors Excessie Employee Fluctuation Excessive IT System Costs Excessive Field Service Expenses Planning Delays Development Cost of Failed Product Late Paperwork Access Inventory Unused Capacity Incorrectly Completed Sales Order Complaint Handling Time with Dissatisfied Customer
- 24. Cost of Quality - ROI 24
- 25. ⢠The âcost of qualityâ (COQ) isnât the price of creating a quality product or service. Itâs the cost of NOT creating a quality product or service. Explain what methods you would use to reduce the Cost of Quality as a function of optimizing the development and testing process. Essay (5 minutes) 25
- 26. ⢠The majority of costs associated with the Cost of Quality are associated with the identification and correction of defects. ⢠Minimize production costs: ⢠focus on defect prevention ⢠SQA must: ⢠identify the costs within COQ categories ⢠quantify them ⢠develop programs to minimize costs ⢠Applying the concepts of continuous testing to the systems development process can reduce the cost of quality. Essay (5 minutes) 26
Editor's Notes
- #4: In this section weâll review basic quality principles and learn to distinguish between QA and QC. We will start our discussion of defects and then continue with it in a later skill set. In the course we will look at three published processes or standards â more are discussed in the CBOK. We will start our discussion of Software testing and what it is and is not along with the factors impacting Software Testing. Several software development life cycle models will be discussed along with the various phases of testing (model dependent) and why we test throughout the SDLC. We highlight some of the more well known Schools of Thought and Approaches and finish the section with some Categories and techniques. This section provides the basis for all the following sections. It is the longest section and needs to be fully mastered for the exam.
- #5: Vocabularies are not consistent from company to company and sometimes within companies. It is suggested that you get a common vocabulary for your organization and publish it. Many vocabularies are available from the internet or from standards associations. The key reason for a vocabulary is the have a common understanding across the organization and reduce miscommunications rework.
- #6: The Quality Assurance function is charged with implementing the quality policy established by executive management. QAI recommends that the QA director position be a strong leadership position, and emphasizes the strong interpersonal skills necessary to successfully execute activities involved in making improvement occur. On Test: management responsible for quality, workers responsible for QC QA tip-offs for questions: metrics, measure, analyze, process, how it is done
- #7: The Quality Assurance function is charged with implementing the quality policy established by executive management. QAI recommends that the QA director position be a strong leadership position, and emphasizes the strong interpersonal skills necessary to successfully execute activities involved in making improvement occur. On Test: management responsible for quality, workers responsible for QC QA tip-offs for questions: metrics, measure, analyze, process, how it is done
- #8: QC deals with products. Test cases, of course Finding poorly defined requirements (not just execution testing) is a huge part of QC and will be covered in detail later. Inspections and reviews are not QA â they deal with products and are considered QC.
- #9: Answers next slide: QC QC QA QA
- #10: Answers are sequential on this same slide QA QC
- #14: You have probably encountered these at one time or another somewhere. They should be familiar to you for the exam.
- #15: Townsendâs Quality Plan. You should know the differences between the two views and the problems they cause as exemplified on the next slide.
- #16: Quality: A product is a quality product if it is defect free. To the producer, a product is a quality product if it meets or conforms to the statement of requirements that defines the product. This statement is usually shortened to: quality means it meets requirements. From a customerâs perspective, quality means âfit for useâ whatever that use may be. Ask which is better view? Fit for use â i.e. the customer defines Quality not the Producer. Know these two views and methods used to close the gap pictured.
- #17: QAI focuses on the customer as the important party. The customer can be ANYONE who receives something from you. In some organizations it is easier to identify the internal customer; in others it is easy to figure out the external customer. Regardless, you must identify your customer and determine how to satisfy them.
- #18: We will be discussing most of these in detail in the remaining skill sets. For the exam, you should know some of these.
- #19: You need to know what is COQ and what is not. Also short definitions of each one. Lastly where to expend funds for the best return.
- #20: The total production costs associated with the delivery of software applications include both the actual production costs and the cost of quality. The first component - production costs - consists of the costs associated with producing the product âright the first time,â or RTF costs. These costs include labor, materials, and equipment (hardware, software, tools) associated with the actual development of the application. The second component includes the additional costs associated with assuring that the product delivered meets the quality goals established for the product. This cost component is called the Cost of Quality, and includes all costs associated with the prevention, identification, and correction of product defects (includes repair and damage costs.) The cost of quality will vary from one organization to the next. The majority of costs associated with the Cost of Quality are associated with the identification and correction of defects
- #21: Answers: By Group: Prevention: 2,4,5,9,10 Appraisal: 1,6,11,12 Failure: 3,7,8,13 By Item: A P F P P A F F P P A A (this is the QC of process conformance.) F (this is maintenance, not enhancements. Maintenance occurs because something wasnât rightâŚproduction bugs, misunderstood requirements, incorrectly implemented requirements.)
- #22: Answers: C, A. Sequential on same slide on click. Test taking tips: Especially if English is 2nd language, delete NOT, see what is true, answer is the leftover one. If unsure of answer, choose the longest one. âAll of the aboveâ usually true 90 percent of the time ânone of the aboveâ almost never true
- #23: 50% COQ 3% Preventative 7% Appraisal 40% Failure Note all the items that are hidden on the first look at the âicebergâ. 90% is below the surface and requires metrics and analysis to find, calculate and solve.
- #25: Note the investment or increase in Prevention to slightly reduce Appraisal and substantially reduce PONC (Failure). Investment in Prevention is considered to generate the greatest ROI.