Analysis of ISO/IEC 9126 and 25010 Jean-Marc Desharnais
Purpose of the presentation
To present 9126 quality model and actual quality model To give a complete picture from quality model through QMEs
Plan of the presentation
Software properties Presentation of 9126 (generic) Presentation of 25010 (generic) Software product quality and quality in use characteristics and sub characteristics Data quality model and characteristics From Quality Model to QMEs (examples) Conclusion and next steps
Software properties
Presentation of 9126
The ISO quality model has three sub-models of software products quality (internal quality, external quality and quality in use), 10 quality characteristics, 24 sub characteristics and more than 250 measures proposed to quantify these quality characteristics and sub-characteristics; Internal and external quality have the same characteristics and sub characteristics. The difference is in the "quality" measures. Quality in use has no subcharacteristics.
ISO 9126 vision for software quality
Process Influence Process quality Attributes of Internal quality Software product Influence Impact of software products Influence Attributes of Quality in use
Attributes of External quality Dependance Dependance External measure
Dependance Measurement process Internal measures
Quality in use measures
Usability context
ISO 9126-1 9126-
ISO 9126-3 9126-
ISO 9126-2 9126-
ISO 9126-4 9126-
Presentation of ISO/IEC 25010
This International Standard defines:
A software product quality model composed of eight characteristics, which are further subdivided into subcharacteristics that can be measured internally or externally. A system quality in use model composed of five characteristics, which are further subdivided into subcharacteristics that can be measured when a product is used in a realistic context of use.
New quality models: ISO 25010
Software product quality
Software Product Quality
Functional Suitability Reliability Performance efficiency Operability Security Compatibility Maintainability Portability
Functional appropriateness Accuracy
Maturity Availability Fault tolerance Recoverability
Timebehaviour Resource utilisation
Appropriateness recognizability Ease of use User error protection User interface aesthetics Technical learnability Technical accessibility
Confidentiality Integrity Non-repudiation Accountability Authenticity
Co-existence Interoperability
Modularity Reusabillity Analyzability Modifiability Testability
Adaptability Installability Replaceability
Quality in use
Quality in Use
Effectiveness
Efficiency
Satisfaction
Safety
Usability
Effectiveness
Efficiency
Likeability Pleasure Comfort Trust
Economic damage risk Health and safety risk Environmental risk
Learnability Flexibility Accessibility Context conformity
ISO 25021-TR and ISO 9126
Quality
From QME to Software Product Quality
Definition of Internal Quality measures
Based on inspecting static attributes can be used to measure inherent properties of a software work product; Static analysis methods include inspection and automated analysis tools. Work products include requirements and design documents, code, and test procedures
Definition of External Quality measures
Measures of dynamic attributes can be used to measure inherent properties of a software intensive computer system. System-dependent properties of a software product. Measurement is performed when executing the software product in the system environment in which it is intended to operate.
Definition of quality in use
Derived from testing or observing the results of real or simulated use. Measure intrinsic properties of a system that can include software, hardware, communications and users. Also system dependent properties of a softwareintensive system or of a software product. Only achieved in a realistic system environment (in operation).
Data quality model
Data Quality Model
System
Information system
Communication System
Human business process
Computer system
Computer hardware
Software
Target Data
Non target Data
Mechanical system
Data Quality Model (characteristics)
Attribute and QME
Attribute
Inherent property or characteristic of an entity that can me distinguished quantitatively or qualitatively by human or automated means (ISO 15939:2007)
QME
A measure defined in terms of an attribute and the measurement method for quantifying it, including optionally the transformation by a mathematical function, used for constructing quality measures
25021 25022, 25023, 25024 Quality Measure
A measure that is defined as a measurement function of two or more values of quality measure elements
Modle de qualit ISO - ISO 9126:2002
Mesure externe
Quality model Examples
External quality
Efficiency
Characteristics
Sub-characteristics
Time behavior: time behavior of computer during testing
Derived mesures/ quality measures
Name : Response time Purpose of the measure: What is the time taken to complete a specified task? Formula: T = A - B A = Time of gathering the result B = Time of command entry finished
19
Mesure externe exemple
Characteristics: Efficiency Sub-characteristic: Time behaviour Example of measure: Response time
Time of gathering the results
Example :
Time of comman Response time d entry 0 1 finished)
20
Quality in use characteristics
Modle de qualit ISO - ISO 9126:2002 Quality in use: example
Quality model
Quality in use
Characteristic Subcharacteristic
Effectiveness
Measures/attributes
Name : Error frequency Purpose of the measure: What is the frequency of Errors? Formula: X= A / T A=Number of errors made by the user T=Time or number of tasks
22
Error frequency in 9126
Comparison
Link between QMs and QMEs
A measure defined in terms of an attribute and the measurement method for quantifying it, including optionally the transformation by a mathematical function, used for constructing quality measures
Quality Measure Element
Measurement Method
Logical sequence of operations, described generically, used in quantifying an attribute with respect to a specified scale. [ISO/IEC 15939:2007].
Attribute
Inherent property or characteristic of an entity that can be distinguished quantitatively or qualitatively by human or automated means. A QME captures information about a single attribute.
Conclusion
ISO 25010 model is somewhat different from ISO 9126 model:
Relations between system and software in the new model with introduction of the data model (ISO 25012) Quality in use has 5 characteristics instead of 4 without productivity and compliance but adding efficiency, satisfaction and usability Integration of internal and external characteristics and sub characteristics with 2 new characteristics: security and compatibility From there new attributes should be added Data quality model characteristics are not a part of 25021
Next steps
New or actual characteristics and sub characteristics need new quality measures New quality measures could need new QME New quality measures could also used actual QME Some actual QMEs could be obsolete Note: Sub committees 25022, 25023 and 25034 is working closely with the sub committee 25021
