[SystemSafety] Qualifying SW as "proven in use" [Measuring Software]

[Martyn Thomas]

How are the defects identified so that they can be counted? How is their 
severity determined so that correction can be prioritised?

Martyn

On 18/06/2013 15:22, Thierry.Coq at dnv.com wrote:
> Dear all,
> There is a method, called SQALE (Software Quality Assessment Based on Lifecycle Expectations), for measuring quality: www.sqale.org, and a derivative on PLC code called PSaQC (PLC Software automated Quality Control, or "psychic"). It is based on the fact that the lack of data for software engineering is troublesome, and the lack of data on quality of software.
> SQALE is supported by a number of tool vendors (static analysis), but is not limited to static analysis of code. It is freely usable (see the license).
>
> Organizations are starting to use it for several reasons:
> - it provides an economical way to measure software, in a standard manner, in the project and when accepting the software,
> - it is objective and comparable across languages and techniques (especially the SQALE index density)
> - it measures the "technical debt" present in the software: the amount of work to improve quality to a defined level,
> - it hierarchizes which defects should be corrected first,
> - most basic errors of measuring quality in software have been removed by the SQALE quality and analysis models.
>
> There are limitations:
> - there is no link between a SQALE index and a "probability of failure": SQALE measures basically a defect density. As usual, the relationship between defect density and failures is difficult.
> - it provides a measure of the "internal quality", as seen from a developer or project manager or customer, not a measure directly of the "external quality", of  an end-user for example,
> - measurement points for real-time critical or PLC software are still very insufficient.
>
> Jean-Louis Letouzey has published several papers on SQALE.
> With Jean-Pierre Rosen, we have published data on open source ADA software, as an example of applying SQALE. With Denis Chalon, we have published SQALE data on PLC code.
>
> Comments or suggestions for improvement are welcome.
> I hope this helps.
>
> Thierry Coq
> PS. The opinions expressed here represent my own and not necessarily those of my employer.
>
> -----Original Message-----
> From: systemsafety-bounces at techfak.uni-bielefeld.de [mailto:systemsafety-bounces at techfak.uni-bielefeld.de] On Behalf Of Derek M Jones
> Sent: lundi 17 juin 2013 12:59
> To: systemsafety at techfak.uni-bielefeld.de
> Subject: Re: [SystemSafety] Qualifying SW as "proven in use"
>
> Software engineering has a culture of not measuring and keeping data.
> This is starting to change, but empirical software engineering has only just started:
> http://shape-of-code.coding-guidelines.com/2011/03/31/empirical-software-engineering-is-five-years-old/
> If anybody knows of any interesting datasets do please let me know.
> I am making all data+my analysis code public and so have no interest in data I cannot freely share.