[SystemSafety] N-version programming moves the goal posts
Derek M Jones
derek at knosof.co.uk
Wed Jun 10 14:20:06 CEST 2026
All,
N-version program is a great idea, but it is is also a lot
more expensive. At least until LLMs came along.
This paper
https://arxiv.org/abs/2606.07828
creates five implementations of a 23k line specification.
Five different languages were used for the implementation,
but that is just for bragging rights.
So the correctness issue has now shifted from the code to
the specification.
A few months ago an LLM generated a C compiler. The compiler
did very well on correct code (which is the vast majority of
the training data), but very badly on incorrect code.
https://shape-of-code.com/2026/02/22/investigating-an-llm-generated-c-compiler/
--
Derek M. Jones Evidence-based software engineering
blog:https://shape-of-code.com
More information about the systemsafety
mailing list