|Workshop on Dependability Benchmarking|
|Classical features such as raw performance
and functionality have long driven the computer industry to improve their
products. But now, dependability and maintainability are seen as equally
important. While there are relatively straightforward ways to evaluate and
compare performance and functionality of different systems or components,
the evaluation of dependability and maintainability features is much more
difficult. Among the challenges that must be addressed are: incorporating
the effects of software failures, characterizing the dependability of opaque
off-the-shelf hardware and software components, including the effects of
typical maintenance, operational, and configuration management procedures,
and accommodating the fact that different application areas have different
requirements for the various factors influencing dependability.
The goal of the Dependability Benchmarking Workshop is to provide a forum for the computer industry and academia to discuss problems associated with the evaluation and characterization of dependability and maintainability of components and computer systems. The identification of dependability benchmarking measures and the essential technologies for dependability benchmarking, including both experimental measuring and modeling technologies, are central aspects of this large discussion meant to garner ideas on practical and cost-effective ways to evaluate dependability and maintainability features.