24 business users of five organisations tested the OEPI system over a period of 4 weeks. The testers represented 11 out of the 12 defined business roles and covered the whole bunch of level of expertises; from environmental experts with deep domain specific knowledge to non-experts.
Based on the impact assessment and requirements analysis 8 evaluation criteria have been defined a) Usability – easy to use, b) Understandability, c) Transparency, d) Time reduction, e) Flexibility, f) Level of confidence of data quality, g) Availability of data and h) Comparability rated by the business users represented in the spider graph.
There were two extreme positions in “availability of data” and “time reduction”. The reason for the low rating of “availability of data” resulted from a test case in the telecommunication sector. Currently there are no real data of telecommunication systems available only theoretical data based on simulation can be used. This sector specific issue has been not in the focus of the OEPI project.
The extreme rating on time reduction resulted from a person who already uses a specific tool and had the opinion that using yet another system for environmental indicators only would increase his work-load. However it is not the intention to substitute tools in operation but integrate and connect them or at least enable the exchange of the results of certain tools with the network.
A number of highlights have been reported as major value of the OEPI system:
• Benchmarking capability with network and external sources
• Access to primary data at lower costs
• A very flexible all in one system providing a very good and fast overview on product and organisational EPIs
by Katrin Mueller