Code	Evaluation Criterion	Number Meeting	Percent Meeting
1.0	Is purpose of criteria set defined clearly?	17	77%
1.1	Is purpose defined operationally?	4	18%
1.2	Is criteria set’s scope (operational range/limit) described?	5	23%
2.0	Is intended user of criteria set (tool) specified?	9	41%
2.1	Does intended user include consumers?	5	23%
3.0	Is criteria set sufficiently comprehensive for purpose?	15	68%
3.1	Is context/basis of criteria (that constitute set) described?	10	46%
3.2	Do criteria encompass all essential dimensions/concepts?	2	9%
4.0	Are criteria (in set) defined in operational terms?	6	27%
4.1	Are applicable terms defined operationally?	6	27%
4.2	Are criteria clear, unambiguous, etc?	5	23%
4.3	Is scoring of individual criteria described clearly?	3	14%
4.4	Is use (e.g., aggregation) of criteria scores explained clearly?	3	14%
5.0	Has reliability/validity of criteria set (tool) been tested?	0	0%
5.1	Is test design adequate/appropriate for criteria purpose?	0	0%
5.1.1	With info given, could another person replicate test?	0	0%
5.2	Did test include intended users of criteria set (tool)?	0	0%
5.2.1	Did test include consumers?	0	0%
5.3	Were sources of variation in test results appraised?	0	0%
5.4	Were test results analyzed appropriately?	0	0%
6.0	Is criteria set (tool) user-friendly (forms, instructions, etc)?	14	64%
6.1	Is it consumer-friendly?	13	59%

To return to introduction