Assessor:	Date:
Criteria set:	ID:

Is criteria set intended for use by consumers? [ ] Yes [ ] No [ ] Can't tell
Instructions

• Read through each criteria set (and any ancillary materials provided or referenced).
• Score the criteria set on each of the following evaluation criteria.
• If a criteria set fails to meet
  • X.0 criterion, it automatically fails to meet all subsidiary evaluation criteria
  • All subsidiary criteria (eg, 1.1), it fails the domain criterion (eg, 1.0).
• Y =Yes, N =No, P =Partial (some applicable terms defined operationally; others not); if can't tell, =No.
• After answering Y/N/P to each evaluation criterion, determine
  • If set meets some/all criteria in domain; if only 1 (eg, 2.0), always "yes"
  • If it meets all evaluation domains; "yes," only if all domains ="yes."

Evaluation criterion Met? Yes/No/Partial		Met? Yes	No	Partial
1.0	Is purpose of criteria set defined clearly?	Y	N	P
1.1	Is purpose defined operationally?
	e.g., to permit assessment of reliability/validity of criteria set	Y	N	P
1.2	Is criteria set's scope (operational range/limit) described?	Y	N	P
2.0	Is intended user of criteria set (tool) specified?	Y	N	P
2.1	Does intended user include consumers?	Y	N	P
3.0	Is criteria set sufficiently comprehensive for purpose?	Y	N	P
3.1	Is context/basis of criteria (that constitute set) described?	Y	N	P
3.2	Do criteria encompass all essential dimensions/concepts?	Y	N	P
4.0	Are criteria (in set) defined in operational terms?	Y	N	P
4.1	Are applicable terms defined operationally?	Y	N	P
4.2	Are criteria clear, unambiguous, etc?	Y	N	P
4.3	Is scoring of individual criteria described clearly?	Y	N	P
4.4	Is use (eg, aggregation) of criteria scores explained clearly?	Y	N	P
5.0	Has reliability/validity of criteria set (tool) been tested?	Y	N	P
5.1	Is test design adequate/appropriate for criteria purpose?	Y	N	P
5.1.1	With info given, could another person replicate test?	Y	N	P
5.2	Did test include intended users of criteria set (tool)	Y	N	P
5.2.1	Did test include consumers?	Y	N	P
5.3	Were sources of variation in test results appraised?	Y	N	P
5.4	Were test results analyzed appropriately?	Y	N	P
6.0	Is criteria set (tool) user-friendly (forms, instructions, etc)?	Y	N	P
6.1	Is it consumer-friendly?	Y	N	P

Meets	Some criteria	All criteria	Other assessment
1.0	[ ] Yes [ ] No	[ ] Yes [ ] No
2.0	[ ] Yes [ ] No	[ ] Yes [ ] No
3.0	[ ] Yes [ ] No	[ ] Yes [ ] No
4.0	[ ] Yes [ ] No	[ ] Yes [ ] No
5.0	[ ] Yes [ ] No	[ ] Yes [ ] No
6.0	[ ] Yes [ ] No	[ ] Yes [ ] No
All	[ ] Yes [ ] No	[ ] Yes [ ] No
Comments	[ ] Attached [ ] None	c\hiicu\criteval\19apr03

To return to introduction