Evaluation of criteria for assessing health websites
Table 4: Number of criteria sets containing a meta-criterion
Code
Criteria Description
Number
Percent (%)
1
Content relevance
1
5
1.1
Purpose/Mission/Scope: Does site state its purpose?
12
55
1.1.1
Does the mission statement convey purpose & scope of website?
3
14
1.1.2
Scope: Does the site state its scope?
1
5
1.1.3
Objective/Goals: Does the site state its objective?
4
18
1.1.4
Does the site indicate the title/subject of site?
1
5
1.2
Audience: Does the site state its intended audience?
12
55
1.3
Relevance: Can one tell easily if what's on site is relevant to search purpose
7
32
1.4
Breadth & depth, Coverage, Uniqueness
6
27
1.4.1
Is the information unique or can it be found elsewhere?
7
32
1.5
Site consists only of links (I.e. no substantive information)?
2
9
1.9
Content, NEC
0
0
2
Content accessibility
7
32
2.1
Comprehensibility: Is site prepared at a level useful to intended audience?
9
41
2.1.1
Is it comprehensible by average consumer?
0
0
2.2
Navigability, logical organization
13
59
2.2.1
Is the information needed to use the eval checklist easily accessible on site?
0
0
2.2.2
Is site content easily accessible?
8
36
2.2.3
Is the site easily navigable?
6
27
2.2.4
Does it contain a search engine?
5
23
2.2.5
Is website designed in a user-friendly manner?
4
18
2.2.6
Is there a site index, table of contents?
3
14
2.3
Does site organize information in a consumer-friendly way?
6
27
2.4
Readability: Is text, graphics, video etc consumer-friendly?
7
32
2.4.1
Does site contain (useful) images?
1
5
2.4.2
Is site available in text only mode?
3
14
2.4.3
If user can't access images, etc, is information still "complete" (useful)?
1
5
2.5
Downloadability
7
32
2.6
Are there conditions to accessing content?
3
14
2.6.1
Is there a fee to access content?
2
9
2.6.2
Does the user have to register?
0
0
2.6.3
Does accessing content require acceptance of cookies?
0
0
2.7
Presentation of website: Is it appealing?
5
23
2.9
Content accessibility, NEC
0
0
3
Content selection/editorial policy
2
9
3.1
Editorial policy, site evaluation process, peer review process
10
46
3.1.1
Was search strategy adequate to the site's purpose?
0
0
3.1.2
Was the selection method adequate to the site's purpose?
0
0
3.2
Conflict of interest, bias, disclosure of sponsorship, funding sources
14
64
3.2.1
Does the site provide a conflict of interest policy?
2
9
3.2.2
Does site report any relationship between authors of content & owner, etc
4
18
3.9
Content selection, NEC
2
9
4
Content validity
12
55
4.1
Does site differentiate between essays/commentaries/opinions/facts?
4
18
4.1.1
Is the information/content thorough and detailed?
1
5
4.1.2
Is the information accurate?
7
32
4.2
Does site give author's information for opinions/reports of facts?
9
41
4.2.1
Author's name
6
27
4.2.2
Author's credentials
12
55
4.3
Does site indicate the date the opinion was written/last updated?
1
5
4.4
For reports of facts does site give source of specific information?
12
55
4.4.1
Link to the source?
1
5
4.4.2
Authors of the source
9
41
4.4.3
Date source information was generated or date the report was published
8
36
4.4.4
Date information was posted on the site
4
18
4.4.5
Bibliography/resource list
3
14
4.4.6
Type of source
2
9
4.5
Does site indicate whether or not it has evaluated specific information?
7
32
4.5.1
If so, does the site describe how the specific information was evaluated?
2
9
4.5.2
Are the methods adequate to their purpose?
0
0
4.6
Does the site state the evidence grade of specific information?
9
41
4.6.1
If so, does the site describe how the evidence grade was assessed?
0
0
4.6.2
Are the methods adequate to their purpose?
0
0
4.7
Does site indicate limitations on applicability of specific information?
8
36
4.8
Does site state whether or not it carries advertising?
3
14
4.8.1
Does site distinguish between advertising and content?
3
14
4.8.2
Does it provide its advertising policy?
3
14
4.8.3
Is its advertising policy appropriate for consumers?
1
5
4.9
Content validity, NEC
1
5
5
Content interchange
2
9
5.1
Is there a way for consumers to request additional information?
6
27
5.2
Does site offer decision support technology?
1
5
5.2.1
If so, does site describe the expert system used for this purpose?
0
0
5.2.2
Are specific caveats given regarding the system's use?
0
0
5.2.3
Does site describe how the DST was developed and validated?
0
0
5.2.4
When was the DST last updated and/or validated?
0
0
5.3
If site offers exchange of information between consumers and health professionals, does the site describe their credentials?
1
5
5.3.1
Is it obvious to the consumers when they are interacting with a professional?
0
0
5.9
Content interchange, NEC
0
0
6
Site transparency/credibility
6
27
6.1
Does the site say who owns or pays for or created it?
17
77
6.1.1
Does it list a physical location, tel number, contact person etc?
1
5
6.2
Does the site say who runs it?
2
9
6.2.1
Does it list a physical location, tel number, contact person etc?
0
0
6.3
Does the site provide email address for the webmaster?
5
23
6.4
Does the site describe the sponsor's purpose or business?
1
5
6.5
Does the site disclose sources of financing of the sponsoring organization?
7
32
6.6
Currency
10
46
6.6.1
When was the site first created?
3
14
6.6.2
How frequently or often is the site/site content updated?
5
23
6.6.3
Does the site indicate when it was last updated?
13
59
6.6.4
Does the site indicate date until which the content/information is valid?
3
14
6.7
Is the site essential "complete"?
1
5
6.8
If site is moderated, is moderator's identity disclosed?
0
0
6.8.1
Are credentials, affiliations, etc of the moderator disclosed?
1
5
6.8.2
Is method used to select moderator disclosed?
1
5
6.9
Site transparency, NEC
2
9
7
Links
3
14
7.1
Does the site link to other sites as sources of health information?
10
46
7.2
Does the site indicate whether or not it has evaluated adequacy of sites?
6
27
7.2.1
If so, does the site describe the basis for such evaluation?
1
5
7.3
Does the site provide appropriate descriptions, disclosures etc about links?
2
9
7.4
Are consumers alerted when they leave the site?
3
14
7.5
Does the site report its policy for periodically checking integrity of links?
8
36
7.6
Does the website contain email links to the authors of the content?
2
9
7.9
Links, NEC
0
0
8
Quality assurance
0
0
8.1
Does the site describe any quality management or QA/QI process?
0
0
8.1.1
Does QA/QI include accessibility?
0
0
8.1.2
Relevance?
0
0
8.1.3
Content selection, validity, and/or interchange?
0
0
8.1.4
Transparency/credibility?
2
9
8.1.5
Links?
0
0
8.1.6
Safeguards?
0
0
8.2
If so, are QA/QI processes adequate to their purpose?
0
0
8.3
Does the site permit easy feedback from consumers?
7
32
8.9
QA/QI, NEC
0
0
9
Safeguards
0
0
9.1
Does site display terms & conditions of use of the website?
2
9
9.2
Does site display its privacy or confidentiality policy?
8
36
9.2.1
Is it adequate to the task of informing consumers of what info is captured etc?
5
23
9.3
Disclaimers, privacy policy, sponsorship, advertising policy
10
46
9.3.1
Are they adequate to the task of informing consumers on limitations?
1
5
9.9
Safeguards, NEC
0
0
To return to introduction