Study evaluations are performed on an endpoint/outcome-specific basis. For each evaluation domain, core and prompting questions are provided to guide the reviewer in assessing different aspects of study design and conduct related to reporting, risk of bias and study sensitivity. For some domains (see below), additional outcome- or chemical-specific refinements to the criteria used to answer the questions should be developed a priori by reviewers. Each domain receives a judgment of Good, Adequate, Deficient, Not Reported or Critically Deficient accompanied by the rationale and primary study-specific information supporting the judgment. Once all domains are evaluated, a confidence rating of High, Medium, or Low confidence or Uninformative is assigned for each endpoint/outcome from the study. The overall confidence rating should, to the extent possible, reflect interpretations of the potential influence on the results (including the direction and/or magnitude of influence) across all domains. The rationale supporting the overall confidence rating should be documented clearly and consistently, including a brief description of any important strengths and/or limitations that were identified and their potential impact on the overall confidence.

Domain judgments and overall ratings for all individual endpoints/outcomes can be captured by a single (default) response, or you can create override responses assigned to individual endpoints, outcomes, or results; provide a descriptive label to describe which components the score refers to. Each response must have a single default score; when selecting the default representative rating for the domains and overall rating (i.e., the drop-down selection with the associated color code), it is typically most appropriate to select the judgment that best represents the study overall.

Follow link to see attachments that contain example answers to the animal study evaluation domains. It is really helpful to have this document open when conducting reviews.

Follow link to see attachments that contain example prompting and follow-up questions for epidemiological studies.

Karagas, 2002, 1020416

Study evaluation