The SIRC™ Methodology
SCORR: Systematic Calculation of Reliability and Relevance
Every SIRC™ score is grounded in a rigorous, transparent methodology based first and foremost on content analysis. This methodological approach has made Ad Fontes Media ratings the basis for dozens of academic research studies.
What Is SCORR?
SCORR is the scoring system underlying the SIRC™. It defines twelve measurable dimensions across two categories — reliability and relevance — and produces a quantitative score for each publication on both axes of the chart.
Scores are generated at the article level by trained analysts and then aggregated to the publication level. The use of multiple independent analysts per article reduces individual bias and improves consistency.
The methodology is designed to be auditable — stakeholders can examine the reasoning behind any score, trace it to specific article-level evidence, and engage with the methodology through a transparent public process.
Vertical Axis · Score 0–25
Reliability Measures
Seven dimensions assess how well a publication consistently vets the science it publishes. Each dimension is evaluated at the article level and contributes to the overall reliability score.
Submission to Acceptance
Does the record show a credible editorial timeline from submission through review to acceptance? Unusually rapid or opaque acceptance can signal that an article was not meaningfully vetted.
Financial Disclosure
Are funding sources and financial conflicts of interest fully and clearly disclosed? Readers need to know who paid for the research and who stands to benefit from its conclusions.
Ethics Disclosure
Does the article document the ethical oversight its research required — such as institutional review board approval, informed consent, and animal-welfare compliance? Missing or vague ethics statements reduce reliability.
Study Design
Does the study use a research design suited to the question being asked? Are the methods appropriate to produce the type of evidence claimed?
Study Quality
What kind of study was carried out? Was its design and execution sufficient to signal a reliable new finding, or was it preliminary or inadequate?
Claims
Does the article confine its claims to what the data actually supports? Overstated conclusions — a pervasive problem in science communication — score poorly on this dimension.
Clarity
Can a reader follow a logical path from the research question through to the conclusions? Gaps or leaps in reasoning reduce reliability, and overconfident language reduces credibility.
Horizontal Axis · Score −18 to +18
Relevance Measures
Five dimensions assess how effectively a publication helps readers understand the significance and limitations of what they are reading.
Author Expertise
Do the authors bring the subject-matter expertise needed to frame their findings for the field? Expertise helps readers trust that results are placed in an informed, meaningful perspective.
Peer-attenuated Claims
Do the article's claims appear aimed at scientific peers by being qualified, bounded, and reconciled with existing evidence?
Original Contribution
Does the research add new observations to the literature? Scientific communities benefit from new observations of natural phenomena.
Promotional Focus
Are the authors focused on communicating science to their community — or on promoting findings or products in a more general and less relevant manner?
Community Accountability
Is the article published in a way that makes it fully accountable to its community?
The Analyst Process
Ratings are produced by qualified professionals — not algorithms alone — using a structured process designed to minimize individual bias.
01
Expert Analysts
Analysts have professional backgrounds in evaluating or creating scientific literature — including editors, researchers, and science communicators.
02
Independent Scoring
Multiple analysts score each article independently across all twelve SCORR dimensions, using a detailed codebook and calibration training.
03
Aggregation and Review
Individual article scores are reviewed, reconciled, and aggregated to produce publication-level ratings on both the reliability and relevance axes.
The same content-analysis principles that have made Ad Fontes Media's news ratings the basis for dozens of peer-reviewed academic research studies are applied here to the scientific literature — adapted for the unique characteristics of scholarly publishing.
Questions About Our Methodology?
We're committed to transparency. Reach out to discuss SCORR in detail or explore how it applies to your use case.
Contact Us