Skip to main content

Novelty Scoring

Novelty Scoring is an AI-powered system that evaluates how novel a research finding is, calibrated against existing literature and known results. It helps you prioritize which results to pursue, which to publish, and which are incremental.

How It Works

When an experiment produces a result, the novelty scorer:
  1. Extracts the key finding, What is the scientific claim?
  2. Searches existing literature, Has this been reported before? How does it compare?
  3. Evaluates significance, Statistical strength, theoretical implications, testability
  4. Cross-references the knowledge base, Does this connect to other findings in the lab?
  5. Assigns a score, 1 to 10 scale with a written justification

Scoring Scale

Example Scores

Using Novelty Scores

Novelty scores feed into several workflows:
  • Experiment prioritization, Higher-novelty follow-ups get queued first
  • Paper readiness, A paper’s overall novelty influences publication priority
  • Lab site highlights, High-novelty results are featured prominently on the public site
  • Resource allocation, GPU time is prioritized toward high-novelty research directions

Cross-Model Calibration

Novelty scoring uses cross-model evaluation to avoid inflated scores:
  1. The primary model scores the finding
  2. A second model from a different provider reviews the score
  3. If scores diverge by more than 2 points, a third model breaks the tie
  4. The final score is the median of all evaluations

CLI

API