> For the complete documentation index, see [llms.txt](https://docs.nested-knowledge.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.nested-knowledge.com/review-workflow/screening/exclusion-based-screening/robot-screener.md).

# Robot Screener

Learn how to use Robot Screener to fill one reviewer seat in Dual Screening.

**Robot Screener** fills one reviewer seat in Dual Screening. It learns from your team’s adjudicated Exclusion-Based Screening decisions.

Unlike **Smart Screener**, it doesn’t answer defined eligibility questions. It learns patterns from your team’s Advance and Exclude decisions. It then assigns an inclusion probability to each new record.

Use it when an automated reviewer can fill one seat. In Dual Two Pass Screening, it works only during Abstract Screening. Full Text Screening remains human. In Single Screening, use the [Screening Model](/review-workflow/screening/exclusion-based-screening/screening-model.md) to prioritize your queue without an automated reviewer.

### Set Up Robot Screener

{% hint style="info" %}
Confirm your nest uses **Exclusion-Based Screening**. **Robot Screener** does not work with **Criteria-Based Screening**.
{% endhint %}

**Robot Screener** needs 50 adjudicated screening decisions, including 10 advancements or inclusions. After you turn it on, it trains on further adjudicated decisions.

{% stepper %}
{% step %}

#### Confirm Dual Screening

On **Nest Settings**, confirm your nest uses Dual Screening. Robot Screener isn't available in Single Screening.
{% endstep %}

{% step %}

#### Meet The Threshold

Two human reviewers must screen and a third human reviewer must adjudicate 50 decisions. At least 10 records must be advanced or included. You can’t turn on Robot Screener before meeting this threshold.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2FfOo8T7OujubKMEiWrgD6%2Ftoggle%20on%20robot%20screener.png?alt=media&amp;token=4da47fc1-7bec-4ff0-867e-259a9982190f" alt="Robot Screener setting unavailable before the screening threshold is met."><figcaption><p><strong>Robot Screener</strong> remains unavailable until your nest meets the screening threshold.</p></figcaption></figure>

On **Nest Settings**, select **Robot Screener** to view your progress toward the threshold.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2F2sBPPeRPqsNSa11eAgmY%2FScreenshot%202026-08-13%20at%2022.32.16.png?alt=media&amp;token=8631dbea-ad1d-4395-8a2a-2576e8655aa2" alt="Robot Screener threshold progress in Nest Settings."><figcaption><p><strong>Nest Settings</strong> shows progress toward the <strong>Robot Screener</strong> threshold.</p></figcaption></figure>

See [**Screen Records**](/review-workflow/screening/screen-records.md) for manual screening guidance.
{% endstep %}

{% step %}

#### Turn On Robot Screener

On **Nest Settings**, turn on **Robot Screener**. When the threshold is met, select **Enable Robot Screener**.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2Fojqvbqxd9xMGZWBE6gc3%2Frobot%20screener%20enabled.png?alt=media&amp;token=3de4b142-0230-4409-9647-d3dfb2abee91" alt="Enable Robot Screener confirmation dialog."><figcaption><p>Confirm that you want to enable <strong>Robot Screener</strong>.</p></figcaption></figure>

Robot Screener begins processing records in the background.
{% endstep %}

{% step %}

#### Continue Screening

One human reviewer continues screening. Robot Screener provides the second decision. Each record moves to adjudication after both decisions are available.

Human adjudicators can view disagreements between the reviewer and Robot Screener.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2FURLvzxXTg5q6sibwX0dV%2Fadjudicate%20robot%20screener.png?alt=media&amp;token=b33f933d-3d81-403c-871d-f43c1c9b7030" alt="Human and Robot Screener decisions shown for adjudication."><figcaption><p>An adjudicator can compare human and <strong>Robot Screener</strong> decisions.</p></figcaption></figure>
{% endstep %}

{% step %}

#### Filter And Download Robot Screener Decisions

To filter Robot Screener decisions, open **Study Inspector**. Select **Add Filter**, then select **Reviewer Screening (Standard)** or **Reviewer AB Screening (Two Pass)**. Select a status, then select **Robot Screener** as the user.

To scan decisions, add the **Reviewer Screened By** column. It lists every reviewer and their screening decision.

To view a decision, select a study, then turn on **Screen** or **AB**, and **Adjudicate**.

Select **Download** to export the filtered studies.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2FzlvRsND5XoAY2cC5rnc3%2Fdownload%20robot%20screener%20in%20inspector.png?alt=media&amp;token=a300bb07-23ae-43f1-96b6-a5cd2ebc8495" alt="Robot Screener decisions filtered in Study Inspector."><figcaption><p><strong>Study Inspector</strong> filters records by <strong>Robot Screener</strong> decisions.</p></figcaption></figure>
{% endstep %}
{% endstepper %}

### How Decisions Appear

Robot Screener doesn’t assign exclusion reasons. Its decisions display as **Advance**, **Include**, or **Robot Excluded**.

It never finalizes a record on its own. A human reviewer provides the second decision. A human adjudicator resolves any disagreement.

Reviewers can’t view Robot Screener decisions during screening. Human adjudicators can view them during adjudication.

### Implications For Your Workflow

Turning on Robot Screener changes more than who screens. Consider these workflow changes before you rely on it. After it’s active, you need one human reviewer. Robot Screener fills the second reviewer seat.

Robot Screener doesn’t assign a reason. Records it excludes show as **Robot Excluded**, not a specific exclusion reason. Account for this when reporting a PRISMA-style tally by reason. See [**Exclusion-Based Screening**](/review-workflow/screening/exclusion-based-screening.md).

A human reviewer provides every record’s second decision. A human adjudicator resolves disagreements. Robot Screener never finalizes a record alone. See [**Adjudicate Records**](/review-workflow/screening/adjudicate-records.md).

Because Robot Screener trains on each adjudicated decision, early inconsistencies can affect later decisions. Consistent screening matters most when the model has limited training data.

In Dual Two Pass Screening, **Robot Screener** replaces a reviewer only during Abstract Screening. Full Text Screening remains human.

### Review Robot Screener Performance

Review predictions and cross-validation metrics each time the model trains. On **Nest Settings**, select **Screening → View Screening Model**.

<figure><img src="https://305208404-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fxb7uNGATUgwQAjDVQRXG%2Fuploads%2Fi7yrYyNowFgsQIGMAEiq%2Frobot%20screener%20screening%20model.png?alt=media&amp;token=e246b875-2407-4865-b155-0b14c5d0d068" alt="Screening Model predictions and cross-validation metrics for Robot Screener."><figcaption><p>The <strong>Screening Model</strong> shows predictions and cross-validation metrics for <strong>Robot Screener</strong>.</p></figcaption></figure>

<details>

<summary>Predictions</summary>

The **Predictions** tab charts Included or Advanced, Excluded, and Unscreened records.

The x-axis shows inclusion or advancement probability from 0 to 1. Performance varies by nest because the model trains on your team’s decisions.

The optimal threshold is the probability at or below which the model recommends exclusion.

</details>

<details>

<summary>Cross Validations</summary>

The **Cross Validation** tab shows evaluation metrics, including recall and accuracy. Use these metrics with your protocol and human review process when deciding whether to use **Robot Screener**.

</details>

<details>

<summary>Understand Model Limits</summary>

The model learns from your team’s adjudicated decisions. Limited include or advance examples, incomplete metadata, or information available only in full text can reduce its reliability.

Use **Robot Screener** to fill one reviewer seat, not to make a final decision. A human reviewer and a human adjudicator remain part of every workflow.

Model performance varies by nest. Review your model’s metrics before relying on its decisions. See the [Screening Model model card](/ai-transparency/model-cards/screening.md) for evaluation details, input data, and limitations.

</details>

### FAQs

<details>

<summary>What happens before the 50-decision threshold is met?</summary>

**Dual Screening** uses two human reviewers and a human adjudicator until you turn on **Robot Screener**. It can’t fill a reviewer seat before the threshold is met.

</details>

<details>

<summary>How do I improve Robot Screener performance?</summary>

Adjudicate consistently and review model metrics after training. More adjudicated decisions provide more review-specific data. They don’t guarantee a particular performance outcome.

</details>

<details>

<summary>Can Robot Screener be turned off after it's turned on?</summary>

Yes. Turn it off any time on **Nest Settings**. When you turn it back on, it trains a new model from current screening decisions.

</details>

<details>

<summary>Can I use Robot Screener with Criteria-Based Screening?</summary>

No. It’s available only with **Exclusion Reasons**. **Criteria-Based Screening** uses **Smart Screener** instead.

</details>

### Next Steps

<table data-card-size="large" data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><i class="fa-clipboard-check">:clipboard-check:</i><br><strong>Screen Records</strong></td><td>Screen alongside Robot Screener in Dual Screening.</td><td><a href="/review-workflow/screening/screen-records.md">Screen Records</a></td></tr><tr><td><i class="fa-scale-balanced">:scale-balanced:</i><br><strong>Adjudicate Records</strong></td><td>Resolve disagreements with a human adjudicator.</td><td><a href="/review-workflow/screening/adjudicate-records.md">Adjudicate Records</a></td></tr></tbody></table>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://docs.nested-knowledge.com/review-workflow/screening/exclusion-based-screening/robot-screener.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
