# What is AI resume screening, and what should it actually do?

> A plain explanation of AI resume screening software, what it is good at, where it fails, and the questions worth asking before you trust one with a batch of applicants.

Sara at SortTheStack, February 4, 2026. Original: https://sortthestack.com/blog/what-is-ai-resume-screening

Resume screening is the part of hiring nobody puts on a slide. A role gets
posted, applications arrive, and someone spends hours deciding which ones
deserve a closer look. AI resume screening software is meant to take that first
pass off a person's desk.

That is the whole promise. It is worth being precise about what it means.

## What screening software actually does

Automated resume screening takes a batch of applications and evaluates each one
against requirements you have written down for a specific role. It reports what
each candidate appears to meet, what evidence in the application supports it,
and what it could not find.

What comes back is a shortlist: a much smaller set of people, ordered by how
well the evidence lines up with what you asked for.

What does not come back is a hiring decision. A screening tool is answering
"who deserves human attention", not "who is the best person for this job". Those
are different questions and only one of them can be answered from a resume.

## Where keyword matching goes wrong

Most first-generation screening worked on keywords. If the resume contained the
phrase, the candidate passed. If it did not, they did not.

This fails in both directions. It rewards applicants who stuff the right words
into a document, and it discards people who did the work but described it
differently. Anyone who has hired for a technical role knows the version of this
where a strong candidate gets filtered out because they wrote the tool name and
not the category name.

Screening is more useful when it evaluates whether the evidence supports a
requirement, rather than whether a string appeared.

## The failure that matters

There are two ways screening can be wrong. It can surface someone who turns out
to be a poor fit, which costs you fifteen minutes. Or it can quietly remove
someone you would have hired, which costs you the hire and you never find out it
happened.

The second one is the reason to be careful. A tool that reports a confident
result on an ambiguous application is not being helpful. It is hiding the part
you needed to see.

The useful behaviour is three outcomes rather than two: clearly missing a stated
requirement, likely relevant, and genuinely uncertain. That third bucket is
where a human should be looking.

## Questions worth asking

Before trusting any screening tool with a batch:

- Can you see why a candidate surfaced, in specifics, not as a percentage?
- Does it tell you what it could not find, or only what it found?
- What happens to applications it is unsure about?
- Can anyone be rejected automatically? If so, by whose rule, and can you
  override it?
- Does the tool email candidates without you, and what exactly does it send?
- Are the criteria yours, for this role, or a general quality model?

If the answers are vague, you are being sold a black box. Recruiters have
enough of those. For the documented risks, and a test you can run on any tool
before trusting it, see
[can AI help you identify the best applicants?](https://sortthestack.com/blog/can-ai-identify-the-best-applicants)

## Screening is not an ATS

One more distinction, because the categories get blurred in marketing.

An applicant tracking system manages your hiring process: postings, pipelines,
stages, communication, offers. Screening software decides who is worth reviewing
in the first place. Plenty of teams have the first and still do the second by
hand, which is why "we already have an ATS" and "we are drowning in
applications" are so often true at the same time.

You do not need to replace your hiring process to fix your reading problem.