AI Literacy Assessment

AI literacy assessment for EU AI Act compliance

Article 4 of the EU AI Act requires that your staff have sufficient AI literacy. AISA measures it — through conversation, not a checkbox quiz. Every score is backed by evidence. Every report is documentation a regulator can read.

What the EU AI Act requires — and what most organisations miss

Article 4 of the EU AI Act mandates that providers and deployers of AI systems ensure their staff have “a sufficient level of AI literacy.” Enforcement began August 2025. The penalty for non-compliance: fines up to 1% of annual global turnover.

What counts as “sufficient” is not precisely defined — which is the problem. Most organisations respond with a generic awareness training module and a completion certificate. That proves attendance, not literacy.

An AI literacy assessment that measures demonstrated understanding — what someone can actually explain and apply, not just what they sat through — provides the documented evidence that closes the compliance gap.

100% coverage of the U.S. DOL AI literacy framework

The U.S. Department of Labor published its AI Literacy Framework defining 25 sub-competencies across 5 capability areas. AISA's assessment covers 100% of those sub-competencies — and goes further, measuring the proficiency depth that the DOL framework defines but doesn't measure.

AISA's rubric is also validated against Anthropic's AI Fluency Index (93% criteria overlap) — the largest empirical study of AI fluency ever published.

Prompting & Communication

Can they structure instructions effectively and iterate on AI output?

Literacy: Writes basic prompts
Beyond: Designs context architectures, iterates strategically

Critical Thinking

Do they evaluate AI output or accept it at face value?

Literacy: Knows AI can be wrong
Beyond: Has a verification methodology, adjusts scrutiny by stakes

Technical Understanding

Do they understand enough about how AI works to make good decisions?

Literacy: Knows key terms
Beyond: Chooses models and tools based on technical trade-offs

Workflow & Application

Is AI integrated into how they work, or still experimental?

Literacy: Uses AI occasionally
Beyond: AI is load-bearing in the workflow

Safety & Responsibility

Do they understand data boundaries, risk, and downstream impact?

Literacy: Follows basic rules
Beyond: Adjusts approach based on stakes, thinks about team norms

Why an AI literacy quiz isn't enough for compliance

A multiple-choice quiz can verify that employees know the term “hallucination” — it cannot verify that they check for hallucinations in practice. The EU AI Act requires sufficient AI literacy, not awareness of AI vocabulary.

AISA's conversational assessment observes how people behave with AI — how they structure inputs, whether they verify outputs, how they handle ambiguity. Each score is backed by a direct quote from the conversation. That evidence is the compliance documentation a regulator needs.

For organisations already running AI literacy training, AISA provides the measurement layer: assess before training to set baselines, assess after training to prove impact, and maintain ongoing documentation of workforce AI literacy levels.

Start measuring AI literacy today

Free individual assessment. Team pricing from $10 per assessment.

AI literacy assessment FAQ

What does the EU AI Act require for AI literacy?

Article 4 of the EU AI Act requires that providers and deployers of AI systems ensure their staff have a sufficient level of AI literacy. Enforcement began in August 2025. Organisations need documented evidence that employees interacting with AI systems understand their capabilities, limitations, and risks.

How does AISA measure AI literacy?

AISA measures AI literacy through a 20-minute conversational assessment that scores 11 specific skills across 5 dimensions. The assessment covers 100% of the U.S. Department of Labor AI Literacy Framework — all 25 sub-competencies. Each score is backed by evidence from the conversation, providing the documented proof regulators require.

Is an AI literacy quiz enough for EU AI Act compliance?

A multiple-choice quiz can screen for factual knowledge but cannot demonstrate that employees can apply AI safely in practice. The EU AI Act requires sufficient AI literacy — not just awareness. A conversational assessment that scores demonstrated behaviour provides stronger compliance documentation than a pass/fail quiz.

The Science Behind AISA

In 2026, Anthropic published the AI Fluency Index — the largest empirical study of AI fluency to date, analysing nearly 10,000 conversations. AISA covers 93% of the behaviours Anthropic identified as markers of AI fluency and goes even deeper with 4 additional dimensions. The U.S. Department of Labor's AI Literacy Framework (TEN 07-25) defines what every worker needs to know about AI — AISA covers 100% of its 25 sub-competencies.Read our analysis: Anthropic's AI Fluency Study & AISA · DOL AI Literacy Framework & AISA