AI Literacy Assessment
AI literacy assessment for EU AI Act compliance
Article 4 of the EU AI Act requires that your staff have sufficient AI literacy. AISA measures it — through conversation, not a checkbox quiz. Every score is backed by evidence. Every report is documentation a regulator can read.
Curious about your AI Fluency?
AISA helps you measure, prove and improve your AI skills — free report in a 20-minute chat.
What the EU AI Act requires — and what most organisations miss
Article 4 of the EU AI Act mandates that providers and deployers of AI systems ensure their staff have “a sufficient level of AI literacy.” Enforcement began August 2025. The penalty for non-compliance: fines up to 1% of annual global turnover.
What counts as “sufficient” is not precisely defined — which is the problem. Most organisations respond with a generic awareness training module and a completion certificate. That proves attendance, not literacy.
An AI literacy assessment that measures demonstrated understanding — what someone can actually explain and apply, not just what they sat through — provides the documented evidence that closes the compliance gap.
100% coverage of the U.S. DOL AI literacy framework
The U.S. Department of Labor published its AI Literacy Framework defining 25 sub-competencies across 5 capability areas. AISA's assessment covers 100% of those sub-competencies — and goes further, measuring the proficiency depth that the DOL framework defines but doesn't measure.
AISA's rubric is also cross-referenced against Anthropic's AI Fluency Index (93% criteria overlap) — the largest empirical study of AI fluency ever published.
Prompting & Communication
Can they structure instructions effectively and iterate on AI output?
Critical Thinking
Do they evaluate AI output or accept it at face value?
Technical Understanding
Do they understand enough about how AI works to make good decisions?
Workflow & Application
Is AI integrated into how they work, or still experimental?
Safety & Responsibility
Do they understand data boundaries, risk, and downstream impact?
How the AI literacy assessment works
A 20-minute conversation
Each person talks to AISA — an AI facilitator that adapts to their role and skill level. No multiple choice. No forms. A natural conversation about how they use AI, what they understand about it, and how they handle its limitations.
Evidence-based scoring
A separate AI evaluator scores the conversation against a published rubric — 11 criteria across 5 dimensions. Every score is tied to a specific quote from the conversation. This is the documented evidence a regulator can read.
Calibrated by a senior model
A final calibration pass reviews the full transcript holistically. The result: a scored profile, a persona classification, and specific growth recommendations — per person, per dimension.
What 1,800 assessments reveal about AI literacy
The AISA AI Fluency Index benchmarks AI literacy across 1,800+ assessed professionals. The findings are directly relevant to compliance planning:
Safety & Responsibility averages 42 out of 100 — meaning most professionals have not internalised responsible AI use to the level Article 4 implies. They use AI, sometimes daily, but have not thought systematically about data boundaries or when AI should not be trusted.
Professionals overestimate their AI skills by 18.5 points on average. A self-reported survey will tell you 80% of your workforce is confident with AI. The assessment data tells a different story. This is why measurement matters for compliance — confidence is not competence.
Why an AI literacy quiz isn't enough for compliance
A multiple-choice quiz can verify that employees know the term “hallucination” — it cannot verify that they check for hallucinations in practice. The EU AI Act requires sufficient AI literacy, not awareness of AI vocabulary.
AISA's conversational assessment observes how people behave with AI — how they structure inputs, whether they verify outputs, how they handle ambiguity. Each score is backed by a direct quote from the conversation. That evidence is the compliance documentation a regulator needs.
For organisations already running AI literacy training, AISA provides the measurement layer: assess before training to set baselines, assess after training to prove impact, and maintain ongoing documentation of workforce AI literacy levels.
What you get for compliance documentation
Per-person scored profiles
Composite score, 5 dimension scores, AI persona classification. Each score backed by an evidence quote — not a checkbox.
Team-level analytics
Aggregate scores by role, department, or seniority. See exactly where the literacy gaps are and which dimensions need training investment.
Pre/post training measurement
Same rubric, same scoring. Run assessments before and after training for an apples-to-apples comparison that proves whether it worked.
Population benchmarks
Compare your workforce against 1,800+ assessed professionals via the AISA AI Fluency Index. Know whether your team is above or below the curve — dimension by dimension.
DOL framework alignment
100% coverage of the U.S. Department of Labor AI Literacy Framework — all 25 sub-competencies measured. The strongest compliance evidence available.
Ongoing documentation
AI capabilities evolve. A training programme run once in 2025 does not constitute ongoing compliance in 2027. Periodic reassessment maintains your documentation.
AI literacy assessment FAQ
What does the EU AI Act require for AI literacy?
Article 4 of the EU AI Act requires that providers and deployers of AI systems ensure their staff have a sufficient level of AI literacy. Enforcement began in August 2025. Organisations need documented evidence that employees interacting with AI systems understand their capabilities, limitations, and risks.
How does AISA measure AI literacy?
AISA measures AI literacy through a 20-minute conversational assessment that scores 11 specific skills across 5 dimensions. The assessment covers 100% of the U.S. Department of Labor AI Literacy Framework — all 25 sub-competencies. Each score is backed by evidence from the conversation, providing the documented proof regulators require.
Is an AI literacy quiz enough for EU AI Act compliance?
A multiple-choice quiz can screen for factual knowledge but cannot demonstrate that employees can apply AI safely in practice. The EU AI Act requires sufficient AI literacy — not just awareness. A conversational assessment that scores demonstrated behaviour provides stronger compliance documentation than a pass/fail quiz.
The Science Behind AISA
In 2026, Anthropic published the AI Fluency Index — the largest empirical study of AI fluency to date, analysing nearly 10,000 conversations. AISA covers 93% of the behaviours Anthropic identified as markers of AI fluency and goes even deeper with 4 additional dimensions. The U.S. Department of Labor's AI Literacy Framework (TEN 07-25) defines what every worker needs to know about AI — AISA covers 100% of its 25 sub-competencies.Read our analysis: Anthropic's AI Fluency Study & AISA · DOL AI Literacy Framework & AISA
AISA's framework is developed by a team with deep roots in tech, behavioural science, and AI product leadership — the rubric is informed by backgrounds spanning the Metropolitan Police, Harvard, Crowdbotics (Silicon Valley), and the European School of Economics.
Official Member Of
