A preregistered study of learning with AI · Fall 2026

Cognitive
Partnership.

What kind of AI co-working leaves students understanding more without AI?

Dinara Pisareva · Nazarbayev University · Principal Investigator
Denis de Crombrugghe · Narxoz Business School · Co-Investigator

02
Start with one student

The semester went well. The grades are good. Now close the laptop.

03
Why this is hard to see

Two things can be true at the same time

04
What research already knows

Handing work to a tool is usually smart — until it isn't

05
The key concept

Cognitive residue: what stays when the tool is gone

06
The idea we're testing

Cognitive partnership

Sustained intellectual work with AI as a genuine partner in a shared system of thinking.

07
What partnership is made of

Three dimensions, growing from one precondition

Teaching cannot act on the student–AI configuration itself, but it can develop what the student brings to it, so we measure the student-side orientation — three co-equal dimensions:

Purpose

Working with AI to think further, not to finish faster.

Engagement

Bringing curiosity and imagination — trying things you hadn't thought to try.

Iteration

Pushing back and building over many rounds, not taking the first answer.

Ontological openness — staying open about what AI is — encourages all three: taught and measured alongside them, but not a facet of the orientation.

08
Dimension one

Purpose: think further, not finish faster

"My goal with AI is to think further than I could alone."

09
Dimension two

Engagement: curiosity and imagination do the reaching

"I work with AI to come up with options I wouldn't have thought of alone."

10
Dimension three

Iteration: the partnership lives in the back-and-forth

"My best work with AI happens over several rounds, not one."

11
The precondition

Staying open about what AI is

"I treat what AI is as an open question."

12
The study

Three real courses, one semester, Fall 2026

A within-person pre/post design embedded in three authentic courses at Nazarbayev University, all taught with the same partnership pedagogy:

CourseWhoAI work students do
Research Methods (PLS210)UndergraduatesWeekly AI conversations; research designs co-built with AI; creative presentation of research projects on GitHub.
AI & Social Science (PLS419/519)Upper-level + MAA semester-long public project built with AI and presented on GitHub, plus two op-eds about AI.
Qualitative Methods (PLS514)Graduate studentsAnalytical portfolios: grounded theory, RTA, and process tracing applied to AI-generated case studies, first without and then with AI, plus a comprehensive comparison of the two passes — differences, commonalities, implications for data interpretation.
13
How we measure

Week 1 and Week 14: the same measures, twice

All measures run in Weeks 1 and 14; every model adjusts for the student's own baseline.

The survey — online, take-home

Twelve self-developed CP items (three per dimension plus the antecedent block), the AIDep-22 Cognitive Dependence subscale (Wu et al., 2026), and an adapted 25-item AI-literacy scale (Lee & Park, 2024).

The quiz — in class, on paper, no AI

Sixteen course-specific items per wave (12 multiple-choice, 4 open-ended) targeting understanding and application; half repeat across the two waves, half are wave-specific.

The quiz is the study's objective outcome — the residue measure.

14
The heart of the design

The no-AI test: knowledge you can't google mid-answer

15
Hypotheses

Three confirmatory hypotheses, preregistered on OSF

The predictor is the partnership composite — the mean of purpose, engagement, and iteration; the three tests are Holm-corrected. H1 carries the evidential weight — its outcome is objective; H2 and H3 are self-report and triangulate.

H1 Cognitive residue

Controlling for Week-1 levels, the partnership composite positively predicts no-AI knowledge-test scores at Week 14.

H2 Over-reliance

Controlling for Week-1 levels, the partnership composite negatively predicts cognitive dependence on AI at Week 14.

H3 AI literacy

Controlling for Week-1 levels, the partnership composite positively predicts total AI-literacy scores at Week 14.

Powered at .80 for medium effects (r ≈ .33; .38 at the strictest Holm bar); smaller effects arrive as wide intervals, reported as such. Per-dimension effects and the antecedent→composite link are exploratory.

16
Measurements · the predictor

Measuring the orientation: twelve items, three per block

17
Measurements · the outcomes

Measuring the outcomes: residue, dependence, literacy

H1 No-AI knowledge test

Sixteen course-specific items per wave (6 + 2 repeated across waves): 12 multiple-choice (0/1) + 4 open-ended scored 0–2 against a rubric by two independent raters; total 0–20, z-scored within course.

H2 Cognitive dependence

The Cognitive Dependence subscale of the AIDep-22 (Wu et al., 2026), five items administered intact.

H3 AI literacy

An adapted 25-item AI-literacy scale (Lee & Park, 2024): the total score is confirmatory; the five subscales are an exploratory breakdown.

Analysis: regression-adjusted change (ANCOVA) with course fixed effects and prior AI use as covariate, robust standard errors; estimation-led reporting with 95% CIs.

18
Doing it honestly

The limitations

The design must answer its own strongest objection: the researcher built the framework, teaches it, and measures it. The answer is architectural.

Preregistered

Hypotheses, instruments, and the full analysis plan are locked on OSF before the first class meets.

Gatekeeping

A co-investigator holds all survey responses and consent forms during the semester; the PI does not know who consented into the study until final grades and appeals close.

Double-scored

Two raters score independently against rubrics written before any data; agreement statistics and an instructor-only sensitivity analysis are reported.

Participation is voluntary and pseudonymous; consent decisions are invisible to the instructor and cannot touch grades. Consent self-selection likely tilts the sample toward engaged students — range restriction on the predictor, which makes the tests conservative.

19
Why it matters

The question isn't whether students will work with AI