@professorcasey: Replying to @Jack Experimental evidence that generative AI (without guardrails) can harm learning. I think this is interesting wrt the Brown AI cheating scandal in part because of the finding that you might not even know that you haven’t learned anything when AI gives you the answers… #aiineducation
Sadly, the issue is that without completely revamping our grading system, the incentives will always be too high to stop students from doing their work like this
2026-07-15 00:43:48
45
Professor Casey Fiesler :
BTW sorry about the lack of captions, I don’t know what happened to them, they were there while editing… 😭
2026-07-15 14:44:23
3
baxtyr ␄␛ :
I gotta say it feels a lot like the early Wikipedia days all over again. students who used Wikipedia instead of reading all of the source material did not do as well on tests, but cognitive offloading is arguably more important than wrote memorization in many cases. plenty of programmers will tell you they've had to quickly learn a language just for a small use case and then they forget it moments later but that's because they don't have enough cognitive space to be holding on to every syntax at once. It lets them get more done with less memorization, if the final product functions cleanly, the amount of memorized data that you applied in order to create it isn't really relevant.
2026-07-15 04:49:55
2
lidachuu :
If the group with guardrail did the same as the group without ai, to me that seems like an argument against using AI. We know there are risks to using AI, and since there doesn’t seem to be any upside, wouldn’t it follow that we shouldn’t use it at all for studying? I feel like it gets pushed so much on kids when there’s no evidence that its benefits them and some evidence that it might be harming them…
2026-09-09 23:46:04
1
A :
I am kinda surprised an IRB approved this study.
2026-07-15 02:09:02
7
Rick :
Did they disclose the tutoring prompts?
2026-08-13 03:01:08
0
chewyTBG :
By statistically identical do you mean they did not find evidence of a difference?
2026-08-10 04:37:14
0
Ruud_XIV :
Guardrails will likely not hold up after daily use. An experiment cannot establish this, but this is very likely to happen (see suicide prevention guiderails) and it immediately removes the external validity of this study.
2026-08-09 09:58:51
0
GLOT :
All educators need to unlearn the AI propaganda of the past 4 years
2026-08-20 12:34:11
0
Grace :
This secondary finding blows my mind. I mean, I guess it makes sense, but it also just feels really wild to me that their self perception was so far off
2026-07-15 00:59:41
6
Hekatonicosachoron :
Had the thought "why would brown skinned students in particular be worried?"
2026-07-28 15:13:28
0
FRobert :
Seems like Darwin at work. Why care? People who do things that manifest success will succeed. Those that do things that cause failure will fail
2026-07-15 00:45:50
0
Mr.K_All_Day :
None of these talk about what experience they had, teaching strategies, etc. we can’t see results as accurate until we change measures for AI use. That’s completely different than any human metric we use. And why is this surprising?
2026-07-16 19:53:09
0
Boundary Strategist :
Does it sound reasonable to think that this could be happening on the job market? The perception of “getting left behind” feeds a sensation to use it, but using it could set candidates back
2026-08-02 19:24:12
0
Kimberley_veronica :
Using it as a dialogic partner really helps learning but students need key skills like critical thinking to use it that way
2026-07-21 08:16:24
0
Rootie :
Yes! Research connected to education video!
2026-07-15 02:43:28
0
Kelly Webb-Davies :
The training I’ve developed for students basically teaches them to make decisions based on why they are doing a certain task, why they should be using their own brain to do it, how cognitively engaged they are in that task, how they can level that up if they need to, and enough about AI so that if they still want to use it they are using it productively. It’s all about them being able to make better learning decisions.
2026-07-15 06:35:17
1
Leticia's#2acct :
that last bit surprised me
2026-07-15 11:37:13
0
Nicolas Ian Coffman, PhD :
Would this potentially be different in project-based work? It's not surprising to me that retrieval suffers when AI supplants that work but different forms of assessment might engage students in different purposes of AI use. I certainly am doing different kinds of work now enabled by AI than I felt capable of beforehand.
2026-07-15 01:42:58
0
iiofybmoat00 :
I have a question - I have returned to school in my late 30s and I am using AI for a highly technical class (math, coding, biostats, etc). However, I have given it hard rules that it can only ask me Socratic questions that I made it put in its memory. I have it my lecture slides (it’s like 100 slides per lecture) and tell it to refer me to a slide if I need help - but it’s so much easier if it tells me go to slide 35 rather than me sifting through slide decks for hours. I also do ask it like “wait why does this concept work like this.” I feel strongly about intellectual honesty and I’d feel guilty turning in work that I didn’t do. Is this OK? I just never had to deal with this in school before and I do want to learn!!
2026-07-15 04:37:21
0
MaxDWolf :
Have there been similar AI experiments? I've run across many on the internet in the pre AI age that expressed that same confidence in their knowledge that they gained from YouTube. and TikTok videos. Not just misinformation. Complete misunderstanding.
2026-07-16 07:16:29
0
EverymanJackalope :
I’m seeing AI being used for lit review and statistical design by my coworkers, scientists. As if part of our process isn’t learning, as if we’re somehow immune to this list of skill. And while I think we might weather it better than an undergrad, we still need to _learn_ to do our jobs, and learn well to do our jobs well.
2026-07-16 01:51:34
0
Lee V. Gaines :
The findings align with my own conversations with students and teachers. I’ve spoken with teachers who use platforms like Magic School that they say won’t give students answers and instead act as a supplemental tutor or teachers assistant. Students say this version of AI can be helpful for them when they’re struggling to get started or need extra assistance understanding a topic. But I’ve also heard from teachers who have seen many students simply copy/paste an assignment prompt into ChatGPT and turn in what it spits out. Students have also told me they’ve resorted to using ChatGPT to complete assignments for them when they feel like the clock is ticking and they’re on deadline to turn something in.
2026-07-15 04:12:56
0
CreativeJason :
I find that if I want to learn something, I can ask very specific and detailed questions and get great answers... not perfect, but very good.
2026-07-15 05:01:54
2
To see more videos from user @professorcasey, please go to the Tikwm
homepage.