@professorcasey: Replying to @Jack Experimental evidence that generative AI (without guardrails) can harm learning. I think this is interesting wrt the Brown AI cheating scandal in part because of the finding that you might not even know that you haven’t learned anything when AI gives you the answers… #aiineducation

Professor Casey Fiesler
Professor Casey Fiesler
Open In TikTok:
Region: US
Wednesday 15 July 2026 00:13:24 GMT
10247
1181
57
53

Music

Download

Comments

churrundo
churrundo :
how did the ai with guardrails group do?
2026-07-16 15:15:15
0
pgiaco22
P Giaco :
Sadly, the issue is that without completely revamping our grading system, the incentives will always be too high to stop students from doing their work like this
2026-07-15 00:43:48
45
professorcasey
Professor Casey Fiesler :
BTW sorry about the lack of captions, I don’t know what happened to them, they were there while editing… 😭
2026-07-15 14:44:23
3
baxtyr_
baxtyr ␄␛ :
I gotta say it feels a lot like the early Wikipedia days all over again. students who used Wikipedia instead of reading all of the source material did not do as well on tests, but cognitive offloading is arguably more important than wrote memorization in many cases. plenty of programmers will tell you they've had to quickly learn a language just for a small use case and then they forget it moments later but that's because they don't have enough cognitive space to be holding on to every syntax at once. It lets them get more done with less memorization, if the final product functions cleanly, the amount of memorized data that you applied in order to create it isn't really relevant.
2026-07-15 04:49:55
2
lidachuu
lidachuu :
If the group with guardrail did the same as the group without ai, to me that seems like an argument against using AI. We know there are risks to using AI, and since there doesn’t seem to be any upside, wouldn’t it follow that we shouldn’t use it at all for studying? I feel like it gets pushed so much on kids when there’s no evidence that its benefits them and some evidence that it might be harming them…
2026-09-09 23:46:04
1
aknug2
A :
I am kinda surprised an IRB approved this study.
2026-07-15 02:09:02
7
jeezmrgarnett
Rick :
Did they disclose the tutoring prompts?
2026-08-13 03:01:08
0
chewytbg
chewyTBG :
By statistically identical do you mean they did not find evidence of a difference?
2026-08-10 04:37:14
0
ruud_xiv
Ruud_XIV :
Guardrails will likely not hold up after daily use. An experiment cannot establish this, but this is very likely to happen (see suicide prevention guiderails) and it immediately removes the external validity of this study.
2026-08-09 09:58:51
0
glot.friend
GLOT :
All educators need to unlearn the AI propaganda of the past 4 years
2026-08-20 12:34:11
0
_andgrace
Grace :
This secondary finding blows my mind. I mean, I guess it makes sense, but it also just feels really wild to me that their self perception was so far off
2026-07-15 00:59:41
6
zorku6
Hekatonicosachoron :
Had the thought "why would brown skinned students in particular be worried?"
2026-07-28 15:13:28
0
robertjf1
FRobert :
Seems like Darwin at work. Why care? People who do things that manifest success will succeed. Those that do things that cause failure will fail
2026-07-15 00:45:50
0
mr.k_all_day
Mr.K_All_Day :
None of these talk about what experience they had, teaching strategies, etc. we can’t see results as accurate until we change measures for AI use. That’s completely different than any human metric we use. And why is this surprising?
2026-07-16 19:53:09
0
toriataughtme
Boundary Strategist :
Does it sound reasonable to think that this could be happening on the job market? The perception of “getting left behind” feeds a sensation to use it, but using it could set candidates back
2026-08-02 19:24:12
0
kimberley_veronica
Kimberley_veronica :
Using it as a dialogic partner really helps learning but students need key skills like critical thinking to use it that way
2026-07-21 08:16:24
0
rootieroos
Rootie :
Yes! Research connected to education video!
2026-07-15 02:43:28
0
kelwebbdavies
Kelly Webb-Davies :
The training I’ve developed for students basically teaches them to make decisions based on why they are doing a certain task, why they should be using their own brain to do it, how cognitively engaged they are in that task, how they can level that up if they need to, and enough about AI so that if they still want to use it they are using it productively. It’s all about them being able to make better learning decisions.
2026-07-15 06:35:17
1
leticia2030
Leticia's#2acct :
that last bit surprised me
2026-07-15 11:37:13
0
nicolascoffman
Nicolas Ian Coffman, PhD :
Would this potentially be different in project-based work? It's not surprising to me that retrieval suffers when AI supplants that work but different forms of assessment might engage students in different purposes of AI use. I certainly am doing different kinds of work now enabled by AI than I felt capable of beforehand.
2026-07-15 01:42:58
0
iiofybmoat00
iiofybmoat00 :
I have a question - I have returned to school in my late 30s and I am using AI for a highly technical class (math, coding, biostats, etc). However, I have given it hard rules that it can only ask me Socratic questions that I made it put in its memory. I have it my lecture slides (it’s like 100 slides per lecture) and tell it to refer me to a slide if I need help - but it’s so much easier if it tells me go to slide 35 rather than me sifting through slide decks for hours. I also do ask it like “wait why does this concept work like this.” I feel strongly about intellectual honesty and I’d feel guilty turning in work that I didn’t do. Is this OK? I just never had to deal with this in school before and I do want to learn!!
2026-07-15 04:37:21
0
maxdwolf
MaxDWolf :
Have there been similar AI experiments? I've run across many on the internet in the pre AI age that expressed that same confidence in their knowledge that they gained from YouTube. and TikTok videos. Not just misinformation. Complete misunderstanding.
2026-07-16 07:16:29
0
everymanjackalope
EverymanJackalope :
I’m seeing AI being used for lit review and statistical design by my coworkers, scientists. As if part of our process isn’t learning, as if we’re somehow immune to this list of skill. And while I think we might weather it better than an undergrad, we still need to _learn_ to do our jobs, and learn well to do our jobs well.
2026-07-16 01:51:34
0
leeveeing
Lee V. Gaines :
The findings align with my own conversations with students and teachers. I’ve spoken with teachers who use platforms like Magic School that they say won’t give students answers and instead act as a supplemental tutor or teachers assistant. Students say this version of AI can be helpful for them when they’re struggling to get started or need extra assistance understanding a topic. But I’ve also heard from teachers who have seen many students simply copy/paste an assignment prompt into ChatGPT and turn in what it spits out. Students have also told me they’ve resorted to using ChatGPT to complete assignments for them when they feel like the clock is ticking and they’re on deadline to turn something in.
2026-07-15 04:12:56
0
creativejason
CreativeJason :
I find that if I want to learn something, I can ask very specific and detailed questions and get great answers... not perfect, but very good.
2026-07-15 05:01:54
2
To see more videos from user @professorcasey, please go to the Tikwm homepage.

Other Videos


About