Using an LLM to do schoolwork is like taking a forklift to the gym.
If all we were interested in was moving the weights around, you’d be right to use a tool to help you. But we’re doing this work for the effect it will have on you. The reason a teacher asks you a question is not because they don’t know the answer.
Compare: My piano teacher doesn't give diplomas because none of her students would care, her students actually want to learn. When my piano teacher cancels class, I am disappointed because I wanted to learn. My piano teacher doesn't need to threaten me with bad grades to get me to practice outside of class (analogous to homework), because I actually want to learn.
There are many college students for whom none of these tests would pass. They would not attend if there was no diploma, they're relieved when their professors cancel class, and they need to be bullied into studying outside of class.
What made us think these students were ever interested in learning in the first place? Instead, it seems more likely that they just want a degree because they believe that a degree will give them an advantage in the job market. Many people will never use the information that they supposedly learn in college, and they're aware of this when they enroll.
Personally, the fact that they can now get a degree with even less wasted effort than before doesn't bother me one bit. People who want to learn still have every opportunity to.
If students find a way to get a diploma without doing the work, it will soon be worth less than the paper on which it is printed.
If employers no longer look for the diploma-signal in an employee, what will be the reason an employer will hire an employee?
I think this story will become true, and society will radically shift into one where critical thinking skills will actually be the only skills employers look for in employees, since the grunt work can be automated.
What becomes the signal then? Will we shift back into apprenticeship based employment? How do potential laborers display their critical thinking skills apart from displaying them in person?
Amen.
I look forward to the era where we train professionals the old fashion way: apprenticeships. It sure worked for blacksmiths and artisans for hundreds of years.
I hire people now and where they went to school means little to me. The first priority is “can they do the work?” which is a niche programming. After that is established, I barely take note of school.
I don’t personally count a CS degree as an indication the person is a good programmer, or thinks logically, or has good work ethic.
No, it has value because it gatekeeps class mobility. Degrees haven't signified learning or problem solving longer than I've been alive. The attitude is that if you pay for an education, you're entitled to a degree. The education aspect is optional.
I think this is already the case.
No. It has value, because companies value it. It sets the starting point for your first salary and then for every salary negotiation moving forward.
As someone who did not go to university, but has the same knowledge self-taught I can tell you that this piece of paper would have opened so many doors and made life so much easier. It took me 15 years to get a salary, that people get with the piece of paper after graduating. And not because it took me 15 years to reach that level of knowledge. I had that by the time the other graduated.
I had a friend who always cheated in school, and now he works for a big car company and earned a fuck ton of money.
Life is unfair and companies only care about the paper your diploma is printed on. If students would ask me for advice, I would tell them to cheat whenever possible.
No. That's how it should be, but the reality looks different: it has value because it shows that someone spent 3+ years doing what they were told to do, enduring all the absurdities they were subjected to in the meantime. Whatever means they used to cheat don't matter, since they still worked on what someone told them to and produced results satisfying the expectations.
There are, perhaps, institutions where learning and problem-solving are seen as the most important while "following orders" and "staying in line" are deemphasized. For the students of all the others, putting up with an utterly absurd environment is often one of the biggest barriers to learning. Yet, it's a requirement without fulfilling which you can forget about graduating. Hence my conclusion: the diploma from most learning institutions certifies you as a good corporate drone - and that's enough of a signal in many situations, so why bother trying to fix it?
Some college students may be genuinely interested in one particular subject, but they're required to take a bunch of other courses, and consider those to just be hurdles.
I still think they're better off at least making an effort and trying to learn something, but I do think it's important to note that just because a student has no interest in one particular class, doesn't mean they have no interest in any class.
The course I'm interested in gets kinda hard, and my "just pull up an LLM" muscle is very, very strong, (and besides, I'm not used to struggling! and why should I get used to it in the classes i like?! I can't afford a C in my major!) so ... I use LLMs on my "I'm interested in it" class too and... we're back to the original argument.
I find a lot of these comments more disturbing than the concerns about AI.
They are in some countries, you get at the vocational programs or apprenticeships alongside the highschool, and in the end you might get the opportunity to apply to the university or just carry on with your job.
That is how I did mine in the 1990's Portuguese education system, and how I was already coding and understanding the big boys computer world at 16y.
For the exact reasons you state, pre-AI homework was often copied and then individuals just crammed for the tests.
AI is not the problem for these students, it's that many students are only in it for the diploma.
If it wasn't AI it would just be copying the assignment from a classmate or previous grad.
And I imagine the students who really want to learn are still learning because they didn't cheat then, and they aren't letting AI do the thinking for them now.
In some ways offering the diploma and all the requirements that go with that take the joy out of the learning for me.
1. Students given bad incentives to be thrown into a system with a completely different purpose than their main goal. Then those jobs turning face to suddenly say "schools teach you nothing" and even refuse to hire the newest generation.
2. Students in general not being stimulated by primary school and given direction and vision on what to do in life. Simply being pushed by parents to "be successful".
3. The crippling reality as of late that a job doesn't even guarantee keeling a roof over your head anymore. Leading to discouragement to even bother trying.
4. Connected to #2, the decline of various apprenticeships, internships (which are now a college recruiting pipeline), and other ways to invest in employees. Even if they complain about new grad output, they are still content outsourcing such training instead of investing in their employees for a career.
There's a lot of systems failing which can arguably cause an entire collapse in the country. Then no one will get an opportunity to properly learn.
You have this option with things like mits open courseware. Some colleges are OK with you just wanting to learn
Your piano teacher does not give a diploma because she is not offering a university education. If she worked with a few other experts and they designed a coordinated curriculum and shepherded students through it over the course of two to four years, and documented that process to the point where they could file with an accrediting agency, then she could issue a degree in piano.
> then she could issue a degree in piano.
This is much larger than a cultural problem with the students of today. They believe, rightfully and accurately, that the university degree is yet another part of the machine that they will become a cog in.
What should be alarming to everyone is that these students will graduate without having learned anything and then go into the workplace where they will continue to not use their atrophied critical thinking skills, to simply do yet more, as a cog in the machine.
* according to the UCLA CIRP freshman survey
These days you need a college degree just to afford a 1 bedroom apartment by the time you are 40.
Yeah, that's when the great "push for education" came, as well as neoliberalism which preached continuous hustling and individuality. And in the 90s, the ADA and other anti discrimination laws hit, and requiring a college degree was and still is a very useful pre-screening filter for HR to continue discrimination.
Me and most of my peers in college had the choice between two courses. Course A was interesting, yet vastly more challenging and therefore time consuming, with the additional downside of lower grade expectation. Course B was boring, a gentle breeze in comparison, yet with an almost guaranteed perfect grade.
Imagine which course most students choose?
Even if a student wants to take on the more interesting course, incentives matter, and the incentive is: better grades qualify for better compensated positions and prestigious degrees. Only students who didn't care about this or were confident enough in their ability did choose Course A. In the end, barely a handful of students out of hundreds went with A.
A decent amount of my professors don't know the answers because they bought the course, test questions, and lectures from Cengage. During exam review, they just regurgitate the answer justification that Cengage provided. During the lectures, they struggle to explain certain concepts since they didn't make the slides.
Professors automate themselves out of the teaching process and are upset when students automate themselves out of the learning process.
I can tell when the faculty views teaching as a checkbox that they officially have to devote 40% of their time to. I can tell when we are given busywork to waste our time instead of something challenging.
To use your analogy, I'm being told to move 1000 plush reproductions of barbells from Point A to B by hand because accreditation wants to see students "working out" and the school doesn't want high failure rates.
We are all pulling out the forklift. Some of us are happy because we don't have to work as hard. Others are using the forklift so we can get in a real workout at home, as school is not a good use of our time. Either way, none of us see value moving paperweights all day.
edit:
My favourite course during my Computer Engineering degree was Science Fiction because that professor graded us on substance instead of form. It was considered a hard class because one would get good marks on the essays by focusing on building substantive points instead of strict adherence to the form of a five-paragraph hamburger essay.
The call to action is to make courses harder and stop giving students plush barbells.
For example, University of Toronto Engineering Science (hardest program in Canada) gives first-year students a "vibe coding" lab in which students learn how to solve a problem that AI cannot.
https://www.cs.toronto.edu/~guerzhoy/vibecoding/vibecoding.h...
It is also hard to evaluate university teaching because there are no benchmarks for that (compared with high school, for example), and it is hard to judge if teaching is good from student feedback. You can only know if someone fucked up or did really well, which are outliers.
There are other issues as well. Professor IMO is a ridiculous job, you are supposed to be an expert in the field, be a researcher, be a manager, be a teacher, be a salesman, all at the same time. There are people who can excel in all these, but these are probably just outliers. It doesn't help when PhD training doesn't train you to be a proper manager and teacher. While there are some teaching training, I think we are not really held to a high enough standard. E.g. One can pass the teaching course if they just show up and spend some time, even though their teaching is horrible.
But sure, you're always going to find a few meh or bad professors. And they will stick out as much ad thr great professors
One analogy I use a lot: if I have a professor sitting next to me, what is the best way to learn a topic?
Struggle through it on my own and I won't be leveraging the professors knowledge.
Ask the professor to do everything for me and I won't be learning anything at all.
Now if the professor is an AI, the same trade-offs hold.
For example, I will back and forth conversations with AI to explain subjects to me. I ask questions, push back, ask for examples, and so on.
If I do ask the AI to answer something for me, I then ask it to break down the answer for me so I can make sure I understand it deeply.
And of course, none of this matters if I don't want to learn something :)
>And of course, none of this matters if I don't want to learn something :)
Society makes people do a lot of things they don't want. I wonder if we're going to hit a breaking point this generation.
Does the use of a quantifiable metric like a GPA not exacerbate this? In a world where people take a GPA seriously, you'd have to be irrational to not consider cheating a viable option.
You could say the same about credit score and dating apps. These institutions assist the most predatory and harm the most vulnerable.
The current and old school way is a proctored exam.
I remember illustrating a point to a class by posing a question and then calling on a student I figured wasn't smart enough to answer correctly so that everyone could see her make the mistake.
The ethics of that still bother me.
This has a negative feedback loop where universities have to lower standards to bring dumber and lazier students to compete with other diploma mills.
> like taking a forklift to the gym.
Second, girls dig forklift operators or so I was told.
But the gym isn't the best place to engage in forklift training. And you engage in forklift training at the gym, expect to learn how to use a forklift to lift gym weights. Don't expect to also get the benefits that the gym is designed to impart.
I related with that analogy too, infact that whole piece is worth reading. I can't seem to find it's link though!
Essentially, since they are a summary of "the" state of knowledge, the teacher should be able to ask them to put a number on how novel a piece of text is.
Once LLMs are able to evaluate, independently, the soundness of an argument... (Hopefully, this will be achieved AFTER $5 H100s reach the average consumer)
They are the wrong tool for pedagogy.
Look, we have no idea what the feedback is like that this grad student gives, what the class sizes are like, what the cadence is, what the grade percentages are, etc. All we know is that Clayton Ramsey is a grad student at Rice in the robotics department and that he wrote a hot take here.
For me, the most important thing is if this grader is bothering to really grade at all. I think we've all had a harried grad student just dash off a few red lines on the week one HW about a week before the final exam. That's not a 2 way street, and if the feedback isn't as in-depth as he wants the work to be, well, he shouldn't be surprised. He can't be expecting students to put in the time unilaterally. But, we don't know any of that really.
Personally, I think that before the decade is out, we're not going to be talking about this at all. Because the students will be adept enough at using the LLMs to make it look like their own writing anyways. This is a problem that experience will solve for them.
And also, I think that the days of the massive lectures and essays are pretty much cooked. That 'cheap' model of education can't survive this LLM revolution. We obviously have to change what the heck higher education is trying to do.
My take is that we're going to go to smaller class sizes like those at St. John's or Oxbridge. Under 10 people, you have to have done the reading or look like a fool, all with a PhD in the subject as a guide/teacher. Large classes weren't cutting it for decades (ask any Frat about their test banks), and now the veil is just ripped off.
I'm sure the time has come for college students to master using LLMs. It's just as important as grammar or basic math now. The software I build (and the entire tech industry) automates huge swaths of business processes with AI. Students need to be able to understand, work with, and manage swarms of AI agents doing work.
To stick to the analogy:
I need skilled forklift drivers, not big buff workers like I used to.
Someone with years of coding experience is going to be able to laser guide an AI agent to the answer/result than someone who has muddled their way through comp sci 101 using an AI chatbot.
This isn't even an opinion on LLMs, it's recruiting 101. You're free to convince the gym to train forklift drivers, but don't be surprised when you're laughed out the room.
Sure, you should lift them yourself too. But using an AI teaches you a shit-ton more about any field than your own tired brain was going to uncover. It's a very different but powerful educational experience.
If you never learn to research, sure. Otherwise, you should be worried about accuracy, up to date information, opinionated takes, and outright lies/misinformation. The tool you use doesn't change these factors.
Besides, those are incredibly short-term concerns. Recent models are a whole lot more trustworthy and can search for and cite sources accurately.