Skip to content(if available)orjump to list(if available)

What Happened When I Tried to Replace Myself with ChatGPT in My English Class

Aurornis

> There are valid reasons why college students in particular might prefer that AI do their writing for them: most students are overcommitted;

Tangentially: I've helped out some college students with mentoring and advice from time to time. One common theme I've noticed is that their class load virtually doesn't matter. They find ways to run out of time no matter how much free time they start with.

We all like to imagine the poor, overburdened college student working 2 jobs and attending classes to make ends meet when reading statements like that. But to be completely honest, the students like that usually have their time management on point. The hardest ones to coach were the students who had no real responsibilities outside of classes, yet who found their free time slipping through their fingers no matter what they did.

Among all of the other problems with easy AI cheating, I wonder how much the availability of these tools will encourage even more procrastination. Feeling like you always have the fallback option of having ChatGPT write the homework for you leaves the door open to procrastinating even longer

> I asked my students to complete a baseline survey registering their agreement with several statements, including “It is unethical to use a calculator in a math class”

Unless there was more to this survey, this wording seems misleading. In a college-level math class, using a calculator is a common expectation depending on the type of class and the problem. The students would probably think of their TI-89, not a magical AI calculator that could solve every freeform problem for them.

Den_VR

Different tools in different years as expectations have changed. The TI-89 is incredibly powerful, but has to give way to MATLAB and Wolfram Alpha. It used to be productive to “google” your problems. Going further, there’s now LLMs writing python code to do calculations. Hard to say what’s next, but I’m sure what is considered ethically questionable today will be acceptable and the new thing will be the new questionable tool.

gizmo686

To be clear; there are plenty of contexts where having a TI-89 is 100% unambiguously cheating. There are even more places where MATLAB and Wolfram Alpha are cheating.

altairprime

Being one of those students and with a career under my belt of process analysis and coaching, I have an interesting observation: I harness free time as an explicit part of my writing process, rather than something that interferes with it.

I write at about 1200 words per day and I considered each fo the major multi-week assignments in my entry-level English courses to be worth no more than one day of my time apiece. For the finals, I gave them two days apiece, because I wanted an extra day to define the scaffolding for my argument.

My mother indicates that this is how she went through college too; very occasionally, a serious paper would require more effort than this, but for the most part it was “load assignment into brain, study assignment mentally until T-2d, write assignment, submit”. If several essays are due, then they have to be staged at various days numbered T-2d through T-5d for example — and it’s really important to not depend on T-1d existing at all due to courseware/internet/power outages.

I could technically write a worse essay the day it was assigned, but ultimately, I’m turning in A-tier work by this method. The hardest lesson was that I have to try not to wait until T-1d, because there’s a lot of risk encoded in that and it outweighs the value derived from having an extra day to think about it while I do other things.

But it wasn’t about “free time slipping away” — it’s just that I’m writing crap throwaway work that doesn’t matter after it’s done, and so I can barely motivate to care relative to literally anything else in my life that matters. Thus the T-2d compromise: I’m not about to give them precedence over literally anything, but I will concede that I do need to do so one day early, however boring it feels, because I’d rather have a crap day at T-2d than the same crap day at T-1d with the unproductive anxiety of risking a class-retake if my internet drops out.

Notably, when I actually genuinely care about what I’m writing, I’ll spend weeks researching sources and studying arguments and selecting quotes and then assembling it all over a couple days into a work of art — but assembly day is still always as late as possible in the time window assigned, because by then I’m most able to think and write about it efficiently and with a minimum of frustration. Not a zero of frustration, that is — I am a grouchy writer — but I’m healthy-grouchy on T-2d and bitter-grouchy on T-1d, so I do make the effort to put in my writing that day early now.

So: for your coaching efforts, try working with students to construct a working calendar that has non-writing activities in the leadup and then writing activities at the end. ie assuming a 7-day window,

T-7d: Assignment given: Read the assignment. (Seems obvious; is not obvious!)

T-6d: Think about your argument during your free time, while playing games or out at coffee or whatever.

T-5d: Try to construct a very halfass outline on a piece of paper. One sentence per argument you’d like to make, draw arrows to rearrange them. Not complete sentences, not punctuated, doesn’t have any structure at all. Point is that trying will help brain coalesce.

T-4d: Research references for fun. End up with far too many. Start highlighting quotes to yourself using highlighter or digital tools. If you’re going to experiment with a new tool, get it working and productive in 2 hours or discard it and do something shittier.

T-3d: Bind quotes to your argument phrases from that halfass outline. This may force reorg of outline; cool. Compile Works Cited from whatever you end up using so that you don’t have to fuck around with it tomorrow.

T-2d: Write paper, referring to outline / phrases handwritten note. Do one paragraph at a time. Plan to spend your entire day on this with 1 hour away from desk handling bio/sanity needs for every 2 hours at desk. Enforce that upon yourself.

T-1d: Finish whatever writing you didn’t feel like you were prepared to write on T-2d. Ideally try to do this earlier in the day than later, since that every hour you let this slip towards midnight l measurably increases your chances of a life outage causing you to fail the class.

The point of this schedule is to bake in the daydreaming / slow cooker aspect of the creative process but to keep it on the rails. I play video games extensively when I’m thinking about a paper because I can feed my literary brain the assignment to simmer and then go occupy my reflex brain with the game. I usually end up having to use some T-1d time but I’m getting better at managing my life’s dependencies ie. Food and Water and Sleep so that I’m more reliably at T-2d completion :)

swader999

I believe you.

brudgers

Altman’s analogy didn’t hold up. Calculators were uncontroversial

Calculators are uncontroversial now. But when they first became cheap and widely available, they were not allowed in math classes. Then only four function calculators, then graphing calculators. But still today, programmable calculators are prohibited in many academic contexts.

treyd

The point that you're (and everyone is) glossing over here is relative positions on the skill gradient.

A first grader probably would be prohibited from using any kind of calculator on arithmetic tests, 4-fn or not. But 8th graders are usually permitted scientific (non-programmable) calculators.

As you go up in grade level, you "get access to" calculators capable of functionality at the level below you. Because the point is that when we're educating students we want them to actually learn the subject matter, but once we've deemed them to have understood it and we have them move onto the next goal, we give them the tools to make that prior goal easier. We lessen the burden of the little mechanical concepts they already know so that they have an easier time becoming familiar with the next more advanced concepts.

AI systems are so much more advanced than what's capable on a TI programmable calculator. It's hard to draw clean boundaries around the tiers and enforce them by telling the model "help the user with tasks of tier 1-4 but not 5+". That's the issue, that it's really infeasible to strictly use them strictly as learning tools. You can almost do it with a lot of self-discipline and self-reflection to analyze your own workflow, but it's not generalizable across domains.

brudgers

I mentioned the continued ban on programmable calculators in many academic contexts. Those contexts still include some portions of undergraduate education. This is fifty years after the introduction of programmable calculators.

Realistically, the answers the students gave the teacher were probably motivated by the practical benefits that come with giving teachers the answers they want to hear…bullshit questions are likely to produce bullshit answers. It’s not like first year college students haven’t had twelve years of academic standards moralizing talked at them.

pishpash

Why can't they be restricted to produce only the concepts of a grade below you? It sounds doable and is actually a great idea.

tomsmeding

How are you going to ensure that it is impossible for the student to work around whatever measures you take?

analog31

>>> imagine how radically math class must have changed when calculators became widely affordable

It didn't.

I was in math class when calculators were introduced. At least for high school level and beyond, the curricula were designed to make problems solvable without calculators, and they weren't of much use. This was still the case when I taught an undergrad college math class in 1997. Graphing calculators were allowed, and the kids who tried to use them just screwed themselves up.

I would have gladly changed the curriculum to use calculators and computers from the very beginning. As tools, and not just to administer the same old exercises and quizzes. Give them Jupyter Notebook. Math education has never been a success story.

Education faces a dilemma, which is that it has always used heuristics to guide study and assess performance. Exercises such as the "three paragraph essay" had no use in the real world, even long before AI could generate them on demand. When one of those heuristics is broken, another one has to be found. Even word processing forced teachers to grade papers on content, rather than mechanics.

grimnebulin

As a teen in the late 80's I had an HP calculator that I programmed to compute molecular weights given an input string like "H2SO4". It felt like having a secret superpower, especially when I participated in competitive exams. I was a very straightlaced kid and would not have used the program if it such things were explicitly forbidden, but as far as I could tell, they never were.

viraptor

Reminds me of when I write a j2me app for matrix diagonalization because we could use the old feature phones as calculators. Nobody thought we'd be mad enough to use those to cheat...

QuantumNomad_

Do you still have the source code for the j2me app?

I hadn’t yet learned to program back when I was still using a feature phone, but I have a lot of fond memories of J2ME applications that I installed on my phones. Mostly games, of course.

I encourage anyone that wrote J2ME games and utilities, no matter how small or big, to upload the source to GitHub :)

mrbungie

Did you tell your teachers about your superpower?

But normally it depends on the subject and if the automation/machine solves the primary skill being teached or if its just a "secondary/tertiary" skill. Are you in a Calculus 101 class? Calculators like TI-89 are likely to be prohibited when examining for deriving analytical solutions for derivatives and integrals.

Statistics, Physics or any other subjects that needs applied maths? Such a calculator is probably a minimum requirement to take the course.

tonyarkles

My HP-49g+ was definitely load-bearing going through EE. I was never much good at memorizing big sheets of formulas but I was pretty good at memorizing a couple of simple differential equations (e.g. I(t) = C dv(t)/dt was easy, v(t) = v_s * e^(-t/RC) wouldn't stick). So I'd just... derive all of the "special case" formulas from scratch during the exam. Usually they were simple enough that I could just get them into the right form but I'd lean on my calculator doing the symbolic integration for me when they weren't.

The other thing it was awesome for was solving systems of linear equations. I could do the nodal or loop analysis just fine, I'd write down the matrix that represented the system of equations and then just punch that matrix in and invert it.

grimnebulin

I was on pretty good terms with my chemistry teacher, so...maybe? It's been a while, but I don't remember either showing it off or taking pains to keep it secret. To adults, that is; my nerdy friends and I delighted in showing off the cool stuff we did with our calculators.

I vaguely remember thinking that one likely reason shortcuts like mine were not prohibited was because no one in charge suspected that such things were even possible with current technology, or if they were, that a child would be able to exploit it. But as long as I kept to the letter of the rules, I considered myself ethically in the clear.

jmholla

A related personal story: During my statistics course in high school, we discovered that the TI-89 had some statistical functions that the TI-83 didn't have. So, the rule was that if we wanted to use the TI-89 ones, you had to write an application for the TI-83 one. It was a great way to really learn the algorithms.

kjkjadksj

Stuff like that seems harder to do than learning the damn thing correctly

grimnebulin

I could do it correctly from the get-go. The program just saved me from drudgery many times over. Probably enough times to recoup my time investment to create the program, but in any case I enjoyed coding for its own sake.

pinkmuffinere

I you like Chemistry, then yes. If you like programming but dislike chemistry, then no.

taneq

I always felt (and my maths teachers agreed) that if I understood something sufficiently to automate it, I’d proved my point and didn’t need to do the rest of the exercises.

Edit: Automate in the sense of coding it myself, not in the sense of downloading some software.

Spivak

The calculator tricked them into studying. Same trick as the "one note card, front back" but in this case accidental.

ortusdux

The concepts of adding machines and calculators were also slowly phased in over the span of a century. The first commercially successfully adding machines hit the market in the 1890's, and pocket calculators took off in the 1980's. AI went from theory to answering hand written math homework questions from a photograph in a few years.

ghaff

I only had a calculator (at a technical university) starting in the mid-1970s. Prices were dropping like a stone in about that period. In high school it was pretty much slide rules.

verelo

Totally correct. In the 90's as a kid in school using a calculator was highly debated amongst teachers and the ability to bring one out on your desk depended on the teacher.

In grade 2 i had a teacher who would say "I don't believe in erasers", you know, the things that "undo" pencil. As a ~6 yr old i actually didn't understand this phrase: "Well I have one, they're real!"

voxl

No middle schooler is using a graphing calculator on their algebra exam

atleastoptimal

I literally used a graphing calculator on my algebra exams in middle school.

voxl

Yeah I don't believe you, especially because you have an axe to grind about AI singularity bullshit. No one in their right mind should allow a graphing calculator to be used on an algebra exam, might as well let them bring a laptop and open Wolfram alpha.

Barrin92

It's also an extremely misleading comparison. Basic calculator functions do not in the slightest replace anything taught in a maths class. Using ChatGPT not just to write entire paragraphs (replacing composition), or even providing the writer with ideas (replacing the creative aspects of writing) isn't comparable to adding two large numbers together.

The equivalent in maths would be if you handed students a theorem prover or have Wolfram Alpha give you step-by-step solutions and obviously nobody to this day allows this, because like ChatGPT for writing it'd defeat the point, that students think.

When I was in uni we were allowed basic but not programmable calculators during exams and a lot of CS classes even were pen&paper, if the prof was a bit hardcore

the_af

>> Altman’s analogy didn’t hold up. Calculators were uncontroversial

> Calculators are uncontroversial now. But when they first became cheap and widely available, they were not allowed in math classes.

The author of TFA means specifically for his cohort of students, not in general. He polled his students, and the result was that they thought calculators weren't seen as unethical but they were more skeptical/uncertain about AI. By his current students, now, not in general.

brudgers

LLM’s have been widely available for approximately five years.

Five years into the availability of a calculator with an arbitrary advanced feature, it was controversial in academic contexts. Some of the author’s students could be grand-children of students from the early days of consumer calculators.

The author is comparing a new technology with an old one. And ignoring programable calculators which are still sometimes banned after fifty years…and many of the author’s students probably have used LLM’s for homework despite their statements that please the author.

patrakov

This essay resonated with me because it highlighted the similarity between AI-written texts, describing the result as a word salad. And this also reminded me about some words from my teacher of Russian Literature: that the "bright future" themed novels of the pre-WW2 Soviet writers — works produced under strict political control — read like one big novel without a beginning and an end, and not as separate works.

And this grayness and sameness is what happens when people are forced to "think" as a chorus, either by the authorities or their censorship, or voluntarily by using the same AI's help.

prisenco

Or by market consolidation, as we're experiencing now.

tkgally

Interesting report.

I understand why much of the discussion about AI and university education has focused on first-year writing classes in the U.S. Some of my own first experiments with ChatGPT in December 2022 were having it write school-like essays [1].

Over the past few months, I cotaught a university class in which we also had first-year students use and reflect on their use of AI in their classwork. But the context was different: the class was a seminar on science communication (how to make science engaging to children and the general public), and most of the time was spent with the students doing group projects. Also, the class was at a university in Tokyo, and we taught it in Japanese.

We have just started analyzing the feedback from the students, but my impression is that they were less conflicted about the use of AI for their group work than they might have been if they had been doing their projects as individuals.

Meanwhile, as the semester progressed, agentic frameworks started to mature. I spent a lot of time on my own experimenting with Claude Code and Gemini CLI. While none of the students in that class seemed to use them, it became clear to me that such higher-level cognitive tools will pose an even greater challenge to higher education than essay-writing chatbots do now.

[1] https://www.gally.net/temp/202212chatgpt/defaultessay.html

aydyn

> most students are overcommitted; college is expensive, so they need good grades for a good return on their investment; and AI is everywhere, including the post-college workforce.

Yeah. Overcommitted to partying and skipping class.

Has this author ever been to an average American university?

bluefirebrand

Overcommitted in this context probably means "has a schedule that is packed too full"

Between work and school and other responsibilities they have no time to decompress so they burn out

yoz-y

The only time I’ve had as much free time as in university was in my first job.

airstrike

Since you said "in university" I assume that wasn't in the U.S.

hansvm

Let's rephrase it to "most of even the best students" then.

I went to about the cheapest US school that had a decent math program. It costs $17,500/yr between tuition, rent, books, and rice and beans.

That's a lot of money. It's over $10/hr in pre-tax income, even if you work full-time all year, which isn't an easy bar to clear in the sort of towns with cheaper universities. Wages don't scale well enough with more expensive tuition for there to be substantially better options.

Classes are another 22+ hours each week (you could complete school in 3-4 yrs instead, but that makes it even harder to afford and doesn't really reduce the workload enough to make a difference, however I'll also factor in a 15-hour workload later).

The rule of thumb is that you should study 3 hours for every hour of class. I found that approximately correct. Some classes took a lot less. Some took a little more. Combined with the self study you need in adjacent topics, 3hrs is a fair bit low.

During the school year then, you have something that looks like a 128hr/week schedule, or 100hr if you're finishing in 4yrs, and still 60hr/week even if you're finishing in 4yrs and racking up $70k in debt.

Don't get me wrong; I had free time (I worked more during the summer, less during the school year, allowing loans to cover the slack, which bought extra time here and there), but it wasn't exactly a party either. When I skipped class it was because I had to work, had to study for some other more pressing class, or found it more efficient to study the book than to try to understand that particular lecturer.

lynndotpy

What people are telling you in the comments is that your perspective is not universal. I've personally only ever skipped one class in my time in undergrad (as an American at an American university), and not for a party. I'm not a special case or anything, those classes are very expensive!

hollandheese

You are much closer to a special case than you think. Average attendance in my and my colleagues Math 101 classes is around 30% by mid semester.

DeepYogurt

Speak for yourself maybe

aydyn

Speaking for myself, has the author ever been to an average American university?

warmedcookie

Heh, especially the non-major freshman classes. A few weeks in and half the seats are empty compared to the first day of class.

DaSHacka

I have, I'd recommended speaking for yourself

lapcat

It me.

But I read an article recently about the death of partying in the USA: https://news.ycombinator.com/item?id=44514550

astrobe_

AIs grading AI-generated essays looks like a recipe for model collapse. That's why we certainly need people who go after the "diminishing returns" of improving their writing skills beyond the "good enough" that AI delivers.

Should education systems aim for that for all of their students? Certainly, because AI alone is not sufficient to raise the bar. As impressive an AI is when it seems to invent a new molecule, it is still only possible because of the original works of many people.

null

[deleted]

LeftHandPath

What a lovely essay. Reminds me of the way I loved the liberal arts growing up. I missed having classes like that in college (AP'd and ACT'd my way out of most requirements).

English teachers seem especially prone to that friendly and sporting demeanor the author has. Professors from the engineering schools are far more prescriptive, probably due to the nature of the material.

resource_waste

>English teachers

Since discovering Analytical Philosophy, I think it is irresponsible to combine Nonfiction and fiction under the term 'English'.

As an engineer, I write emails, they need to be clear, factual, etc... This is in huge contrast with fiction, where writers get merit for being intentionally ambiguous with things like metaphors and symbolism.

What an incredible disservice to students and society to consider English(nonfiction) an 'art'. It should be treated like math and science.

I had to become a middle aged adult and learn this for myself.

ElevenLathe

All the best writers that I know in the sense that you mean (communicating information precisely), including non-native speakers, are also avid fiction readers. Many also write fiction or prose for fun. Familiarity and fluency with the details of usage and vocabulary are what let one employ these things precisely for whatever purpose, fictional or not.

aquariusDue

I agree that it's a good distinction to make. Personally I haven't thought about it till I read On Writing Well by William Zinsser. In the book he specifically teaches writing nonfiction and even shares an anecdote where he was a guest on a radio show promoting a writing conference and was annoyed with the host because he conflated writing with literary works.

So yeah, I recommend the book to people interested in writing.

thisoneisreal

To back up your point, I kind of hated English class until my senior year of high school when I took AP English Language (nonfiction), after which I started drinking books from a firehose.

DiscourseFan

> I had to become a middle aged adult and learn this for myself.

This is a cliche.

You can’t write precisely without an understanding of how language becomes imprecise, of its fundamental instability. Precision and delicate use is an accident when it does happen, and its happening can never be proven. We must have faith in the accident.

thaumasiotes

More traditionally you'd study "rhetoric", the art of making your arguments appealing. It doesn't really matter whether the things you say are true or false.

Rhetoric is valuable in any writing endeavor; clarity is only valuable sometimes.

aquariusDue

For a funny take on the whole "rhetoric" is the use and abuse of logic some people might enjoy How to Win Every Argument by Madsen Pirie which also happens to be where I plucked the tagline regarding rhetoric from. It's a pretty easy book to go through in toilet break sized increments, the author goes through different fallacies and how they're employed one by one along with various rhetorical devices.

Though a few years ago when I searched for a book on rhetoric and making convincing arguments Office Of Assertion by Scott Crider also popped up, but it's aimed more at written rhetoric instead of what most people have in mind.

anigbrowl

Here are some of the essay topics I had them read aloud:

[...] I expected them to laugh, but they sat in silence. When they did finally speak, I am happy to say that it bothered them. They didn’t like hearing how their AI-generated submissions, in which they’d clearly felt some personal stake, amounted to a big bowl of bland, flavorless word salad.

But that's what it has been trained on - almost all academic writing is bland flavorless word salad, and this is extremely noticeable in title fads. I have a nearly decade-long game running with my friend where me make up absolutely bullshit concepts that could nevertheless be plausibly published in a journal, and the process has been going on long before that.

'Verbing the noun: towards a genericization theory of expressivity in high-entropy counter-heterogeneity' describes an ongoing problem in academic writing where novelty is deprioritized in favor of acceptability by an evermore tightly circumscribed set of peer professionals whose socioeconomic interests favor the establishment of intellectual stasis that maximally conserves positionality in a quais-Simmelian network space parameterized by income, tenure proximity, and citation count.

Or put more clearly, the more academics write to impress each other instead of to reach the public, the more generic their titles and language will be. Being able to parse and regurgitate wordy titles and abstracts constitutes table stakes in academia, so the incentives tilt toward burying the lede any original proposals as deeply as possible so as the minimize the career-damaging possibility of rejection on technical/syntactical grounds.