Interviewing a software engineer who prepared with AI
730 comments
·April 4, 2025no-dr-onboard
jaredklewis
> - And yeah, you guys, it's time to buy a suit.
Others have already commented on this, but do you work in tech? IME getting interviewed by directors and even VPs in t-shirts is the norm. I’ve worn jeans to work my whole career. If anything, I think people in tech have a strong prejudice against people in suits (ie “obviously this person isn’t a real software engineer, they’re wearing a suit.”)
Anyway, probably not good career advice to wear a suit unless dress codes at tech companies are suddenly subject to drastic changes.
ChrisMarshallNY
I was once turned down by Microsoft (in the 1990s), because I wore a suit to the interview. They made a point of mentioning it.
mathgeek
Too real. I once got turned down by the Apple Store for a retail position because I wore a collared shirt to the interview (after being told in advance not to wear anything formal). Interviewer let me know I came off as too formally dressed to get their vibe. The discrimination/bias was real.
ar_lan
I didn't wear a suit, but in 2012 I wore slacks, tucked in collared shirt, and a tie, and got the same response from Microsoft. It was for an internship which is hilarious.
I interviewed elsewhere and one other time I wore an Oxford. I passed the university interview but the hiring manager told me for the on campus interview to not wear that again, or I'll stick out too much. I wore a plain T-shirt and have been happily employed for 10 years here :)
kklisura
[in NYC accent] What, you think you're better than us
zeroonetwothree
I was hired by MS wearing a suit in the 2000s
michaelt
So tech got rid of the suits, but kept the desire to judge people at interviews based on their clothes?
Great. Fantastic job everyone /S
phaedryx
I've made it a point to always ask beforehand: "what is the dress code expectation? I've seen everything from t-shirts to suits in the tech industry and I'd like show up dressed appropriately."
I always get a positive response.
barbs
I wore a suit to my very first tech interview on the advice of my well-meaning but ill-informed mother.
I got the job, but was then told "don't listen to your mother"!
cruffle_duffle
Very close story here as well. lol. “You can always underdress but never overdress!”
Thanks mom!
kevin_thibedeau
I was told by a recruiter to "suit up" for an engineering position 15 years ago. I was met by the VP of engineering wearing cutoff jeans. I never listen recruiter sartorial advice.
9rx
To be fair, "suit up" usually means to put on a uniform rather than to wear a suit. The phrase seems to have originated in sports. T-shirts and hoodies are the uniform of tech.
null
siva7
I wouldn't take that advice seriously. Suit in tech would be awkward (even for most mgmt roles). Tech pioneered the concept that you don't need a suit to get the pay of a suit. You can be yourself.
lo_zamoyski
"Be yourself"? What does that mean?
What if wearing a suit is "being myself"? You'll be penalized in tech for that.
Not everyone views the wearing of suits as some kind of punishment.
_blk
As I learned, you can also be yourself, never wear a suit on the job and still wear one for the interview. First impressions count. Once people know I can wear a suit they just don't seem to mind me in shorts anymore.. So I might have a social skill after all :D
graemep
It has spread to other industries and circumstances other than suits.
I now have no idea how I am supposed to dress for most things other than formal occasions like wedding, funerals, or formal dinners.
zelphirkalt
Seeing someone wearing a suit for a dev interview would make me think one of the following:
(1) This person really really needs the job. Probably is in a bad negotiation position, due to this urgent need.
(2) Are you here to impress people with looks, or with your skills?
(3) They take looks way more serious than they should, maybe not focussing enough on the technical side of things.
(4) Hopefully this is not an "EnTeRpRiSe software" developer, and if they are, hopefully they don't work on my team and if they are, hopefully my next up manager does not get blinded by fancy clothes, instead of technical reasoning.
That said, I would try to keep an open mind about the person, but they would be initially sorted into the category of managerial or close to management, rather than close to the other engineers, which is not a positive signal to send.
crabbone
The only programmers I've ever seen wearing a suit to work were the ones working in a bank. Not sure if that was a requirement or just a local tradition. Just saying that it happens, but seems very rare.
lores
It's not unusual in Europe - but then Europeans tend to dress smarter than Americans in general too.
drivingmenuts
The general rule seems to be if you’re not customer-facing, then no suit is needed. Just wear clean, neat clothes and that’s usually enough. If a suit or uniform is needed, that would be noted up front.
sethammons
The general rule is to dress one step up from those in the role. Everyone in hoodie and shorts? Wear pants. Everyone in collared polos? Go business casual with maybe a blazer. Showing up a level lower makes you look unprepared. Showing up some levels higher, like in a suit to a hoodie shop, shows lack of research and reading a room.
In start ups, I have seen candidates nearly rejected just on a suit alone. Def started them on the wrong foot impression wise.
baketnk
is it bad form to just like, ask your HR screener what the general dress code/vibe is like?
eikenberry
You are right about hiring not being that much different but your prognostications are way off IMO.
> - people are probably going to have to fly out for interviews, again.
Fly where? Many companies don't have offices anymore.
> - awkward and/or neurodivergent people are going to have to learn social skills again.
Ahh... the age old, "just do better" position for neurodivergent people. Classic bigotry.
> - And yeah, you guys, it's time to buy a suit.
Suits were out in tech 30 years ago when I first interviewed. They have only gone more out of style. Fashion doesn't work the way you think it works.
My guess is that we'll see more contract-to-hire positions and "talking through code" style interviews. Though I think we'll see lots of things tried which will be a general improvement over what much of the industry was doing before.
donnachangstein
> Classic bigotry.
Hiring is all about finding the best candidate. If you find you cannot function sitting in conference room with three other people for an hour, there is a 100% chance there is a better candidate suited for the role, even if his/her technical skills are less than yours.
Jobs have soft skill requirements, and there is nothing bigoted about that.
ellen364
I'm curious about this. When I've hired, I've always wondered how I can actually tell (a) what soft skills are required for the role and (b) whether a candidate has them.
People sometimes think that's a silly thing to ponder: it's obviously obvious! But at most places I've worked, we spend lots of time defining the technical skills required for a job and handwave the rest.
I guess people assume "they'll know it when they see it". But there's a lot of ambiguity. Parent comment suggests that being comfortable sitting in a conference room for an hour is an important part of their job. In some workplaces that would be an odd requirement. I've worked at places where the important thing was being able to go away and make progress on something for a few weeks.
I suspect there are people with autism reading these threads and feeling disheartened. It would be easy to leave with the impression that neurotypical people expect you to make all the effort and they won't try to meet you half way. Some workplaces are like that. But in all the talk about neurotypical vs neurodivergent, it's easy to forget that neurotypical people are a varied lot, just like neurodivergent people. Workplaces are a varied lot too.
DaSHacka
> Hiring is all about finding the best candidate. If you find you cannot function sitting in conference room with three other people for an hour, there is a 100% chance there is a better candidate suited for the role, even if his/her technical skills are less than yours.
> Jobs have soft skill requirements, and there is nothing bigoted about that.
Everything you just said also applies to someone who's deaf, blind, or physically impaired.
Apply that same logic to someone with one of those conditions, and enjoy losing the discrimination lawsuit.
lores
There is a big difference between being in a conference room for an interview where you are judged, and on a regular work day. There is for me, and I'm old and have done dozens and dozens of interviews, largely successfully. Don't summarily judge people, especially if they're not neurotypical, as often happens in software.
re-thc
> If you find you cannot function sitting in conference room with three other people for an hour, there is a 100% chance there is a better candidate suited for the role, even if his/her technical skills are less than yours.
This assumes that was the job? What if the job never talks or sits in a room with anyone?
> Hiring is all about finding the best candidate.
Then what is leet code about?
baketnk
there is a world of difference between interacting with three people you don't know for an hour for the explicit purpose of stress testing your experience and knowledge and interacting with three people that you talk to every day talking about a project that is well familiar to you.
jasonlotito
[flagged]
creato
Requiring people to be able to interact with other people is not "bigotry".
qkeast
I'm deaf and rely on real-time captions for calls. In an in-person interview scenario, I'm at a huge disadvantage and not able to perform at my best. In a video call, I'm on equal ground.
It's not as simple as "requiring people to be able to interact with other people."
eikenberry
No, but ignoring their disabilities and saying to just learn to do better is not good enough. It is no different from telling a deaf person to learn to hear with their other sense, it doesn't make sense as their disability is what prevents it. People do need to be able to interact with other people, it just doesn't work like it does with non-neurodivergent people. It takes an effort on both sides. Quit putting it all on the person who cannot do what you want. That is the bigotry.
motorest
> Ahh... the age old, "just do better" position for neurodivergent people. Classic bigotry.
I think you're too eager to throw personal attacks on those who raise valid points that are you feel are uncomfortable to address.
You should be aware that engineering is a social activity that requires hard skills. In any project that employs more than one person, you need to be able to interact with others. This means being able to effectively address and interact with others around you.
If you give anyone a choice, anyone at all, on who they work with, they will of course favor those who they are able to effectively interact with.
This is not bigotry, is it?
ang_cire
> they will of course favor those who they are able to effectively interact with. This is not bigotry, is it?
If "those who they are able to effectively interact with" ends up meaning only people who look, act, or believe like them, then yes it absolutely is.
_blk
If you have a really desirable job I wouldn't think twice about a few hours long drive/flight but eventually creativity wins the game for the hiring side. E.g. No offices, no problem: Either you recruit where you already have people or find trustees. I'd be happy to hold remote interview assist in the Colorado Springs (pot. Denver) area in my small 3ppl office if anyone from a remote-only corp doesn't have anyone on-site and wants to give it a shot...
tayo42
> Fly where? Many companies don't have offices anymore
While i dont agree with the idea we'll be flying anywhere for interviews, havent most companies gone back on remote work. "hybrid" is a benefit now and being in the office is the expectation.
PantaloonFlames
> Fly where? Many companies don't have offices anymore.
Presumably to meet the boss. And maybe the key people on the team.
eikenberry
So fly them to multiple destinations? I was hired 1 year ago and interviewed with ~14 people all living in different locations. That could be paired down, but it won't ever reach the single destination that the OP is referring to.
sjamaan
You can always rent a conference room for an hour or so somewhere in between.
pramsey
> Suits were out in tech 30 years ago when I first interviewed. They have only gone more out of style. Fashion doesn't work the way you think it works.
Or maybe it works exactly the way they think? Suits are so out, that wearing one is a strong signal of "different thinking" in a way that being casual once was. A colleague of mind would wear a three-piece on "casual Friday", and always showed up to the nines for interviews. Never harmed him, just reinforced his "think different" bona fides.
thruway516
You're merely reinforcing their point. Its so out of fashion it would be considered a bold or even edgy choice just as dressing casually once would.
Aurornis
> The thing is, none of these things really changed with AI
I agree that lying was possible before AI, but something about AI has emboldened a lot more people to try to lie.
Something about having the machine fabricate the lie for you seems to lessen the guilt of lying.
There's also a growing sentiment online that using AI to cheat/lie is "fair" because they think companies are using AI to screen candidates. It's not logically consistent, but it appeals to people who approach these problems as class warfare.
esafak
It definitely did change with AI. Imposters are becoming harder to detect, at a cost to the company.
xigency
With all the unemployed tech workers, would it just make sense to hire someone who knows their salt to do recruiting and interviews? Recruiters always seem to have a blast moving between random high-level companies and ghosting people over text, socials and the phone. If they lack both the social skills and the technical knowledge, I don't know what their value proposition is, but compared to chronic underemployment after actually learning Java, C, C++, they're clearly winning.
Arwill
Interviewing has also become harder too. You try to search the net during the interview, because you forgot the name of a thing, and the interviewer will assume you are running with an AI chat, and are cheating the interview.
Joeboy
I suspect the people saying nothing's changed are not people who've been conducting interviews recently.
roguecoder
I have seen wild things in the last year.
People taking minute-long pauses before answering questions. People confidently saying things that are factually incorrect and not being able to explain why they would say that. People submitting code they don't understand & getting mad when asked why they wrote something that way.
I get that candidates are desperate for jobs, because a bunch of tech companies have given up on building useful software and are betting their entire business on these spam bots instead, but these techniques _do not help_. They just make the interview a waste of time for the candidate and the interviewer alike.
9rx
I haven't seen the use of AI in interviewing (non-tech) yet, but something has definitely changed: People are now applying in droves.
NullPrefix
>There's also a growing sentiment online that using AI to cheat/lie is "fair" because they think companies are using AI to screen candidates. It's not logically consistent
How is it not logically consistent?
Aurornis
Because it's a nonsensical reduction and false equivalence.
It's like if you saw a headline that some grocery stores were price fixing, so you decide it's only fair if you steal from your local grocery store. One bad behavior does not justify another in a different context. Both are wrong. It's also nonsensical to try to punish your local grocery store for perceived wrongs of other grocery stores.
That's why it's such a ridiculous claim: Two wrongs don't make a right and you don't even know if the people you're interviewing with are the same as the people doing the thing you don't like.
cutemonster
Using AI to review and improve your CV would make sense, just as you can ask a person for help and review.
But not using it for creating lies and pretending you're skilled in areas where you're not.
Or would you say that if HR uses humans to screen CVs, you can cheat by using a friend's CV instead (using a human, like HR)
sidrag22
>How is it not logically consistent?
i used my words to speak to the candidate, so they think its fair game to use their words to lie.
screening using AI could be a totally legitimate usage of AI depending on how its done. cheating/lying has no chance of being legitimate. just like speaking can potentially be used to lie.
most people here arent straight up vilifying the use of AI, just certain uses of it.
aforwardslash
I've conducted interviews where the candidate asked if he could use google to try to get an answer. I often say "sure". If a guy can read an explanation out of context, understand it in a way he can explain it using his own words, and reason about corner cases in a couple of minutes, he's hired. The same goes with AI; canned responses work when you ask canned questions, not so much on open-ended ones.
Aurornis
That's missing the point. The goal is to have a level playing field for the interview.
If your interview format allows people to use outside help but only if they think to ask, that's hardly a level playing field. You're testing the candidate's willingness to ask. In most interview formats it would not be acceptable to Google the answer, so most people won't ask.
If you have an interview format that allows Googling, you should mention that at the start. Not leave it as a secret for people to discover.
kevinsync
My personal theory is less that it's reducing the guilt of lying if the machine fabricates it but rather more that the average person has historically been not so good at fabricating a fib (and they now have instant access to plausible-sounding lies)
microtherion
> And yeah, you guys, it's time to buy a suit.
At my previous employer, I had to convince several people in my team that wearing a suit was NOT a reason to reject a candidate out of hand. It's really difficult to gauge the expected dress code at a company beforehand, but it's not good advice to just blindly dress up.
yencabulator
Perhaps the suit wasn't the one level up that people are talking about? If you accidentally go 3 levels too formal, you've definitely ruined the initial impression.
Me personally, I like working at places where people can wear shorts and flip-flops. One level up is "pants and shoes, with socks", not even a collared shirt. Maybe a single-color new T-shirt, to be safe. A full suit would be an alarmingly bad read of the culture, and at that point we'd have made you come eat lunch at a burrito place to get a read on whether you're really a bad fit or just socially awkward.
The best thing I heard from an interviewee that was wearing a suit was that they interviewed elsewhere nearby that morning, and those people needed to be impressed with clothing.
Lutger
Did you ever work with developers? Maybe if you hire for consultants in some industries some of this is relevant (I doubt it), but with social skills + suit part alone will make sure you miss out on a significant pool of talent.
I could even go further and say that NOT hiring anyone who shows up in a suit will give you better results than the other way around. You filter out a lot of career guys who are really poor programmers and will try to end up as mediocre middle management that way.
Cthulhu_
I knew some colleagues who were alright as developers (maybe over-eager, e.g. building a microservices architecture by themselves when that didn't actually solve the real problems the company had) who had a suit phase for some reason.
throwaway2037
In most highly developed countries, there is a probation period for 90+ days for new hires. During this period, you can be fired for any reason. It is not an expensive as people think to fire someone who deceived your hiring process. However, institution inertia is real.
That said, I very much agree with your last paragraph. In the late 1990s and early 2000s, a lot of hiring was done this way in the US.
thaumasiotes
> In most highly developed countries, there is a probation period for 90+ days for new hires. During this period, you can be fired for any reason.
In an American context, this is generally true in 49 out of 50 states, except that the probation period covers the entire duration of your employment. The people who say firing is expensive are thinking about something else.
maxnevermind
Every big tech company in the US has their version of PIP, to protect them from potential law suits as I understand, that lead to a situation that low performers might occupy their positions for months and years.
yardie
Unfortunately, in very large organizations the onboarding process can take a while. It can be months before you have credentials to the repository. By then, full benefits will kick in, worker protections, etc.
And I’m a hiring manager. I’m trying to slot new hires with the training they will need and give them realistic tasks I know they can accomplish. And it’s not easy. I’m already 30 days in on a new hire that I’ve been able to peer with for 2 days. And I’m constantly apologizing for the lack of time.
__turbobrew__
If you make a bad hire you stop looking to fill that role, and then if you fire them 2-3 months later you are back at square zero.
tartoran
> - awkward and/or neurodivergent people are going to have to learn social skills again
It's not like these are skills that they haven't learned, these are things that they have a hard time with. Expecting them to be 'normal' is like asking a person of medium stature to be taller. They could mask them but ultimately it's not who they are and expecting everyone to be the same is a fools errand.
baq
It's not expectation of sameness, it's that they will be working with 'normal' people and need to meet some standard to not be a net negative for any team they're in.
tartoran
I think there's a tacit expectation to fit into a mold and that mold is heavily skewed towards extroverted neurotypical traits.
ghaff
And people may lean on their networks more (though they already do).
I do agree that there’s no reason face to face interviews shouldn’t be the norm again after an initial screen.
If some of those things don’t appeal to some candidates? <shrug> I don’t totally mean that. But some practices should be the default even if some candidates don’t really like them (and even if they’re less convenient or more costly for hiring managers.)
Not sure about the suit at a lot of tech companies but dressing neatly and even throwing on a sports jacket probably doesn’t hurt.
9rx
> But some practices should be the default even if some candidates don’t really like them
Employers didn't have a whole lot of choice in that matter for a long time. Candidates wouldn't show up if you tried to impose that upon them.
Granted, nowadays it does appear that the tide has turned back to employers getting to call the shots, especially for lower-level positions. It is less clear how desperate the top talent is.
ghaff
Seems pretty alien to my experience. A lot of senior talent was accustomed to traveling a lot anyway. I’ve certainly always interviewed in person and would probably turn down any company that didn’t offer as an option aside from COVID. But maybe there were a lot of companies that were willing to compromise on face to face so they could get any supposed talent to sign on the dotted line. Of course, they didn’t have much choice for a time even if they subsequently laid people off and/or largely froze hiring.
jamesgasek
"Preparing with AI" sounds like an issue here, and it's not. The issue is lying about your experiences, which people have done since the beginning of time. I "prepare with AI" by having it help give me hints when doing leetcode problems, which is very helpful. Interviewing is not a presentation, it's a conversation, and having a simulated other side can be helpful.
This shouldn't be surreal at all. A candidate just wasn't able to make up relevant experiences on the spot.
dennis_jeeves2
>The issue is lying about your experiences
Side note, as far as a job requirements goes the bigger issue is asking for impossibly diverse experience and asking for things that can be easily learnt. This promotes lying because the liars are the ones that are rewarded with an initial interview. I was talking to a fresh graduate with some volunteer experience who was having difficulty getting a job, and all I could hesitatingly recommenced was to tell him lie on his resume so that his resume could get past the screening.
_bin_
My compromise here is invisible words in the PDF. I pack it with every freaking keyword I can think of because I have absolutely no issues with lying to a robot and don't feel the need to a respect a hiring process where they can't be bothered to so much as read my resume. Funny enough I often get offers after that even when I don't have some specific technology.
That said, my personal ethics don't let me lie to an actual person.
polishdude20
Do OCR systems still detect invisible words? I would have thought by now they'd use pixel based image recognition.
hansvm
Interesting, that still works? I first heard about that a decade ago.
jajko
Nope, that's just rather bland justification of cheating. Not sure how US corporations work, but in Europe any big company would flag you internally so you won't be able to work there for a decade, and the mark still remains in their hiring system afterwards. Just a stupid thing to do, as lying always is.
This are not school exams, company wants to hire the best candidate. If all fail then best failing is still the best candidate, and this can be measured and/or perceived by skilled interviewers.
wqaatwt
> would flag you internally
And how would they figure that out if you lie by exaggerating your experience and skills and not outright making up entirely false stuff?
SR2Z
Even reneging on an offer in the US gets you blacklisted for like 5 years max. It's not personal, it's just business.
gspencley
> Side note, as far as a job requirements goes the bigger issue is asking for impossibly diverse experience and asking for things that can be easily learnt.
Really? That's the bigger issue?
Company wants to pay money to someone in exchange for services. They have unreasonable expectations. So that makes it OK for people to deceive them in order to have them believe that their unreasonable expectations have been met?
I don't think that unreasonable expectations should be rewarded. But an unreasonable expectation is just "being stupid and harming yourself."
Deceiving others in order to take their money under false pretences (which is fraud) is immoral and harms others.
The two are not remotely comparable.
> This promotes lying
No it doesn't. If someone feels "encouraged" to lie and defraud others because they want something from them (even if the "someone else" is objectively stupid), that is no one's fault but their own. And their wishes and desires are just as unreasonable as the company's. [The wish/desire on the part of the applicant is wishing that the company had reasonable expectations]
miki123211
The problem is that if everybody lies and you're the one not lying, you're worse off. In that scenario, the choice is between lying and being on even footing with everybody else, versus staying honest and getting an unfair disadvantage for it.
If enough participants lie, some of the honest participants get pushed out of the system, which makes lying more socially acceptable, which causes even more participants to lie... and so the feedback loop goes.
dennis_jeeves2
So what would be your advise to a fresh graduate (or even an experienced person) whose resume says experience in ".NET 3.0" where as the job posting says experience needed in ".NET 3.1" ? Remember it's HR or some automated system that does the screening.
wqaatwt
Well if the idea is that the lying (to a sane degree) is only necessary to pass the “filter” and that it has limited impact on the candidate’s ability to perform the actual work its not necessarily that straightforward.
mystified5016
I mean, we have companies out there posting "entry level" positions and demanding 10 years experience in a technology that's only existed for five.
All bets are off, man.
never_inline
In India I know people using AI to craft resumes with half-lies and full-lies. They say they "use AI to match the keywords in job description".
Indian SDE market is an extreme case of Goodheart's law, but that's a topic for another day!
FirmwareBurner
> They say they "use AI to match the keywords in job description".
If recruiters only pick up your resumes based on keyword matching themselves, what is one to do, if not adapt their resumes to said keywords so they can at least try to get to a human interview?
Not talking about India specifically, but in general. Hiring is broken, so everyone tries to fix it in their own ways to maximize their chances.
never_inline
AI will often casually lie / make up points which sound authentic.
rafaelmn
> what is one to do
Find roles where your skills match the required skills ?
WalterBright
Recruiters have gone beyond keyword matching, they're now using AI to judge the resume.
> Hiring is broken
How would you, as an employer, filter out the frauds?
zemo
> The issue is lying about your experiences
I think the point is that LLMs makes it easier and cheaper to produce a large volume of convincing lies. The candidate likely would not have been able to produce convincing-enough lies to get through the resume screen without LLMs.
mytailorisrich
That's true. On the other hand I have tried ChatGPT to review programming concepts or language features and I have found it very convenient and more useful than Googling.
For instance if you want to prepare for a C dev interview and would like to review what 'static' means and does (one of the super usual interview questions) you can just ask and immediately get a pretty much perfect explanation without noise. It's not cheating, it's just a better tool.
devmor
How do you reconcile that opinion with the fact that LLMs trained on programming concepts generally give incorrect answers about 50% of the time?
Is it actually more useful than Googling, or is it just so convenient that you let it convince you that it was useful? Or, depressingly, is Google just becoming so useless that something wrong a solid half of the time is still better?
WalterBright
> if you want to prepare for a C dev interview
Spend an hour reading a book about C?
I have a young colleague who wanted a job at a FAANG company, and asked for advice. I said spend a couple weeks studying the leetcode books - it will be the best value for time spent you'll ever get.
He did, and got a $300,000 offer.
skydhash
Or you can open any good C book and review that way. Not to bash on the use of AI, but there's a lot of alternative ways that for me is more reliable to get knowledge from.
autoexec
I'm not sure that it's a good thing if "ability to produce convincing lies" is something that a company requires in a job candidate. People getting into jobs who aren't exceptional liars when they couldn't have otherwise seems like win to me.
exabrial
>I "prepare with AI" by having it help give me hints when doing leetcode problems, which is very helpful.
It would be better if we just stopped asking l33tc0d3 questions, since it's been shown over and over again it's a pointless waste of time on both side of the aisle.
rblatz
I don’t employ leet code questions in my hiring process, but I do think they can provide value or signal.
If a candidate is taking the time to practice and master leetcode it does show the candidate is motivated, demonstrates their ability to learn and internalize knowledge, and to utilize that knowledge under pressure.
If those are things you want to screen for and have a high volume of talented candidates I can see a use for them.
exabrial
I mean, as an alternative to 133tcode, perhaps they could maybe demonstrate real world applicable skills:
* ability to communicate
* ability to empathize
* ability to be a nice person you’d want to see every day
before_the_law
> I "prepare with AI" by having it help give me hints when doing leetcode problems
I've been really impressed with how much a of performance lift working on leetcode with AI is. It's so much easier to focus on developing rapid problem decomposition skills and working with an interviewer during the problem.
Unfortunately it's also necessary to improve this process because the current standards for the companies still doing leetcode interviews are getting pretty wild these days. Meta requires 2 med-hard question solved in 20 minutes or less each for the screen these days! Even if you have solid algorithmic thinking solving and implementing solutions that quickly requires you to be insanely prepped.
giancarlostoro
English is not my first language, and yet I'm fluent, but some of the questions I've been asked to solve are insanely confusingly worded and so I have a harder time because the interview process at some places is unrealistic.
ender341341
Many interview coding questions are purposefully worded weird with the intent of seeing if you ask clarifying questions.
throwaway31131
The interviewer might be looking to see how you deal with bad specifications which, in my experience, are also often confusingly worded, vague and/or conflicting.
sidrag22
this candidates version of preparing with AI was a portion of the issue for sure though. he utilized it to attempt to optimize his dishonesty about his past experiences.
i totally agree otherwise, there are a ton of other good proper ways to prepare for an interview using AI. for example his resume, im sure he asked for some refinements about how he was wording certain things, and who cares at all that its not word for word grammatically from his mind. getting past the resume screening process is a huge part of the battle, and all the scam attempts and bad candidates will be optimizing their resume as well. The info within it should still be relevant about your ACTUAL technical skills or you are just also falling into the scam/bad candidates category.
Of course your example is a solid one, which ive done myself as well for leetcode stuff and plenty of other stuff.
IF his experiences where actually real and he used AI to simulate an interview based on them, thats a fine use case for AI, so i guess this article likely should have used a more clear way to condone this candidates preparation.
apwell23
> Interviewing is not a presentation, it's a conversation, and having a simulated other side can be helpful.
i got a high paying job at meta once i started see it as 'presentation' and not a 'conversation' .
I play this stupid ass game to make money
iamleppert
It's really easy to catch these scammers. Ask for a non-trivial code or work sample, something they have written. Actually take the time to read through the code and understand at least a part of it. In an interview, ask them some questions about it. People who actually wrote the code or did the thing can talk at length about about what they did, the history behind it, trade offs, have colorful stories about it, etc. I don't even care exactly about the technical details of it, I'm looking for signals that they are a liar.
If they say they don't remember, that's a red flag. If they can't describe how something works, that's a bigger red flag. You're not looking for photographic memory, but it's very obvious once you do it a few times who is real and who is lying.
It's common sense, if you don't put in at least a tiny bit of effort in your hiring process, you can only expect to attract similar low effort candidates.
wijwp
"Ask for a non-trivial code or work sample, something they have written."
I haven't written non-proprietary code in a decade.
spongebobstoes
Spending a few hours to write some open source code seems like a reasonable tradeoff to get a high paying job.
It is surprising to me that folks looking for a new job would not do this proactively.
mywittyname
Because interviewers don't care. I have tons of code on my personal github page and even thought it's listed on my resume/linkedin, no interviewer has ever looked at it. This includes contributions to a widely used OSS project.
YMMV, but all the high paying jobs I've received were due to knowing the tech stack they used and being able to walk through the projects that I've done in detail.
Admittedly, the last time I changed jobs was 2024, so things might be different now.
alkonaut
Everyone can produce _something_ they have written. Yes there are people who literally clock in at work and code 8-5 for 10 years and never touched a hobby project or contributed to an OSS project. And you might not want to filter that group out completely. But if I was in that group and I was considering switching jobs, I'd definitely make sure I had some of that proprietary code stashed away so I could show a potential future employer. Yes you won't be allowed to do that. And it would be understandable if in some cases (like you work as a defense contractor) it's completely impossible. But for most people it should be possible to show something.
giancarlostoro
> If they say they don't remember, that's a red flag.
Is it? I can think of projects I've worked on that have come up with friends that I have no idea how they worked anymore, just barely if at all. If the project was within the last 2 years, then yeah, but if its 8 year old plus code, I don't expect anyone to remember. However, they could have looked at it when they sent it over and refresh their minds.
rahimnathwani
OK, so ask them for something they've written in the past 2 years.
giancarlostoro
Everything I've written in the past 2 years is either proprietary or deeply private to me.
polishdude20
> If they say they don't remember, that's a red flag.
If I just have to give a code example of mine on the spot during an interview with no prep, I'm sure as hell not going to remember why I took a certain approach unless there are comments.
null
droopyEyelids
Very easy but time-consuming
aforwardslash
If one cant take 30mins to vet a candidate code sample, one should not be hiring. Or working in anything that requires proper reasoning - its akin to not writing tests or do code reviews because "they take time".
neilv
Potentially important side points, since not everyone knows, and we don't want anyone to learn a mistake by example:
1. Don't use blur to redact documents. Whatever blur was used can probably be reversed.
2. Don't try to hide the identity of someone you're talking about by redacting a few details on their resume. With the prevalence of public and private resume databases, that's probably easy to match up with a name.
highwaylights
There’s a few red flags here on the hiring side too.
I’ve given a lot of interviews, candidates will always try to come up with the best story as an answer to your question because “I can’t think of an example” is not an acceptable answer. It’s a demand you’re placing on them.
Also having experience puffed up on a resume happens around 100% of the time. The point of the interview is to figure out how much real relevant experience the candidate has.
OP was right to end the interview as they were an unprepared candidate and a bad fit, but low-key threatening someone with “word gets around” who’s trying to find a job and probably starting to panic about not having one doesn’t make him the good guy in this story that he thinks it does.
OP could have just told them not to use AI in future, but even that’s unnecessary as the lesson’s already been learned.
(I’ve also noticed that towards the end of the post OP mentions this, but it doesn’t line up with the actual call as described unfortunately)
sethammons
> having experience puffed up on a resume happens around 100% of the time
Maybe I am the rounding error. I have zero puffery, exaggerations, embellishments, stolen credit, or lies on my resume.
rahimnathwani
Me, too.
But, sadly, OP is right.
When doing a technical screen I'll sometimes pick a skill the person claims to have, and ask them the simplest possible non-trivial question I can ask.
For example, let's say you list 'SQL' as one of the skills on your CV. I might show you a SQL statement like:
SELECT id, start_date FROM employees;
(EDIT: I meant SELECT id, start_date FROM employees ORDER BY id;)I'll tell you id is an auto-increment field, and ask whether the result would show the newest employee at the top or the bottom.
You have a 50/50 chance of getting it right. If you get it wrong, I'll tell you the answer. Getting it wrong wouldn't disqualify you.
Then I'll ask you how to get it in the opposite order.
I am expecting you to immediately say 'add DESC'. If you can't answer that question in under 2 seconds, you probably haven't written enough SQL to justify listing it as a skill on your CV.
You would be surprised at how many people fail simple tests just like this one.
(I won't use this particular one again.)
cutemonster
Yes me too, zero, and I'm pretty sure it's closer to zero than to 100% among others also, here where I live
alexdowad
I'm together with sethammons in that "rounding error". I actually go further and explicitly list things which I'm not good at on my resumé.
jkhanlar
I was sharing this story and responding to various comments (here) in my conversations elsewhere on the Internet, and as part of my statements I questioned about quoting/paraphrasing the "word gets around" to determine if this is best way to reference the point, and thought I may as well share it here too. https://grok.com/share/bGVnYWN5_c0378709-b716-48af-8996-a0e4...
highwaylights
Thanks, interesting point and it hadn’t occurred to me that it would read like a direct quote.
I can’t edit it now, so will leave this here to say that it’s not a direct quote.
criddell
Use blur, but blur a different string then paste it over your text. "Nice try" is always a good choice.
myself248
If the unredacted parts of the resume were entirely fabricated, what harm is there in having the lies out there? The candidate will be scrubbing from their honest version going forward anyway.
Agreed on the blur thing, though. Blur tools should come with warnings.
jere
I'm often surprised when someone will paste a screenshot of a tweet with the name blurred (presumably to protect them from harassment). The contents of the tweet are easily searchable...
sundarurfriend
Public tweets are a different scenario, they are things that have intentionally been shouted out into the void for anyone to hear. Blurring out names is a courtesy to prevent low-effort harrassment (which is most of it), while using the tweet for its intended purpose (i.e. showing its message to the public).
mortar
On 2, I was surprised the author included the screenshot in their write up so I did some very pointed searches on some of the strings, and was surprised to see just how many profiles on LinkedIn were sourced for this farce. Good work LLMs
reneretord
Generally I agree with this advice, but if the goal is to make the dork findable with a modicum of plausible deniability this is fine.
goldchainposse
3. This probably counts as copyright infringement, unless it's chatbot output.
neilv
IANAL, but I wouldn't be surprised if this was found to be legitimate fair use.
gwbas1c
> Don't use blur to redact documents. Whatever blur was used can probably be reversed.
I just got mosquito noise when I sharpened. Are you confusing blurring with pixelating?
As long as the blur is strong enough, there's no way to get the text back.
crazygringo
Regular sharpening doesn't work.
But a deconvolution filter will. You can't do it in Photoshop but you can with a dedicated tool that tries different deconvolution kernels until it finds one that matches the exact original blur function.
This is how you can remove motion blur from a photo due to camera movement, for example. It's wild how much information is still there, in the exact precise levels and shape of the blur.
There are limits of course, but they're much further than you might expect.
gwbas1c
Well, let's see you do it! Can you deblur something like the first 2-3 letters of a name?
null
VohuMana
As someone who has conducted interviews with candidates almost certainly using AI in both the phone screen and coding portion. The biggest giveaway is the inability to explain the why of things. Even some of the simple things like "why did you initialize that class member in this method rather than in the constructor?"
I think at this point we are in a world where the cat is out of the bag and it's not are you or are you not using AI but how are you using it. I personally don't care if a candidate wants to use AI but be up front about it and make sure you still understand what it is doing. If you can't explain what the code it generated is doing an why then you won't be able to catch the mistakes it will eventually make.
veunes
Yep, it's less about if you're using AI and more about how you're integrating it into your workflow. At this point, using AI tools is becoming a baseline expectation in many roles, not a red flag. But yeah, the moment someone can't explain the rationale behind a decision (especially in their own code) that's a huge issue.
Foofoobar12345
We get a few thousand fresh grads applying to us each year. It’s practically impossible to interview every one of them. At the same time, any sort of coding assignment we give is easily defeated by AI—so that’s not useful either and there are very few signals there.
What we do instead is send out a test - something like a mental ability test - with hundreds of somewhat randomized questions. Many of these are highly visual in nature, making them hard to copy-paste into an AI for quick answers. The idea is that smarter candidates will solve these questions in just a few seconds - faster than it would take to ask an AI. They do the test for 30 minutes.
It’s not expected that anyone finishes the test. The goal is to generate a distribution of performance, and we simply start interviewing from the top end and make offers every week until we hit our hiring quota. Of course, this means we likely miss out on some great candidates unfortunately.
We bring the selected candidates into our office for a full day of interviews, where we explicitly monitor for any AI usage. The process generally appears to work.
On a different note, things are just getting weird.
jannesan
As a candidate, this sort of test gives me the worst possible impression of the company.
- 0 effort on your side - very stressful for me - completely unrelated to job - ridiculous definition of someone being “smart”
Actually, I would not even do the test most likely and I bet many others neither.
Aurornis
> Actually, I would not even do the test most likely and I bet many others neither.
Unpopular observation: Many people say this, but when they actually want or need a job they change their mind quickly.
I've lost count of how many of my peers went from "I will never grind LeetCode!" to working their way through LeetCode challenge lists as soon as a recruiter from a big tech company contacted them.
I talked to one hiring manager at a company who tested their mobile developer applicants by having them make an entire demo app with some non-trivial functionality. I assumed they wouldn't have any applicants, but his current problem was that too many qualified applicants were applying for every position and begging to do the test.
wat10000
Seriously. I’m interviewing as a programmer and you give me some ridiculous “which cube is next in the sequence” nonsense that probably has three different arguably correct answers for every question? Pass.
Foofoobar12345
We have to use some criteria when all applicants are effectively the same - 4000 applicants and 6 interviewers. We interview each applicant at least 3 times.
Definition of being smart is to be quick at mental math and logic, but the puzzles are represented visually. And yes, both those skills are needed in the course of our work.
Contrary to what you might expect, over 80% take the test. I suppose during next hiring season, we could A/B against random selection to compare what % go past our interview.
not_a_bot_4sho
> Definition of being smart is to be quick at mental math and logic
That's not smart. That's being quick at mental math and logic.
Very different things
narnarpapadaddy
We still do a coding assignment, but a significant chunk of the technical interview is dedicated to a walkthrough of the code. Thus far, that’s been able to detect those who relied solely on AI.
…If you used AI and can still explain to me why code works and what it does, even better. You have learned how to use new tools.
(have not tried the randomized question approach to compare, but I’m curious to try it and see what happens)
koyote
We do it similarly and it's pretty easy to tell if someone knows their stuff, especially as the assignment is just a platform to dig deeper in the face to face interview.
However, the coding assignment was a really good filter and allowed us to dismiss the majority of candidates before committing to a labour-intensive face to face.
I haven't interviewed anyone since AI took off, but I am assuming that from now on the majority of candidates that would usually send us crap code will send us AI code instead; thereby wasting our time when they finally appear for the face to face.
Have you encountered that yet?
narnarpapadaddy
Yes, but we had that problem before when somebody would farm out coding assignments to a friend. I couldn’t say yet how it’s impacted the coding assignment’s effectiveness as a filter yet. We still do get crap code just sometimes it’s obviously AI generated.
levocardia
>something like a mental ability test
General-purpose "mental ability tests" are typically illegal for hiring in the US.
rahimnathwani
Yes, not absolutely illegal, but if an applicant challenges the legality of the test, the burden of proof is on the employer.
boscillator
I'm still mad at IBM for giving me one of those tests for an internship after 4 years. It required a lot of fast mental arithmetic, which is, medically speaking, not my strong suit. I thought the job was programming computers, not being the computer, but the test suggests otherwise.
I probably should have figured out how to request an ADA accommodation... oh well.
umbra07
when you say "visual questions" - are you referring to questions in the style of Mensa/gifted tests?
https://www.reddit.com/media?url=https%3A%2F%2Fpreview.redd....
Foofoobar12345
Simpler - eg. A table of some numbers, with a question to quickly compute averages of a filtered set, after performing some quick boolean logic to filter them.
intalentive
You could also sort by SAT / ACT score. It will yield roughly the same results as your IQ test.
Foofoobar12345
We don’t operate in the US. Our applicants can’t present any standardized test scores
gwbas1c
Some people think it's perfectly normal to stretch the truth on a resume, and to lie in an interview. Other people think an interview is just a matter of finding the "magic words" to get the job.
What I don't understand is, what did the candidate do with AI? Did they use the AI as a coach? Did they use it to suggest edits to the resume?
---
I once interviewed a candidate who was given my questions in advance. (I should point out that it was quite time consuming for me to design an interview, so I couldn't just make up new questions for every candidate.)
When the candidate started taking the "schoolboy" tone of a well-rehearsed speech, I realized that they had practiced their answers, like practicing for an exam. I immediately threw in an unscripted question, got the "this wasn't supposed to be on the test" response, and ended the interview.
ghaff
The first part sounds like what I’d expect a serious candidate to do. Didn’t you look at the questions we sent you?
The second part sounds like areal curveball unless you made it clear that the questions sent out were only representative/samples of what you’d ask.
gwbas1c
The candidate wasn't supposed to know the questions in advance.
> The second part sounds like areal curveball
That was the point. The candidate wasn't supposed to know the questions in advance. Once the candidate can practice / memorize, there's no way to evaluate the candidate.
ghaff
That was not clear from your original comment. I read it as the company gave them the questions to presumably think about/prep.
lysecret
The way I read it is they used ai as a coach and ai probably told them some variation of “it’s ok to exaggerate”.
However, this to me would be a red flag because they somehow try to blame Ai for misrepresenting their experience. So they can’t even take responsibility for that.
dakiol
One can easily rehearse answers that sound natural. You could start with a partially wrong answer, realize midway and correct it. Easily fakeable. All the “ums”, “let me think for a second”, and even failing to answer 10% of the questions on purpose is easily doable.
tryauuum
I was in this situation on the candidate side :) however I started with "I had your question list beforehand and I searched wikipedia for the answers". I got the job
ikrenji
let me get this straight ~ someone took the time to prepare for the interview and you basically penalized them for the preparation? people are truly ridiculous
Ylpertnodi
>I couldn't just make up new questions for every candidate.
Ask each candidate the same questions?
roguecoder
Follow up questions will vary, but the bulk of most interviews is the same for every candidate, and candidates are then judged based on a rubric that is the same for every candidate (though often tailored to the specific role).
The consistency lets interviewers compare across candidates, and avoids the cognitive pitfall of defining a rubric after-the-fact that lets us hire the candidate who appealed to our lizard brains.
Even at startups, questions are also usually tested on several existing employees before it is used on the first external candidate, for calibration. Companies put a lot of time and money trying to hire for actual competence.
gwbas1c
Yes. It was a programming exercise that took me a few hours to create. It was not practical to re-make it for every candidate.
BTW, it's industry normal for companies to come up with a programming exercise and reuse it.
veunes
Yeah, this is the gray area we're all bumping into now
mystraline
> Some people think it's perfectly normal to stretch the truth on a resume, and to lie in an interview.
So marketing works in the company's favor, and not the candidates? Its a tough pill to swallow, but bending the truth and lying seems to be the way folks get jobs now.
Perhaps not lying... But I've thought about the 1pt font white on white mega-tech-list attached to Workday resumes to get past THEIR ai-slop filters. And even had my SO get insta-rejected when whatever AI term wasn't explicitly there.
As a candidate, the market is horrific. Ghost jobs, fake jobs that gather market intelligence, scam jobs, blatantly lying candidates, AI blusters, and more. I can look at the usual places, or even HN. I've even applied to my share of HN jobs without so much as a 'no' as response.
It puts us who actually want to be honest at a pretty severe disadvantage.
roguecoder
Lying isn't marketing. If you lie in marketing, people can sue you.
It is one thing to frame your experiences in ways that are relevant to what the job is looking for: it is not only unethical to fabricate experiences, it is counter-productive. I will be checking references, and if their reports of the role you played on a project don't match yours I will not be hiring you. If you don't have references who can speak to the work you did, I also won't be hiring you. All you have done is waste my time and yours.
The sheer number of applications from auto-submit-to-every-job application processes have completely broken the system. There is simply no way for every recruiter to consider ever candidate, which is what they are now being asked to do. I know that is frustrating, and I am sorry you are in that place, but lying will not help.
We will eventually figure out how to defeat these candidate-spam bots. In the meantime the only hiring pipelines that are still functional are human-to-human individual networking.
anon_e-moose
That's all fun and games until a single company puts the top 3 or 5 candidates pitted against each other to see who waits the longest without a rejection and takes the lowest offer...
I heard this from friends, and despite being very comfortable where I am, I started interviewing cynically with no intention to take any job. I can confirm this is very much true and widespread. Hiring is at its worst ever.
Whenever supply and demand gets fixed, we'll see these behaviors go away.
veunes
Completely agree with the distinction you're making: framing is fine, fabrication is a deal-breaker. It's frustrating how often people conflate "putting your best foot forward" with just making stuff up, especially when they underestimate how easily it can fall apart during reference checks or follow-ups.
dpkirchner
> Lying isn't marketing. If you lie in marketing, people can sue you.
That's why we had our guys down in marketing come up with a new term for it. Focus groups, legal review, the works! Now we call it "puffery".
mystraline
> Lying isn't marketing. If you lie in marketing, people can sue you.
That is also fungible as well. Some lies just aren't catchable, like experience with skills that you teach yourself quickly, or go through a quick online course. Not saying I should, but "fake it till ya make it" is a definite thing.
> If you don't have references who can speak to the work you did, I also won't be hiring you.
There's also a reason I'm leaving the role, and usually you don't want people near your position to know youre looking.
And also, demanding references is the old AI slop - you're only going to give glowing references. Nobody gives bad references. And the worst case is you have a friend answer, or you buy one of those reference services (yes, theres a service for that).
> know that is frustrating, and I am sorry you are in that place, but lying will not help.
I think you're missing the point of the type of 'lying' I was referring to. Workday uses an absolute terrible AI, that uses keyword search. With my resume, the human readable text is accurate and me, but to this ai-slop scanning woukd scan 1pt listicle of every keyword.
Its not lying, but it is. Play stupid AI bullshit games, get gamified AI slop solutions. And I hate it. But even having a discussion with someone would be a start.
gwbas1c
Well, everyone tells their interpretation of the facts in a way that puts them in the best light.
For example, in 2003, I was fresh out of college and the job market was slow. I applied at a retail store so I could have some beer money. I was honest that I was looking for a job in tech and that I wasn't going to stay forever. Then I said I'd probably be there for 3-4 months.
I was there for 2 weeks, and I don't list the job on my resume.
Was I telling the truth when I said 3-4 months? I certainly gave them the longer end of the estimate in my head.
Was I telling the truth when I left the retail job off of my resume?
roguecoder
Leaving short-duration jobs off is common practice. The only way it might be "lying" is if you happened to, I dunno, have joined SVB just in time to commit a bunch of fraud, and then hoped no one googles your name. And even then, if it was three weeks, when your conviction comes up in the google search no one is going to think you lied leaving it off.
Similarly, it is typical that people will have a polite fiction for "why did you leave your last role?" that hints in the direction of the real reason without saying anything the company wouldn't want to be said publicly. That question is a test of your discretion as much as it is making sure the same reason doesn't apply to the new company.
However, saying you have a degree you don't, worked on a project you didn't, implemented something you didn't, led a project you only participated in, or used a technology you didn't: those are lies. Even if you get away with it, you are setting yourself up for a role you are unqualified to have. If you get caught, you will be correctly fired.
myrandomcomment
I linked this to my team and got back "I had almost identical experience with some candidates though no one admitted faking" and "One candidate just disconnected and was never heard back from after being asked to remove virtual background".
Interviewing is hard. Over the years the one thing I have learned is that for a technical role you want to interview people for how they THINK and REASON. This is hard and requires a time investment in the interview.
Back in the day when interviewing people for roles in networking, data center design, etc. I used to start by saying I am going to ask you a question and unless you have seen this very specific issue before you will NOT know the answer and I do not want you to guess - what I care about is can you reason about it and ask questions that lead down a path that allows you to get closer to an answer - this is the only technical question I will be asking and you have the full interview time to work thought it. I have people with 4+ CCIE family certs (this is back when they were the gold standard) and 10 year experience have no idea how to even reason about the issue. The candidates that could reason and work the problem logically became very successful.
For coding at my company now we take the same approach. We give candidates a problem with a set of conditions and goal and ask them to work through their approach, how they would go about testing it, and then have them code it in a shared environment of their choosing. The complexity of the problem depends on the level the candidate is interviewing for. For higher level engineerings besides the coding, we include a system architecture interview, presenting a requirement, taking the time to answer any questions, and then asking the candidate how they would implement it. At the end we do not care if it complies, what we care about is did the candidate approach the problem reasonably. Did they make sure to ask questions and clarifications when needed. Did their solution look reasonable? Could they reason on how to test it? Did their solution show that they thought about the question - IE, did they take the time to consider and understand before jumping in.
Anyone can learn to code (for the most part). Being able to think on the other hands seems to be something that is in short supply.
sam36
I've got no sympathy for the person doing the interviewing here. They advertise a "L3" software job for $150k a year and wanting someone with internship experience. Doesn't even make sense. Then they interview someone with a sh!t resume written in semi-broken english and act surprised that they are fake. I guarantee if I had applied I would not have even been considered due to 15 years of experience and that seems to put me in the "too expensive" category even though I live in a rural town and my monthly expenses are under $2k (with a family of 5 even).
I hope this guy's startup fails. That is what you get.
dakiol
The guy had to invent “cool” scenarios because companies think they are Google and working in backend doing normal things won’t get you hired. One could easily have prepared the whole interview with AI without failing to explain details (like what data was being paginated) just by lying a bit more. Not lying on your actual knowledge but on what your previous jobs were about. E.g., I have used k8s in pet projects but not at work, but this job ad for a backend position asks knowledge about k8s, so I’ll put k8s as skill under my last job and invent a credible story that I can talk about based on my experience during my pet projects.
I think the message here is: don’t ask for the moon, you are not Google.
frogulis
While I think this view is probably apt in other situations -- and to be clear, I don't know much about the company -- all of the specific techniques mentioned on the candidate's CV and in the article are fairly "garden-variety".
The pagination example seems like a perfectly reasonable thing for both sides to want to talk about, and which becomes relevant at a level of scale much smaller than Google.
dakiol
imho I think the pagination example alone wouldn’t get you hired even if told correctly. In over a decade of experience my “coolest experience” related to pagination is about not using LIMIT and OFFSET because it’s not performant… but that’s 101 knowledge and doesn’t sell.
theamk
The pagination was chosen because it was prominently featured in the candidate's resume, and was something that interviewer was familiar with - it's not about "cool experience", but rather conversation starter.
When performing interview, asking about things mentioned on the resume is a pretty good conversation starter. No one wants random trivia, resume entries, especially from the most recent jobs, are absolutely fair game. And if they turn out too simple, we can always dig further based later.
coolThingsFirst
What’s the better way to do pagination?
Aurornis
They weren't asking Google questions. They were asking about basic pagination, which is an entry-level topic.
Hard to argue with their interview process when it successfully unmasked someone who didn't have the basic experience to discuss a simple topic.
never_inline
The message is: good lie is not too far from truth.
hbsbsbsndk
I've interviewed some candidates (more senior than TFA) and I agree with OP that it is a uniquely uncomfortable experience.
Candidates who rely on AI seem to just be totally turning their brains off. At least a candidate who was embellishing in the old days would try to BS if they were caught. They could try and fill in the blanks. These candidates give plausible-sounding answers and then truly just give up and say "ummm" when you reach the end of their preparation.
I've been interviewing for 10+ years across multiple startups and this was never a problem before. Even when candidates didn't have a lot of relevant experience we could have a conversation and they could demonstrate their knowledge and problem-solving skills. I've had some long, painful sessions with a candidate who was completely lost but they never just gave up completely.
Developers I've worked with and interviewed who rely on AI daily are just completely helpless without it. It's amazing how some senior+ engineers have just lost their ability to reason or talk about code.
roguecoder
I suspect we are seeing the first wave of programmers who got a promotion to "senior" on the basis of being an early AI adopter at a place that valued lines of code written or tickets closed or other similarly-game-able metrics.
Alternatively, there are people who haven't been promoted but think their AI-fu is so good they obviously should have been, without realizing that "senior" is actually a different role, with additional responsibilities.
I've found asking about their pedagogy when coaching junior engineers is a great sorting strategy right now. It isn't something a lot of people have written about so ChatGPT's answers are full of useless platitudes, and mid-level engineers often don't even know that it is part of the job.
msravi
I don't think this has anything to do with using AI for prep. 20 years ago I was interviewing candidates who had somewhat lied on their resume, knew some of the things that they'd written about, but had everything fall apart under a little more questioning of what exactly they'd done and why.
matsemann
I think the difference is that you used to need a certain knowledge to be able to bullshit. You could still do it, but it would mainly be to embellish stuff you already somewhat know. With LLMs, it's easy to make it write a whole page of interview prep you can use to hide your tracks, without any prior knowledge. My guess is they saw that kapwing wanted experience in X,Y,Z and made an LLM create projects that sounds real in a way you otherwise wouldn't be able to do as easily.
msravi
From the article:
> but it had been some time ago, and they never worked on any of the features
It appears that the candidate might have actually worked on the daycare app, but not on what they said they worked - i.e., the ratelimiting and pagination. It appears that they might have been working on the frontend, and took the liberty of "expanding" their role - this used to be extremely common in a big sample of the resumes, and I'm guessing it still is. They might have used AI to prep - they used to use google earlier, but the prep was (and is) still inadequate if you've not actually worked on and implemented it. I don't think it was an entirely LLM created project...
looofooo0
Well I guess if the candidate would be a little be stronger and actually trying to reason with the LLM about the decision it suggested, he would be better prepared and maybe got away with his claims.
Or as current best chess player Magnus Carlson said, "if I would cheat, you would never know". Meaning very strong candidates will get away with flexing the truth with AI. But this means maybe, you shouldn't look for a perfect fit. Or check his merit by spending time and money to get in touch with his old companies.
throwaway743
Wouldn't be surprised if the whole post was actually written up by AI as a "subtle" way of promoting the company, fueled by riding out the outrage from hiring managers on linkedin
lysecret
I used to do a lot of hiring interviews long before ai and this exact situation has happened many times. People have been added to some project doing x haven’t really done much or engaged in it. They then see you need someone doing x then they add it to their resume. However, I do agree not being able to fully talk about a thing you have been working on and worse misrepresenting the extend of your involvement are red flags. Has nothing to do with AI though. Also sounds a bit like they wanted to say: “Ai encouraged me to exaggerate a bit” which again just means they wanted to shift the blame which is another red flag.
I keep coming back to this phrase used in this post: "it was scary".
Yeah, hiring is scary. Hiring is insanely expensive on all fronts. Firing people is difficult, it's expensive and legally exposing. Hiring the wrong person, allowing them access your systems and potentially exfiltrate your IP to them is a hazardous but necessary venture.
The thing is, none of these things really changed with AI. People have been lying about their experience for literally centuries. IMO the advent of AI-laden candidates is going to nudge the hiring process back to how we did it 10 years ago, with a good old fashioned face-to-face interview and whiteboard questions. This means a lot of things that we've grown accustomed to in the past 5 years is going to have to melt.
- people are probably going to have to fly out for interviews, again.
- awkward and/or neurodivergent people are going to have to learn social skills again.
- And yeah, you guys, it's time to buy a suit.
Companies should consider reverting to forking the upfront $13-1500 dollars for a set of plane tickets for their hiring team and rented conference rooms for a week. It's a whole lot cheaper than spending 50k because you hired the wrong person for half a year.