Python lib generates its code on-the-fly based on usage
92 comments
·May 12, 2025turbocon
anilakar
Didn't someone back in the day write a library that let you import an arbitrary Python function from Github by name only? It obviously was meant as a joke, but with AIcolytes everywhere you can't really tell anymore...
__alexs
There's one that loads code out of the best matching SO answer automatically https://github.com/drathier/stack-overflow-import
atoav
Why not go further? Just expose a shell to the internet and let them do the coding work for you /s
dheera
It's not really something to be sarcastic about.
I've actually done this, setting aside a virtual machine specifically for the purpose, trying to move a step towards a full-blown AI agent.
bolognafairy
“Twitch does…”
rollcat
Flask also started as an April 1st joke, in response to bottle.py but ever so slightly more sane. It gathered so much positive response, that mitsuhiko basically had to make it into a real thing, and later regretted the API choices (like global variables proxying per-request objects).
tilne
Is there somewhere I can read about those regrets?
rollcat
Two days after the announcement: https://lucumr.pocoo.org/2010/4/3/april-1st-post-mortem/
I think there was another, later retrospective? Can't find it now.
QQ00
I second this, I need to know more. programming lore is my jam.
userbinator
It's like automatically copy-pasting code from StackOverflow, taken to the next level.
null
extraduder_ire
Are there any stable output large language models? Like stablediffusion does for image diffusion models.
tibbar
If you use a deterministic sampling strategy for the next token (e.g., always output the token with the highest probability) then a traditional LLM should be deterministic on the same hardware/software stack.
extraduder_ire
Wouldn't seeding the RNG used to pick the next token be more configurable? How would changing the hardware/other software make a difference to what comes out of the model?
roywiggins
Deterministic is one thing, but stable to small perturbations in the input is another.
3abiton
Sounds like a fun way to learn effective debugging.
emporas
It imports the bugs as well. No human involvement needed. Automagically.
dheera
I mean, we're at the very early stages of code generation.
Like self-driving cars and human drivers, there will be a point in the future when LLM-generated code is less buggy than human-generated code.
AlotOfReading
That's a compiler with more steps.
kastden
You can make it production grade if you combine it with https://github.com/ajalt/fuckitpy
archargelod
The repo name made me think it's a tool that stops you from using a project if it detects python:
"fuck, it's python!" *throws it in the garbage*
the_real_cher
we need one of those for golang
selcuka
This is amazing, yet frightening because I'm sure someone will actually attempt to use it. It's like vibe coding on steroids.
- Each time you import a module, the LLM generates fresh code
- You get more varied and often funnier results due to LLM hallucinations
- The same import might produce different implementations across runsbaq
There are a few thresholds of usefulness for this. Right now it’s a gimmick. I can see a world in a few years or maybe decades in which we almost never look at the code just like today we almost never look at compiled bytecode or assembly.
latentsea
There's not much of a world in which we don't check up and verify what humans are doing to some degree periodically. Non-deterministic behavior will never be trusted by default, as it's simply not trustable. As machines become more non-deterministic, we're going to start feeling about them in similar ways we already feel about other such processes.
NitpickLawyer
> Non-deterministic behavior will never be trusted by default, as it's simply not trustable.
Never is a long time...
If you have a task that is easily benchmarkable (i.e. matrix multiplication or algorithm speedup) you can totally "trust" that a system can non-deterministically work the problem until the results are "better" (speed, memory, etc).
jerf
You will always get much, much, MUCH better performance from something that looks like assembler code than from having an LLM do everything. So I think the model of "AIs build something that looks recognizably like code" is going to continue indefinitely, and that code is generally going to be more deterministic than an AI will be.
I'm not saying nothing will change. AIs may be constantly writing their own code for themselves internally in a much more fluid mixed environment, AIs may be writing into AI-specific languages built for their own quirks and preferences that make it harder for humans to follow than when AIs work in relatively human stacks, etc. I'm just saying, the concept of "code" that we could review is definitely going to stick around indefinitely, because the performance gains and reduction in resource usage are always going to be enormous. Even AIs that want to review AI work will want to review the generated and executing code, not the other AIs themselves.
AIs will always be nondeterministic by their nature (because even if you run them in some deterministic mode, you will not be able to predict their exact results anyhow, which is in practice non-determinism), but non-AI code could conceivably actually get better and more deterministic, depending on how AI software engineering ethos develop.
rollcat
There was a story written by (IRRC?) Stanisław Lem: technology went to absurd level of complexity, yet was so important to daily lives that the species' survival depended on it. The knowledge of how everything worked has been long forgotten; the maintainers would occasionally fix something by applying duct tape or prayers.
Sufficiently advanced technology is indistinguishable from magic.
We're basically headed in that direction.
selcuka
Asimov's "The Feeling of Power (1958)" [1] was similar.
[1] https://archive.org/details/1958-02_IF/page/4/mode/2up?view=...
adammarples
This later evolved into the 40k universe
Legend2440
It lets you do things that are simply not possible with traditional programs, like add new features or adapt to new situations at runtime.
It’s like the strong form of self-modifying code.
ralferoo
I really liked this:
The web devs tell me that fuckit's versioning scheme is confusing, and that I should use "Semitic Versioning" instead. So starting with fuckit version ה.ג.א, package versions will use Hebrew Numerals.
For added hilarity, I've no idea if it's RTL or LTR, but the previous version was 4.8.1, so I guess this is now 5.3.1. Presumably it's also impossible to have a zero component in a version.
kordlessagain
> zero component in a version
I immediately got this. So true!
extraduder_ire
I'm both surprised it took so long for someone to make this, and amazed the repo is playing the joke so straight.
behnamoh
can it run Doom tho?
from autogenlib.games import doom
doom(resolution=480, use_keyboard=True, use_mouse=True)Gabrys1
It's been 3 hours and no-one came back with an answer. They must be busy playing Doom
roywiggins
Possibly the funniest part is the first example being a totp library
1718627440
This has a file named .env committed containing an API key. Don't know if it is a real key.
bgwalter
My guess is that it's a joke about:
https://jfrog.com/blog/leaked-pypi-secret-token-revealed-in-...
1718627440
Sorry, what is the joke? The site to me seams legit?
nxobject
One way to get around non-deterministic behavior: run $ODD_NUMBER different implementations of a function at the same time, and take a majority vote, taking a leaf from aerospace. After all, we can always trust the wisdom of the crowds, right?
mac3n
> taking a leaf from aerospace
experiment showed that independent [human] software developers make the same mistakes
you need at least $ODD_NUMBER > 7
https://leepike.wordpress.com/2009/04/27/n-version-programmi...
mac3n
AI developers might just riff on each others' code
matsemann
I did something similar almost 10 years ago in javascript (as a joke): https://github.com/Matsemann/Declaraoids
One example, arr.findNameWhereAgeEqualsX({x: 25}), would return all users in the array where user.age == 25.
Not based on LLMs, though. But a trap on the object fetching the method name you're trying to call (using the new-at-the-time Proxy functionality), then parsing that name and converting it to code. Deterministic, but based on rules.
cs702
Silly and funny today, but down the road, if AI code-generation capabilities continue to improve at a rapid rate, I can totally see "enterprise software developers" resorting to something like this when they are under intense pressure to fix something urgently, as always. Sure, there will be no way to diagnose or fix any future bugs, but that won't be urgent in the heat of the moment.
conroy
you'd be surprised, but there's actually a bunch of problems you can solve with something like this, as long as you have a safe place to run the generated code
thephyber
I was super interested in genetic programming for a long time. It is similarly non-deterministically generated.
The utility lies in having the proper framework for a fitness function (how to choose if the generated code is healthy or needs iterations). I used whether it threw any interpretation-time errors, run-time errors, and whether it passed all of the unit tests as a fitness function.
That said, I think programming will largely evolve into the senior programmer defining a strategy and LLM agents or an intern/junior dev implementing the tactics.
NitpickLawyer
> That said, I think programming will largely evolve into the senior programmer defining a strategy and LLM agents or an intern/junior dev implementing the tactics.
That's basically what goog wants alphaevolve to be. Basically have domain experts give out tasks that "search a space of ideas" and come up with either novel things, improved algorithms or limits / constraints on the problem space. They say that they imagine a world where you "give it some tasks", come back later, and check on what it has produced.
As long as you can have a definition of a broad idea and some quantifiable way to sort results, this might work.
pbronez
> The utility lies in having the proper framework for a fitness function
Exactly. As always the challenge is (1) deciding what the computer should do, (2) telling the computer to do it, and (3) verifying the computer did what you meant. A perfect fitness function is a perfect specification is a perfect program.
jnkl
Could you elaborate what problems can be solved with this?
Wow, what a nightmare of a non-deterministic bug introducing library.
Super fun idea though, I love the concept. But I’m getting the chills imagining the havoc this could cause