Skip to content(if available)orjump to list(if available)

Minecraft with object impermanence

Minecraft with object impermanence

147 comments

·January 19, 2025

skykooler

This was a fun read. But some of the things attributed to a glitchy AI are just normal Minecraft stuff. For example: "One time I was swimming across a lake and noticed that the reflections at the water's edge were looking weirdly spiky." That's kelp, it looks like that in the game because the chunks beyond haven't loaded so it stands out from the sky. Also, the "natural blocks of rare glowstone" are honeycomb blocks, which she thinks might be new "cheese" blocks but in fact have been in the game for over five years.

kqr

> over five years

I think there is a generation of Minecraft players that participated in the alpha, beta, and early 1.0 releases and then grew out of it. For these people, "in the game for over five years" is basically the same as "new".

(I belong to that group. I recently started introducing my four-year old to Minecraft and there is so much stuff that was not there when I played!)

bakugo

Can confirm.

Whenever I'm reminded of the existence of things like Villagers, or the End, my brain still goes "oh yeah, that new thing they added" before reality catches up and I realize just how long those things have been in the game.

Part of it is because 80%+ of my playtime was before they were added, but I think another part of it is that those things have never really quite fit into the game in my mind.

Suppafly

>Whenever I'm reminded of the existence of things like Villagers, or the End, my brain still goes "oh yeah, that new thing they added" before reality catches up and I realize just how long those things have been in the game.

Same, one of my kids will randomly want me to play and I'm constantly surprised by some 'new' thing that's literally been in the game for 10 years. It's kinda cool that minecraft has existed as a thing for basically my kids' entire lives, and oldest is in college now.

imtringued

The End is akin to an inside joke or maybe a pun. You cannot finish a sandbox game, so Notch deliberately added a dimension that you have to go out of your way for, that is difficult to find, unless someone tells you or you read about it. The End dimension isn't meant to fit in the game. It's meant to subvert the idea of a sandbox game.

You can say "I've reached the end of Minecraft" and it is true by the letter of the words, but untrue by the spirit of the words. Beating the Ender Dragon does not mean you finished all the content in Minecraft, since there is content even beyond the Ender Dragon.

TazeTSchnitzel

Minecraft has been around for more than 15 years, and the game was already fully recognisably itself by around 2012. There's 13 years of additions that will always feel mostly unnecessary to many players.

mapt

These people will have to buy a second account because Microsoft up and deleted them when they bought Minecraft, and haven't been sued yet. If you were paying attention at the time they offered a migration process for Mojang accounts to Microsoft accounts... and then turned it off because 'fuck you that's why'.

Instead, people are apparently suing them because Microsoft banned gun mods.

America in a nutshell.

Modified3019

This was me. Played the beta for a little bit, didn’t find what was there very compelling and stopped with the year.

A decade later it turns out my sister got into it that she had a realms server with friends and I joined. Basically a completely different game, which is mostly a positive.

Though mojang really needs to fix inventory management bullshit, which is not fun. There are many more possible items now, but with the same inventory space as the game started with, meaning anything you do results in inventory constantly filling up.

portaouflop

Building item sorters is a fun red stone project. You just dump your inventory in a chest and it gets sorted automatically.

littlestymaar

This exactly. I wouldn't be surprised if most HN readers had played a bit of Minecraft 13 to 15 years ago and still represent Minecraft like that even after all that time. I'm definitely one of those BTW.

TeMPOraL

Same here. Played a lot of it in a brief moment some 13 years ago, then never touched it again. Villagers and stuff is still strictly in the "new" category for me.

lynndotpy

Infinidev here :) It's wild to think that some people played Minecraft, had kids, and some of their kids are older than I was when I started playing Minecraft.

tokai

The kids teased me so much for trying to build an obsidian generator. Almost the whole game was new for me.

khedoros1

I've got a map full of redstone gadgets that I made like...13 years ago, I suppose. Few of them work in the current version of the game.

I played a bunch around the 2010 timeframe, then around 2015, then around 2021. It was a strange mix of familiar and new each time.

iamthepieman

I first played Minecraft when Notch was posting demos as zip files on the TIGSource forums. I playtested and kept playing off and on until a little after the 1.0 release but that was still over 10 years ago. Some of the early demos also had object impermanence. You would leave a chunk and when you went back to it, it had been re-generated.

Akronymus

I stopped playing anything beyond 1.7.10.

I still play a lot of 1.7.10 though, because of gtnh. Loving that modpack quite a bit.

bombcar

The most surprising thing about GTNH, to me, is how much of "vanilla minecraft" is already present in 1.7.10 and how relatively minor the changes since then (except the resizing of the world) have been.

danudey

For what it's worth, I'm fully aware of honeycomb blocks and have played Minecraft recently, but I've never seen a honeycomb block in person. It's entirely possible she plays casually or has played casually recently but doesn't engage with media or wikis enough to know about blocks that she hasn't had reason to see.

sedatk

That's pretty much how my dreams work. For example, I can read in my dreams (like signs, books), but it's almost always one word at a time, and the rest of the text becomes impossible to focus while I'm reading that word, no matter how hard I try. It's like the "permanence module" is disabled and my brain falls back to a primitive generative AI for the next frame. And, I can't reason about the logic of my experience, the lack of causality, or persistence of objects at the time. Everything feels "as they should be" despite how awkward things get. I guess that's why nightmares are so convincing or hard to get out of, because I can't reason about them. The whole article feels like describing a typical dream to me.

EZ-E

> I can read in my dreams (like signs, books), but it's almost always one word at a time, and the rest of the text becomes impossible to focus while I'm reading that word, no matter how hard I try. It's like the "permanence module" is disabled

Techniques for lucid dreaming rely on this fact for you to be able to "detect" that you are in a dream. There is one where you need to look at time, look away and look again. The time will change or be in an impossible format if you're dreaming. Then if you're aware you're dreaming you can start to "control" the dream.

rogual

Recently I found myself looking at an old alarm clock with a seven-segment display, but the segments were lit up arbitrarily, making an unreadable pattern instead of a time. But then I remembered, oh yeah, that's right, I do have a broken old alarm clock that does that, it's probably just that, I'm not dreaming. And I fell back into the dream.

The funny thing is, I really do have an old alarm clock that does that. It's the most useless alarm clock ever, because not only can it not tell you the time, it can't even tell you if you're awake.

westmeal

I've found your brain is extremely quick to jump to conclusions in a dream. It's surreal sometimes where random connections like your alarm clock suddenly come out of nowhere and draw you back in.

lucidlucia

Funny enough, I never really needed these tricks. Or I guess, I do have one? It's when I realize the events are scripted. I don't know why, but many of my dreams are perfectly sensical and linear, and sometimes I notice and hijack them. What I can do with them tho, depends on how close I am to waking up.

Saddest one was when I realized I was walking my dead dog. She was actually exhibiting behaviors I know she had been used to have, but not ones I had consciously remembered much when thinking about her after her death. I lingered on that one a bit. Still, dreams are dreams, and there was some weirdness, and I knew them for what they were. But that time, I did not fight the script.

thedanbob

> It's when I realize the events are scripted.

> But that time, I did not fight the script.

That's a good way of putting it. In the past when I realized I was dreaming, I would take advantage of the situation and change things, give myself superpowers, etc. But in recent years my few lucid dreams have had really interesting plots, so I consciously chose to let things be and just see where they go.

sedatk

> I was walking my dead dog

I can relate. I saw my dead dog several times in my dream, and in the dream, it felt like she was never dead in the first place, not like I reunited with her, but it was just another of those regular days with her. So, even though I enjoyed the dream, I didn't have that euphoric joy of reuniting with her. I perceive everything as 100% absolute truth and only realize what's wrong after I wake up.

diggan

> There is one where you need to look at time, look away and look again. The time will change or be in an impossible format if you're dreaming.

I did a bunch of lucid dreaming when I was younger (seems it was a lot easier then?), and even knowing things like that can end up making sense in the dream, you sometimes end up thinking "Well, it kind of makes sense the time went from 11:00 to 14:00 when I looked away, I did look away for quite a while".

For people who haven't lucid dreamed before, it might sound simple and almost stupid, but a lot harder when you're trying to look at your watch and everything makes sense but also not.

jfactorial

The key to lucid dreaming for me is to question reality regularly, and as a result do things in waking life to test if I'm dreaming. About once a month I will legitimately wonder whether I'm dreaming and press my hand into a solid object expecting my hand to sink into it. This has helped me go lucid in a dream a few times. It's made me seem nutty a few more than that.

Aerbil313

The way you described is only one technique, and lucid dreams obtained with this technique have a false positive rate higher than wake-induced (WILD) methods. These false-positives are normal dreams masquerading as lucid. An example is flying like superman “because you know you are in a dream and you can do anything” in order to get the milk from supermarket because your dream-wife told you there is no milk in the kitchen. See the logic error?

Suppafly

>Techniques for lucid dreaming rely on this fact for you to be able to "detect" that you are in a dream.

I wish I could figure out how to do that, anytime I'm dreaming all the weird inconsistencies and people morphing from one person to another and such all just seem to be normal.

sedatk

Yeah, I can't detect it at all. When dreaming, everything feels 100% real despite how unrealistic it gets: my vision is blurry, it's always in a darker hue even in the daylight, colors are grayish, i can't reason, my long term memory doesn't work, objects don't stay where they are, no logic to anything, sounds are weird. Yet, I can't tell if it's a dream. I can't even think about whether it's a dream or not. My reasoning module doesn't function. If things become so stressful, I wake up, but that's about it.

HappMacDonald

My experience with nightmares has largely been that a part of my subconscious is trying to conduct the dream in an "exciting" direction, to engender thrill on a par with a carnival ride .. but then it slips or gets out of hand and turns into a spiral of self-fulfilling terror instead. I feel like ruminating on that process some during waking time has helped my dream producing instincts to instead steer away from unnecessary sources of fear often before I even perceive (during the dream) that things might have been about to get scary (though I'm often able to assess that pattern after the fact).

kqr

> It's like the "permanance module" is disabled and my brain falls back to a primitive generative AI for the next frame.

What if there is no such module and whenever you believe you have experienced permanence it is because your brain confabulated it from what it actually observed?

sedatk

I'd still call that permanence module :) AFAIK, that the way our vision works is that our eyes only see a narrowly focused region in detail and the rest of our periphery is generated by our brain (based on what we saw there before). There are optical illusions based on that.

diggan

> AFAIK, that the way our vision works is that our eyes only see a narrowly focused region in detail and the rest of our periphery is generated by our brain (based on what we saw there before).

I know it's a over-simplification, but maybe too much of it? 100% of your periphery isn't "generated" by your brain based only on what you've seen before, otherwise it wouldn't be possible to see stuff "at the corner of your eyes" or "looking while not looking" where you can see stuff without actually focusing straight on on the thing itself.

xeonmc

"Attention", perhaps?

null

[deleted]

rogual

There's a bit in Ender's Game where he plays this computer game that has a dreamlike quality to it. It seemed it could simulate a response to any player action, and continue the story along that path. I think in the book it was a tool for introspection, like dreams can be? I can't really remember.

Anyway, as a kid I thought, silly author, that's not how computer games work. But it turns out Orson Scott Card is smarter than me. Give this kind of thing a few years and we'll have it.

UltraSane

I think that "game" was a tool used to test the kids.

kridsdale1

Or guide them towards their true goal.

mkoubaa

This reminds me of dreaming. Either there's a similarity between dreaming and what this AI is doing or my human brain is stereotypically finding patterns where there are none.

MarioMan

I felt the same way using GPT-2 and AI Dungeon back in the day. The surrealism and incredibly short-term memory was a big part of the fun.

djmips

Yeah, I tend to agree. I think there is a familiarity and if you read up on how AI generates images it kind of works like that where it builds and amplifies noise or existing structure as a seed of a plausible image. Our perception of reality probably works like this except we are getting some good consistent information from our eyes - using the same apparatus with blank inputs or noise or shifting memories then you get some interesting output.

lionkor

> the first step in our research towards more complex interactive worlds

As we know, object permanence is not really needed in any videogame, so this makes sense. It's also easy to add in, they just didn't do it because they didn't feel like it.

Snark aside, not sure what that is supposed to mean. This isn't interactive in the same sense that games are, its not a world because it doesn't have any properties of a world, its just a video generator you can steer with keys. Cool, but not what we would call an interactive world

Jeep_

I would argue that a video generator you can steer with keys is an interactive world. In this case the way you "steer" has a direct effect on your experience which makes it, in my sense, interactive.

Dilettante_

It's an interactive experience, but you are not interacting with, having any impact on, a world.

xigoi

Well, that’s just because of the lack of object permanence.

RedNifre

You can interact with it, by placing or breaking blocks, harvesting crops etc.

lou1306

> Things became duplicated in Tlön; they also tend to become effaced and lose their details when they are forgotten. A classic example is the doorway which survived so long as it was visited by a beggar and disappeared at his death. At times some birds, a horse, have saved the ruins of an amphitheater.

JL Borges, Tlön, Uqbar, Orbis Tertius

aktau

I highly recommend this to anyone reading HN. I wouldn't say it changed my life, but I think about Borges and Fictions/The Aleph at least once per year.

lou1306

I would say that TUOT is absolute essential reading (even more than the -- justifiably -- better-known Library of Babel), since the fact that things disappear unless kept in memory is exactly how the digital world works.

treyd

> One time I was swimming across a lake and noticed that the reflections at the water's edge were looking weirdly spiky.

This is probably the model trying to generate kelp is the ocean. When water is in chunks on the edge of the loaded world, you can see through the water to the sky at that angle, so you also see the outline of the kelp kinda like that.

This is pretty common to see in the game nowadays, but the AI model might be having a hard time since kelp was only added a few years ago and isn't as well represented in the training data.

gwern

> The problem, as far as I can tell, is that if all this works perfectly, this will be simply the human-programmed Minecraft we already have, except far more expensive to run. The original Minecraft is already infinitely playable, thanks to the way it randomly generates a 7x-larger-than-planet-Earth landscape with each new game. You can't use generative AI like this to get a new kind of game, only a better simulation of the game you trained it on.

Oh come now, that's not true and is showing a lack of imagination, especially from someone who's been covering generative models this long. There's lots of things you can do with an accurate differentiable model of Minecraft - just like there's lots of things you can do with a LLM or a diffusion model beyond just 'generate a random sample'. (Just think about all the things you can do with CLIP steering a diffusion model...) Imagine describing GPT-3 as saying 'as far as I can tell, if this all works perfectly, this will simply be Common Crawl, except far more expensive to read'!

torginus

The AI dungeon thing is a salient point - GPT2 (which it started out with) could barely make a coherent paragraph, and GPT3 could write about half a page of text that more or less made sense.

With modern LLMs, they still get occasionally tripped up, but you could go for pages without a minor detail not making sense.

Something similar might happen with these game models, given enough time.

TeMPOraL

AI Dungeon was the text equivalent of the Minecraft thing in TFA. I still remember the distinct feeling I had after getting immersed in the interactive story experience for an hour - for the rest of the day, I felt like I woke up from an intense fever dream.

itsTyrion

Oooor we could not waste our time with game models that serve no purpose after a minute of "that’s cool"

rollcat

That's the difference between a deterministic and a stochastic system. Using one where you need the other leads to exactly these kinds of results. Recent trend in LLMs is to gravitate towards more determinism (like fact checking), I'm afraid in the end we will come full circle and end up with a fancy frontend to a database.

fdb

Janelle Shane’s work has been really inspiring. Her talk at Strange Loop from a couple of years ago — right before DALL-E, before ChatGPT — was a turning point, and very funny:

https://youtu.be/yneJIxOdMX4?feature=shared

omcnoe

Interesting blog post from the creators with more details about the model: https://oasis-model.github.io

Interactive demo: https://oasis.decart.ai/

lostmsu

As far as I can see, the demos in the blog post are cherry-picked. In most cases that I tried the model could not understand that I just mined a block and it should go to my inventory. Still very impressive.