Upgrade to 1.4

Started by Tom, October 26, 2012, 05:47:40 PM

Previous topic - Next topic

Tom

Sorry :(

I had intended on doing the upgrade today, but I was working to catch up a bit with work, and got sucked into "Just a few more minutes, just gotta fix this bug" mode. Which is funny, I fixed the bug I was wanting to fix like 3-4 hours ago. After that, I found another thing I wanted to fix, and didn't think it'd take too long. Still not fixed, but I'm zeroing in on the problem. So woo.

My plan now is to move the map over tomorrow.

append:

If you're wondering why I don't just do it now...  have three excuses: 1. my brain hurts, 2. I have a headache, 3. I'm really tired.

Also I need to find my old DDR2 ram, the box I'll be playing on (and messing with mcedit on) only has 2GB in it. I've somehow lost an entire system, motherboard+cpu+ram all still together, but nowhere to be found. Want to look for that a bit harder tomorrow.
<Zapata Prime> I smell Stanley... And he smells good!!!

Mr. Analog

Work on a Saturday? You crazy! :D
By Grabthar's Hammer

Tom

#92
Quote from: Mr. Analog on November 24, 2012, 11:42:22 PM
Work on a Saturday? You crazy! :D
I took thursday off ;) I try to make some actual progress, its hard when the code gets this complicated. Asynchronous threaded mumbujumbo and a UI layer that is brain dead (*cough*UIKit*cough*).

edit: it was a bug that was bugging me (pun not really intended) off and on for ages now. Never could track it down properly till today. Usually other more serious issues would come up. This was just a slight logic error that caused some items to be initialized somewhat incorrectly (in only certain cases), up till now it was just a minor glitch compared to other things. And now its fixed, and onto the next most annoying glitch.
<Zapata Prime> I smell Stanley... And he smells good!!!

Thorin

Quote from: Tom on November 24, 2012, 11:35:45 PM
I had intended on doing the upgrade today, but I was working to catch up a bit with work, and got sucked into "Just a few more minutes, just gotta fix this bug" mode. Which is funny, I fixed the bug I was wanting to fix like 3-4 hours ago. After that, I found another thing I wanted to fix, and didn't think it'd take too long. Still not fixed, but I'm zeroing in on the problem. So woo.

I know that feeling, and it's a good feeling - fixing code and making it better is always fun.

Quote from: Tom on November 24, 2012, 11:35:45 PM
My plan now is to move the map over tomorrow.

So that's today, then?  You plan on moving it Sunday Nov 25th, right?
Prayin' for a 20!

gcc thorin.c -pedantic -o Thorin
compile successful

Tom

Quote from: Thorin on November 25, 2012, 11:57:14 AM
Quote from: Tom on November 24, 2012, 11:35:45 PM
I had intended on doing the upgrade today, but I was working to catch up a bit with work, and got sucked into "Just a few more minutes, just gotta fix this bug" mode. Which is funny, I fixed the bug I was wanting to fix like 3-4 hours ago. After that, I found another thing I wanted to fix, and didn't think it'd take too long. Still not fixed, but I'm zeroing in on the problem. So woo.

I know that feeling, and it's a good feeling - fixing code and making it better is always fun.

Quote from: Tom on November 24, 2012, 11:35:45 PM
My plan now is to move the map over tomorrow.

So that's today, then?  You plan on moving it Sunday Nov 25th, right?
It's not the next day till I wake up ;D So yes.
<Zapata Prime> I smell Stanley... And he smells good!!!

Tom

Hey Guys, working on the map. It's going to take mcedit a while to load up the map (its bloody massive :o). The server will be down till I get the upgrade done. Probably be a few hours.
<Zapata Prime> I smell Stanley... And he smells good!!!

Tom

Theres a village up in the top left by that weird circle/spire/tower thing, I'm thinking of deleting it. There doesn't look to be any real signs of player activity besides some torches in caves. Is it alright if I delete things like that? Map generated structures that don't show any real signs of player involvement? I think we'll want to regenerate some villages anyhow, I think theres some new stuff since 1.3.2.
<Zapata Prime> I smell Stanley... And he smells good!!!

LennyLen

Quote from: Tom on November 25, 2012, 08:33:49 PM
Theres a village up in the top left by that weird circle/spire/tower thing, I'm thinking of deleting it. There doesn't look to be any real signs of player activity besides some torches in caves. Is it alright if I delete things like that? Map generated structures that don't show any real signs of player involvement? I think we'll want to regenerate some villages anyhow, I think theres some new stuff since 1.3.2.

If you're referring to this one, please let it remain.  It took me ages to build that fence around it and light it up sufficiently to prevent mobs from entering/spawning.  I also increased it's size quite a bit to raise the number of Golems.

Tom

Quote from: LennyLen on November 25, 2012, 08:58:01 PM
Quote from: Tom on November 25, 2012, 08:33:49 PM
Theres a village up in the top left by that weird circle/spire/tower thing, I'm thinking of deleting it. There doesn't look to be any real signs of player activity besides some torches in caves. Is it alright if I delete things like that? Map generated structures that don't show any real signs of player involvement? I think we'll want to regenerate some villages anyhow, I think theres some new stuff since 1.3.2.

If you're referring to this one, please let it remain.  It took me ages to build that fence around it and light it up sufficiently to prevent mobs from entering/spawning.  I also increased it's size quite a bit to raise the number of Golems.
Nope, its another one. That one there has a fence, so clearly has some indication of player activity.

I'm referring to this one

By player activity, I mean anything that looks man made. If theres a portal, a fence, some non map gen buildings, or changes made to map genned stuff it'll stay.

This is fun though, mcedit isn't threaded at all. At least not where it matters. I have the map files in a ram disk, and its still taking an age to load areas of the map. crazy.
<Zapata Prime> I smell Stanley... And he smells good!!!

Tom

Quote from: Tom on November 25, 2012, 09:08:16 PM
This is fun though, mcedit isn't threaded at all. At least not where it matters. I have the map files in a ram disk, and its still taking an age to load areas of the map. crazy.
Yeah, I can't stand sitting there for hours waiting for sections of the map to load, so I'm just going to leave it open and load. It may take a few hours :( I hope not. I'd like to get the new map up tonight.
<Zapata Prime> I smell Stanley... And he smells good!!!

LennyLen

QuoteI'm referring to this one

Ah, that's just one I came across while exploring around Nordvang.

Thorin

How'd the map-loading thing go?  I'm guessing the more you cut out the less problems it'll have loading the map...
Prayin' for a 20!

gcc thorin.c -pedantic -o Thorin
compile successful

Tom

Quote from: Thorin on November 26, 2012, 09:13:40 AM
How'd the map-loading thing go?  I'm guessing the more you cut out the less problems it'll have loading the map...
mcedit seems to have been designed by monkeys. I don't know what kind of data type its using, but I assume they are doing some kind of retarded linear search of an array every time they load a chunk. Which means it takes longer and longer to load each chunk. I have my doubts as to if its loaded yet, 8-10 hours after It started.

Later today I'll just do things the hard/annoying way, and do it a section at a time like I started doing but found way too tedious. Sadly doing things the not tedious way is pretty much impossible without waiting a couple days for the map to bloody load.
<Zapata Prime> I smell Stanley... And he smells good!!!

Mr. Analog

Well, if you're going to try multi-GB into memory it's going to start paging no matter how good/bad the code is, I'll assume you hit some kind of limit where it's just too slow to do anything.

Can you trim the map by co-ords?

Maybe get rid of big chinks we KNOW are empty and load the smaller map.

I don't know how it works but I'd be surprised if you couldn't give it co-ordinates to delete.
By Grabthar's Hammer

Tom

Quote from: Mr. Analog on November 26, 2012, 09:30:52 AM
Well, if you're going to try multi-GB into memory it's going to start paging no matter how good/bad the code is, I'll assume you hit some kind of limit where it's just too slow to do anything.

Can you trim the map by co-ords?

Maybe get rid of big chinks we KNOW are empty and load the smaller map.

I don't know how it works but I'd be surprised if you couldn't give it co-ordinates to delete.
The way it works is you have this big map view, but only a section of it will even attempt to render out. It doesn't actually load the entire map into memory, it goes through all the chunks and loads representations of each chunk in small little tiles, so memory wise its actually rather efficient even for a large map. The problem is, the more chunks, the slower it is to scan new chunks.

I will have to just do as I was doing to begin with last night, is zoom in really close on a section, work on deleting bunches of that, then work on a new area. Once you move to a new section and it starts scanning all over again, it gets fast again. They are doing something incredibly retarded while scanning. I don't know what that is, but its probably just the wrong kind of data type when scanning chunks. It seems to scan chunks in the same way minecraft does in a sprial out from the player's position, so I have to assume as it does that it has a big array or linked list where it inserts the new chunks in the correct x,y position, and does a linear search to insert them.

But yeah, I should have the map setup tonight. Is all good. I did get the top of the map all set up. I deleted ALL of the chunks around the few sections that have builds up north. So there are a bunch of isolated islands up there. mc will properly reload the chunks around it, so it shouldn't be a problem. People will probably want to check out all of their areas once its back online though. I'm trying not to cut things too close, but I may have by accident.
<Zapata Prime> I smell Stanley... And he smells good!!!