MTSatellite: A "realtime" web mapping system for Minetest

[Minetestforfun]

@s-l-teichmann

If it interrest you (colors.txt generator mod/python script) : https://github.com/xxx/minetest-minetes ... ppercolors
made by Gravgun.

This solution check every nodes and auto generate its color (no unknow nodes with this script)

[s-l-teichmann]

@Minetestforfun Thanks for the hint and thumbs up to Gravgun for writing the scripts.
Great starting point! :-)

I had a look at the mod+post processing tool at the weekend.
The post processor produces too much transparent entries (eg. grass). It also produces a transparent column next to the alpha channel in colors.txt which is not parsed by MTSatellite.
After some experimentation I ended in modifying the mod slightly to write out the draw types
of the nodes out too. This helps to determine if a node should lead to transparent entry or not.
Furthermore I wrote my own post processing tool which is about 6-10 times faster [1]
than the original Python script.

[1] https://bitbucket.org/s_l_teichmann/mtautocolors

[gravgun]

@s-l-teichmann You just heavily butchered my nickname on your project description...

[s-l-teichmann]

@gravgun Oh sorry, that was only an unintended typo. I've just corrected it.

[lightonflux]

What do i need to do to limit everything to -4500 - 4500 as this is the worldedge limit of our server. This includes mtseeder.

[Minetestforfun]

Hi,

Any news about MTSatellite ?

Im mainly looking for performance improvments about the mapper :)
(actually 50% of our servers CPU are used for mapper and 20% for the minetest-server processes, we manage 4 servers...)

[s-l-teichmann]

@Minetestforfun

Im mainly looking for performance improvments about the mapper :)

Yes. There is an experimental branch [1] which SHA1 checksums
regenerated base tiles and does not write them to disk if they don't change.
This safes a lot of disk I/O and CPU too, because the pyramid tiles depending
on these unchanged base tiles don't get updated/scaled down either.
It also results in lesser notification on the websockets.

The code works but it needs a little clean up. I'll merge it back into master
soon. It would be nice to know if it improves your situation.

[1] https://bitbucket.org/s_l_teichmann/mts ... -overwrite

[Minetestforfun]

Happy to see your answer, I will wait the code cleanup before use it, to be safe for all of our servers :)

[s-l-teichmann]

I've merged the feature back. The tests on my local instance look pretty good.

We will upgrade our production server to the new version of MTSatellite in a couple of days (when doing the 0.4.14 update of the MT server).

BTW: MTSatellite have learned to set the background color [1]. This may be interessing for your Skyblock server?!

[1] https://bitbucket.org/s_l_teichmann/mts ... se-default

[Minetestforfun]

Cool for the production tests, i will still wait a couple of days before updating MTSatellite on all of our servers :) Thank you for the return !

For the background color, it's a good new feature, but I'm hesitating if i change the Skyblock background color or not. Indeed the background is "white" as the "clouds" and the islands are above clouds so... I need some tests with different colors ;)

[s-l-teichmann]

We use MTSatellite 0.8 for half a month with a MT 0.4.14 server without any problems.

Currently we have an Go 1.7 beta compiled version installed which gives a performance
boost over the 1.6.2 compiled version up to 15% on our AMD64 system.

As the new Go compiler chain is still experimental use it with care. I've updated the
compile instructions [1].

[1] https://bitbucket.org/s_l_teichmann/mts ... COMPILE.md

[texmex]

When trying to run mtredisalize I get

Code: Select all

2017/02/18 04:59:01 IO error: /home/minetest/.minetest/worlds/world/map.sqlite/LOCK: Not a directory

no matter what world I try with. But I'm noobish.

[s-l-teichmann]

@temex

Looks like you have configure a LevelDB as backend but you path points to a SQLite database.

If you want mtredisalize to use a SQLite backend you have to use '-driver=sqlite' as an option.

[texmex]

If you want mtredisalize to use a SQLite backend you have to use '-driver=sqlite' as an option.

Oh okay, I'll try that! Thank you. Is it not recommended, since it's not in the instructions?

[s-l-teichmann]

@texmex You can use it.

It is not 'recommended' in the way as we don't use SQLite as our productive backend. So
the SQLite code path is not tested in production as good as the the LevelDB path.

But for small/medium sized worlds with not too many users/viewers it is fast enough because
there are some optimizations inside mtsatellite to ensure this. If I do some feature development
I often use the SQLite backend first because of its straight out of the box setup. So I am pretty
sure that all works as expected. ;-)

[texmex]

Thank you for explaining. My servers are small and private, so SQLite should suffice.