MTSatellite: A "realtime" web mapping system for Minetest
-
- Member
- Posts: 940
- Joined: Tue Aug 05, 2014 14:09
- GitHub: MinetestForFun
- IRC: MinetestForFun
- In-game: MinetestForFun
- Location: On earth
- Contact:
Re: MTSatellite: A "realtime" web mapping system for Minetes
@s-l-teichmann
If it interrest you (colors.txt generator mod/python script) : https://github.com/xxx/minetest-minetes ... ppercolors
made by Gravgun.
This solution check every nodes and auto generate its color (no unknow nodes with this script)
If it interrest you (colors.txt generator mod/python script) : https://github.com/xxx/minetest-minetes ... ppercolors
made by Gravgun.
This solution check every nodes and auto generate its color (no unknow nodes with this script)
Last edited by Minetestforfun on Sat Apr 13, 2024 18:50, edited 1 time in total.
MinetestForFun Team mods : [spidermob] [fishing]
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
@Minetestforfun Thanks for the hint and thumbs up to Gravgun for writing the scripts.
Great starting point! :-)
I had a look at the mod+post processing tool at the weekend.
The post processor produces too much transparent entries (eg. grass). It also produces a transparent column next to the alpha channel in colors.txt which is not parsed by MTSatellite.
After some experimentation I ended in modifying the mod slightly to write out the draw types
of the nodes out too. This helps to determine if a node should lead to transparent entry or not.
Furthermore I wrote my own post processing tool which is about 6-10 times faster [1]
than the original Python script.
[1] https://bitbucket.org/s_l_teichmann/mtautocolors
Great starting point! :-)
I had a look at the mod+post processing tool at the weekend.
The post processor produces too much transparent entries (eg. grass). It also produces a transparent column next to the alpha channel in colors.txt which is not parsed by MTSatellite.
After some experimentation I ended in modifying the mod slightly to write out the draw types
of the nodes out too. This helps to determine if a node should lead to transparent entry or not.
Furthermore I wrote my own post processing tool which is about 6-10 times faster [1]
than the original Python script.
[1] https://bitbucket.org/s_l_teichmann/mtautocolors
Re: MTSatellite: A "realtime" web mapping system for Minetes
@s-l-teichmann You just heavily butchered my nickname on your project description...
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
@gravgun Oh sorry, that was only an unintended typo. I've just corrected it.
- lightonflux
- Member
- Posts: 384
- Joined: Mon Nov 11, 2013 07:22
- In-game: lof
- Location: Germany
Re: MTSatellite: A "realtime" web mapping system for Minetes
What do i need to do to limit everything to -4500 - 4500 as this is the worldedge limit of our server. This includes mtseeder.
-
- Member
- Posts: 940
- Joined: Tue Aug 05, 2014 14:09
- GitHub: MinetestForFun
- IRC: MinetestForFun
- In-game: MinetestForFun
- Location: On earth
- Contact:
Re: MTSatellite: A "realtime" web mapping system for Minetes
Hi,
Any news about MTSatellite ?
Im mainly looking for performance improvments about the mapper :)
(actually 50% of our servers CPU are used for mapper and 20% for the minetest-server processes, we manage 4 servers...)
Any news about MTSatellite ?
Im mainly looking for performance improvments about the mapper :)
(actually 50% of our servers CPU are used for mapper and 20% for the minetest-server processes, we manage 4 servers...)
MinetestForFun Team mods : [spidermob] [fishing]
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
@Minetestforfun
regenerated base tiles and does not write them to disk if they don't change.
This safes a lot of disk I/O and CPU too, because the pyramid tiles depending
on these unchanged base tiles don't get updated/scaled down either.
It also results in lesser notification on the websockets.
The code works but it needs a little clean up. I'll merge it back into master
soon. It would be nice to know if it improves your situation.
[1] https://bitbucket.org/s_l_teichmann/mts ... -overwrite
Yes. There is an experimental branch [1] which SHA1 checksumsIm mainly looking for performance improvments about the mapper :)
regenerated base tiles and does not write them to disk if they don't change.
This safes a lot of disk I/O and CPU too, because the pyramid tiles depending
on these unchanged base tiles don't get updated/scaled down either.
It also results in lesser notification on the websockets.
The code works but it needs a little clean up. I'll merge it back into master
soon. It would be nice to know if it improves your situation.
[1] https://bitbucket.org/s_l_teichmann/mts ... -overwrite
-
- Member
- Posts: 940
- Joined: Tue Aug 05, 2014 14:09
- GitHub: MinetestForFun
- IRC: MinetestForFun
- In-game: MinetestForFun
- Location: On earth
- Contact:
Re: MTSatellite: A "realtime" web mapping system for Minetes
Happy to see your answer, I will wait the code cleanup before use it, to be safe for all of our servers :)
MinetestForFun Team mods : [spidermob] [fishing]
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
I've merged the feature back. The tests on my local instance look pretty good.
We will upgrade our production server to the new version of MTSatellite in a couple of days (when doing the 0.4.14 update of the MT server).
BTW: MTSatellite have learned to set the background color [1]. This may be interessing for your Skyblock server?!
[1] https://bitbucket.org/s_l_teichmann/mts ... se-default
We will upgrade our production server to the new version of MTSatellite in a couple of days (when doing the 0.4.14 update of the MT server).
BTW: MTSatellite have learned to set the background color [1]. This may be interessing for your Skyblock server?!
[1] https://bitbucket.org/s_l_teichmann/mts ... se-default
-
- Member
- Posts: 940
- Joined: Tue Aug 05, 2014 14:09
- GitHub: MinetestForFun
- IRC: MinetestForFun
- In-game: MinetestForFun
- Location: On earth
- Contact:
Re: MTSatellite: A "realtime" web mapping system for Minetes
Cool for the production tests, i will still wait a couple of days before updating MTSatellite on all of our servers :) Thank you for the return !
For the background color, it's a good new feature, but I'm hesitating if i change the Skyblock background color or not. Indeed the background is "white" as the "clouds" and the islands are above clouds so... I need some tests with different colors ;)
For the background color, it's a good new feature, but I'm hesitating if i change the Skyblock background color or not. Indeed the background is "white" as the "clouds" and the islands are above clouds so... I need some tests with different colors ;)
MinetestForFun Team mods : [spidermob] [fishing]
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
---
Our Minetest servers :
MinetestForFun (Survival - PvP - Hardcore)[FR/EN]
MinetestForFun HUNGER GAMES
MinetestForFun SKYBLOCK
MinetestForFun CREATIVE
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
We use MTSatellite 0.8 for half a month with a MT 0.4.14 server without any problems.
Currently we have an Go 1.7 beta compiled version installed which gives a performance
boost over the 1.6.2 compiled version up to 15% on our AMD64 system.
As the new Go compiler chain is still experimental use it with care. I've updated the
compile instructions [1].
[1] https://bitbucket.org/s_l_teichmann/mts ... COMPILE.md
Currently we have an Go 1.7 beta compiled version installed which gives a performance
boost over the 1.6.2 compiled version up to 15% on our AMD64 system.
As the new Go compiler chain is still experimental use it with care. I've updated the
compile instructions [1].
[1] https://bitbucket.org/s_l_teichmann/mts ... COMPILE.md
- texmex
- Member
- Posts: 1753
- Joined: Mon Jul 11, 2016 21:08
- GitHub: tacotexmex
- In-game: tacotexmex
Re: MTSatellite: A "realtime" web mapping system for Minetes
When trying to run mtredisalize I get
no matter what world I try with. But I'm noobish.
Code: Select all
2017/02/18 04:59:01 IO error: /home/minetest/.minetest/worlds/world/map.sqlite/LOCK: Not a directory
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
@temex
Looks like you have configure a LevelDB as backend but you path points to a SQLite database.
If you want mtredisalize to use a SQLite backend you have to use '-driver=sqlite' as an option.
Looks like you have configure a LevelDB as backend but you path points to a SQLite database.
If you want mtredisalize to use a SQLite backend you have to use '-driver=sqlite' as an option.
- texmex
- Member
- Posts: 1753
- Joined: Mon Jul 11, 2016 21:08
- GitHub: tacotexmex
- In-game: tacotexmex
Re: MTSatellite: A "realtime" web mapping system for Minetes
Oh okay, I'll try that! Thank you. Is it not recommended, since it's not in the instructions?s-l-teichmann wrote:If you want mtredisalize to use a SQLite backend you have to use '-driver=sqlite' as an option.
-
- Member
- Posts: 28
- Joined: Sun Aug 03, 2014 14:50
- GitHub: s-l-teichmann
- In-game: KimJongKlaus
Re: MTSatellite: A "realtime" web mapping system for Minetes
@texmex You can use it.
It is not 'recommended' in the way as we don't use SQLite as our productive backend. So
the SQLite code path is not tested in production as good as the the LevelDB path.
But for small/medium sized worlds with not too many users/viewers it is fast enough because
there are some optimizations inside mtsatellite to ensure this. If I do some feature development
I often use the SQLite backend first because of its straight out of the box setup. So I am pretty
sure that all works as expected. ;-)
It is not 'recommended' in the way as we don't use SQLite as our productive backend. So
the SQLite code path is not tested in production as good as the the LevelDB path.
But for small/medium sized worlds with not too many users/viewers it is fast enough because
there are some optimizations inside mtsatellite to ensure this. If I do some feature development
I often use the SQLite backend first because of its straight out of the box setup. So I am pretty
sure that all works as expected. ;-)
- texmex
- Member
- Posts: 1753
- Joined: Mon Jul 11, 2016 21:08
- GitHub: tacotexmex
- In-game: tacotexmex
Re: MTSatellite: A "realtime" web mapping system for Minetes
Thank you for explaining. My servers are small and private, so SQLite should suffice.
Who is online
Users browsing this forum: No registered users and 7 guests