Search Minetest mods!

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Search Minetest mods!

by Krock » Post

Mod Search engine

Why?
It's a pain to search mods on this forum, therefore I set up this page. All (half-way) valid formatted mod topics are indexed about each week. On top of that, you have the choice to apply filters to get more precise answers.

Syntax
The listed mods will contain each word separated by a space in the title. You can also concatenate multiple search queries by using the OR "|" sign. Please be aware that each keyword has to be at least three characters long. Simple examples for this can be found directly on the page.

Reputation
With a simple feedback system (Like / Dislike) based on stupid simple JavaScript code you're able to give mods a reputation. Those with a good reputation will be listed rather on top of the list, whereas a low reputation will move the entry further down (unmaintained mod and/or broken).

Implementations
MinetestBot plugin on Freenode IRC
DuckDuckGo: !bang <query>

Link: http://krock-works.uk.to/minetest/modSearch.php

Also check out the new Minetest Content Database, which is available here.

Suggestions and bug reports are appreciated.
Last edited by Krock on Tue Oct 02, 2018 17:57, edited 7 times in total.
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

Sokomine
Member
Posts: 4138
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Post

That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?
A list of my mods can be found here.

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Re: Search Minetest mods!

by Krock » Post

Sokomine wrote:That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?
Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.
I will run it sometimes a week for the 1st and 2nd page of Mod Releases and Modding General - maybe once a month for a complete update.

It will not have a DDoS effect because it only reads from the forum pages and not from every single topic.
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

User avatar
Minetestforfun
Member
Posts: 940
Joined: Tue Aug 05, 2014 14:09
GitHub: MinetestForFun
IRC: MinetestForFun
In-game: MinetestForFun
Location: On earth
Contact:

Re: Search Minetest mods!

by Minetestforfun » Post

Good work ! :)

Sokomine
Member
Posts: 4138
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Post

Krock wrote: Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.
That's good. I've tried to sort mods into categories on the Wiki, but doing so manually was so much work (tedious cut&paste) that I gave up. With a script that parses the forum automaticly, introducing categories becomes far more doable.
A list of my mods can be found here.

User avatar
webdesigner97
Member
Posts: 1327
Joined: Mon Jul 30, 2012 19:16
GitHub: webD97
IRC: webdesigner97
In-game: webdesigner97
Location: Cologne, Germany
Contact:

Re: Search Minetest mods!

by webdesigner97 » Post

+1 for PHP-friends!

User avatar
rubenwardy
Moderator
Posts: 6281
Joined: Tue Jun 12, 2012 18:11
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy
Location: United Kingdom
Contact:

Re: Search Minetest mods!

by rubenwardy » Post

I used to use php a lot, and now I have resolved to never use it again.

User avatar
Evergreen
Member
Posts: 2135
Joined: Sun Jan 06, 2013 01:22
GitHub: 4Evergreen4
IRC: EvergreenTree
In-game: Evergreen
Location: A forest in the midwest
Contact:

Re: Search Minetest mods!

by Evergreen » Post

rubenwardy wrote:I used to use php a lot, and now I have resolved to never use it again.
Why not?
Back from the dead!

User avatar
rubenwardy
Moderator
Posts: 6281
Joined: Tue Jun 12, 2012 18:11
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy
Location: United Kingdom
Contact:

Re: Search Minetest mods!

by rubenwardy » Post

It is a terrible language with lots of inconsistencies. Badly designed. There a lot of better frameworks that are faster to develop for and the result is less messy. Django (python) and Rails (ruby) being examples.

User avatar
philipbenr
Member
Posts: 1690
Joined: Fri Jun 14, 2013 01:56
GitHub: philipbenr
IRC: philipbenr
In-game: robinspi
Location: United States

Re: Search Minetest mods!

by philipbenr » Post

Yes for python. Very good language.

User avatar
srifqi
Member
Posts: 557
Joined: Sat Jun 28, 2014 04:31
GitHub: srifqi
IRC: srifqi
In-game: srifqi
Location: Indonesia

Re: Search Minetest mods!

by srifqi » Post

+1
Saya dari Indonesia! · Terjemahkan Minetest! · my mods · My nickname in IPA: /es.rif.qi/

User avatar
balthazariv
Member
Posts: 214
Joined: Mon Apr 07, 2014 15:48
Contact:

Re: Search Minetest mods!

by balthazariv » Post

Very good, i like it.

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Re: Search Minetest mods!

by Krock » Post

Update!

Multiple search terms can now be specified using the OR notation `|` to get more results.
Last edited by Krock on Tue Jul 10, 2018 08:17, edited 1 time in total.
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

User avatar
ExeterDad
Member
Posts: 1717
Joined: Sun Jun 01, 2014 20:00
In-game: ExeterDad
Location: New Hampshire U.S.A

Re: Search Minetest mods!

by ExeterDad » Post

I think a list of indexed mods would be a useful addition to your page. Nice work BTW

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Search Minetest mods!

by Krock » Post

Update!
- Bugfixes
- New keyword marker

Image
Any suggestions?
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

User avatar
Casimir
Member
Posts: 1174
Joined: Fri Aug 03, 2012 16:59
GitHub: CasimirKaPazi

Re: Search Minetest mods!

by Casimir » Post

I don't even try to use the forum search anymore. It should be on minetest.net

One bug: When you select Author and then go to the next page, it switches back to Title.

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Re: Search Minetest mods!

by Krock » Post

Casimir wrote:One bug: When you select Author and then go to the next page, it switches back to Title.
Thanks for reporting. A small typo caused this fail - Fixed.
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

Sokomine
Member
Posts: 4138
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Post

It would be great to add a link to this in the forum at a prominent place so that players do get a chance to find mods.
A list of my mods can be found here.

Sol
Member
Posts: 73
Joined: Thu Jul 31, 2014 05:21
In-game: sol

Re: Search Minetest mods!

by Sol » Post

Suggestion: don't make tiny annotations like this, it's very hard to read.
http://i.imgur.com/AMTBgP9.png
There is no such thing as duty. If you know that a thing is right, you want to do it. If you don't want to do it—it isn't right. If it's right and you don't want to do it—you don't know what right is and you're not a man. -- Ayn Rand

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Re: Search Minetest mods!

by Krock » Post

Update!
- Added games to the page
- Added a filter for games

Image
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

User avatar
lightonflux
Member
Posts: 384
Joined: Mon Nov 11, 2013 07:22
In-game: lof
Location: Germany

Re: Search Minetest mods!

by lightonflux » Post

Can you add a "Minetest" to the <title> of the page? It makes it easier to find the bookmark in your browser. "Mod search" is not as great as "Minetest Mod Search" if you do a search for Minetest in your bookmarks. :)

User avatar
dgm5555
Member
Posts: 245
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Post

I just suggested a button for the Python gitsync tool could very easily be added to the lua forming the front page of minetest viewtopic.php?f=14&t=8749 and wrote a scraper to extract all the git links from the forum and now find this.
Would it be posible to merge this with gitsync and add user voted tags for sorting. You'd have a far better 'modstore' then...
If not could you also use your search to produce a list of links to save from multiple scrapers working...

PS Also could one of the admin create a pinned post on the forum you could just keep updated with your list?

PPS could you also do the same for worlds/maps?

User avatar
Krock
Developer
Posts: 4564
Joined: Thu Oct 03, 2013 07:48
GitHub: SmallJoker
Location: Switzerland
Contact:

Re: Search Minetest mods!

by Krock » Post

Well, I only index forum topics. I don't extract download links from every post.
I don't see how this could be merged with gitsync since the search engine uses PHP, MySQL and a handcrafted update script which has remote access to the MySQL database. Adding tags is a good idea but I must be aware of intentional spammers.
dgm5555 wrote:[..] list of links to save from multiple scrapers [..]
Could you please explain what you mean with this?

I could extend my program/script to fetch the data of a list if there are enough informations.
Yes, I could do the same for worlds and maps but there it's a bit complicated to ignore talk-only topics.
Look, I programmed a bug for you. >> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>

User avatar
maikerumine
Member
Posts: 1387
Joined: Mon Aug 04, 2014 14:27
GitHub: maikerumine
In-game: maikerumine

Re: Search Minetest mods!

by maikerumine » Post

This is a great addition! thank you for making this!! Now we need to get all the modders to have a similar name convention and post in this forum!
Extreme Survival Minetest-->viewtopic.php?f=10&t=12959

User avatar
dgm5555
Member
Posts: 245
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Post

dgm5555 wrote:[..] list of links to save from multiple scrapers [..]
I meant I have just run a python bot/scraper over the forum and extracted html links which point to git addresses ('list of links'). However if you're also doing (albeit for a slightly different purpose) the same it doubles the server load (thus the reference to 'multiple scrapers'). Combining this function into your tool would be much friendlier on the forum (and yours sounds better than mine as I searched every post in the forum).
Here's what my list looks like: viewtopic.php?p=170199#p170199

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests