Search Minetest mods!

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Search Minetest mods!

by Krock » Thu Sep 18, 2014 17:09

Mod Search engine

Why?
It's a pain to search mods on this forum, therefore I set up this page. All (half-way) valid formatted mod topics are indexed about each week. On top of that, you have the choice to apply filters to get more precise answers.

Syntax
The listed mods will contain each word separated by a space in the title. You can also concatenate multiple search queries by using the OR "|" sign. Please be aware that each keyword has to be at least three characters long. Simple examples for this can be found directly on the page.

Reputation
With a simple feedback system (Like / Dislike) based on stupid simple JavaScript code you're able to give mods a reputation. Those with a good reputation will be listed rather on top of the list, whereas a low reputation will move the entry further down (unmaintained mod and/or broken).

Implementations
MinetestBot plugin on Freenode IRC
DuckDuckGo: !bang <query>

Link: http://krock-works.uk.to/minetest/modSearch.php

Also check out the new Minetest Content Database, which is available here.

Suggestions and bug reports are appreciated.
Last edited by Krock on Tue Oct 02, 2018 17:57, edited 7 times in total.
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

Sokomine
Member
 
Posts: 3866
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Thu Sep 18, 2014 17:16

That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?
A list of my mods can be found here.
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Sep 18, 2014 17:29

Sokomine wrote:That's a very good thing! It ought to be linked somewhere. Else this mod will get lost like all the other ones.

Do you execute a live search or do you parse the forum pages from time to time?

Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.
I will run it sometimes a week for the 1st and 2nd page of Mod Releases and Modding General - maybe once a month for a complete update.

It will not have a DDoS effect because it only reads from the forum pages and not from every single topic.
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

User avatar
Minetestforfun
Member
 
Posts: 936
Joined: Tue Aug 05, 2014 14:09
Location: On earth
GitHub: Darcidride
IRC: Darcidride + MinetestForFun
In-game: Darcidride + MinetestForFun
 

Sokomine
Member
 
Posts: 3866
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Thu Sep 18, 2014 18:04

Krock wrote:Good question. I wrote a bot to do this job, using an open source html parser library and some MySQL queries to add and/or update the mods.

That's good. I've tried to sort mods into categories on the Wiki, but doing so manually was so much work (tedious cut&paste) that I gave up. With a script that parses the forum automaticly, introducing categories becomes far more doable.
A list of my mods can be found here.
 

User avatar
webdesigner97
Member
 
Posts: 1325
Joined: Mon Jul 30, 2012 19:16
Location: Bergisch Gladbach, Germany
GitHub: webD97
IRC: webdesigner97
In-game: webdesigner97
 

User avatar
rubenwardy
Moderator
 
Posts: 5826
Joined: Tue Jun 12, 2012 18:11
Location: United Kingdom
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy

Re: Search Minetest mods!

by rubenwardy » Sat Sep 20, 2014 15:39

I used to use php a lot, and now I have resolved to never use it again.
 

User avatar
Evergreen
Member
 
Posts: 2135
Joined: Sun Jan 06, 2013 01:22
Location: A forest in the midwest
GitHub: 4Evergreen4
IRC: EvergreenTree
In-game: Evergreen

Re: Search Minetest mods!

by Evergreen » Sat Sep 20, 2014 20:26

rubenwardy wrote:I used to use php a lot, and now I have resolved to never use it again.

Why not?
Back from the dead!
 

User avatar
rubenwardy
Moderator
 
Posts: 5826
Joined: Tue Jun 12, 2012 18:11
Location: United Kingdom
GitHub: rubenwardy
IRC: rubenwardy
In-game: rubenwardy

Re: Search Minetest mods!

by rubenwardy » Sat Sep 20, 2014 22:03

It is a terrible language with lots of inconsistencies. Badly designed. There a lot of better frameworks that are faster to develop for and the result is less messy. Django (python) and Rails (ruby) being examples.
 

User avatar
philipbenr
Member
 
Posts: 1688
Joined: Fri Jun 14, 2013 01:56
Location: United States
GitHub: philipbenr
IRC: philipbenr
In-game: robinspi
 

User avatar
srifqi
Member
 
Posts: 556
Joined: Sat Jun 28, 2014 04:31
Location: Indonesia
GitHub: srifqi
IRC: srifqi
In-game: srifqi

Re: Search Minetest mods!

by srifqi » Sun Sep 21, 2014 04:41

+1
I'm from Indonesia! Saya dari Indonesia!
Terjemahkan Minetest!
Mods by me. Modifikasi oleh saya.

Pronounce my nick as in: es-rifqi (IPA: /es rifˈki/)
 

User avatar
balthazariv
Member
 
Posts: 214
Joined: Mon Apr 07, 2014 15:48
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Oct 02, 2014 19:38

Update!

Multiple search terms can now be specified using the OR notation `|` to get more results.
Last edited by Krock on Tue Jul 10, 2018 08:17, edited 1 time in total.
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

User avatar
ExeterDad
Member
 
Posts: 1717
Joined: Sun Jun 01, 2014 20:00
Location: New Hampshire U.S.A
In-game: ExeterDad

Re: Search Minetest mods!

by ExeterDad » Fri Oct 03, 2014 02:57

I think a list of indexed mods would be a useful addition to your page. Nice work BTW
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Search Minetest mods!

by Krock » Sun Oct 05, 2014 08:33

Update!
- Bugfixes
- New keyword marker

Image
Any suggestions?
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

User avatar
Casimir
Member
 
Posts: 1163
Joined: Fri Aug 03, 2012 16:59
GitHub: CasimirKaPazi

Re: Search Minetest mods!

by Casimir » Sun Oct 05, 2014 11:19

I don't even try to use the forum search anymore. It should be on minetest.net

One bug: When you select Author and then go to the next page, it switches back to Title.
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Sun Oct 05, 2014 16:34

Casimir wrote:One bug: When you select Author and then go to the next page, it switches back to Title.

Thanks for reporting. A small typo caused this fail - Fixed.
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

Sokomine
Member
 
Posts: 3866
Joined: Sun Sep 09, 2012 17:31
GitHub: Sokomine

Re: Search Minetest mods!

by Sokomine » Mon Oct 06, 2014 02:36

It would be great to add a link to this in the forum at a prominent place so that players do get a chance to find mods.
A list of my mods can be found here.
 

Sol
Member
 
Posts: 73
Joined: Thu Jul 31, 2014 05:21
In-game: sol

Re: Search Minetest mods!

by Sol » Mon Oct 06, 2014 04:46

Suggestion: don't make tiny annotations like this, it's very hard to read.
http://i.imgur.com/AMTBgP9.png
There is no such thing as duty. If you know that a thing is right, you want to do it. If you don't want to do it—it isn't right. If it's right and you don't want to do it—you don't know what right is and you're not a man. -- Ayn Rand
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Thu Jan 15, 2015 18:26

Update!
- Added games to the page
- Added a filter for games

Image
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

User avatar
lightonflux
Member
 
Posts: 384
Joined: Mon Nov 11, 2013 07:22
Location: Germany
In-game: lof

Re: Search Minetest mods!

by lightonflux » Thu Jan 15, 2015 20:44

Can you add a "Minetest" to the <title> of the page? It makes it easier to find the bookmark in your browser. "Mod search" is not as great as "Minetest Mod Search" if you do a search for Minetest in your bookmarks. :)
 

dgm5555
Member
 
Posts: 245
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Sat Feb 14, 2015 13:49

I just suggested a button for the Python gitsync tool could very easily be added to the lua forming the front page of minetest https://forum.minetest.net/viewtopic.php?f=14&t=8749 and wrote a scraper to extract all the git links from the forum and now find this.
Would it be posible to merge this with gitsync and add user voted tags for sorting. You'd have a far better 'modstore' then...
If not could you also use your search to produce a list of links to save from multiple scrapers working...

PS Also could one of the admin create a pinned post on the forum you could just keep updated with your list?

PPS could you also do the same for worlds/maps?
 

User avatar
Krock
Developer
 
Posts: 4365
Joined: Thu Oct 03, 2013 07:48
Location: Switzerland
GitHub: SmallJoker

Re: Search Minetest mods!

by Krock » Sat Feb 14, 2015 18:51

Well, I only index forum topics. I don't extract download links from every post.
I don't see how this could be merged with gitsync since the search engine uses PHP, MySQL and a handcrafted update script which has remote access to the MySQL database. Adding tags is a good idea but I must be aware of intentional spammers.
dgm5555 wrote:[..] list of links to save from multiple scrapers [..]

Could you please explain what you mean with this?

I could extend my program/script to fetch the data of a list if there are enough informations.
Yes, I could do the same for worlds and maps but there it's a bit complicated to ignore talk-only topics.
>> Mod Search Engine << - Mods by Krock - DuckDuckGo mod search bang: !mtmod <keyword here>
 

User avatar
maikerumine
Member
 
Posts: 1350
Joined: Mon Aug 04, 2014 14:27
GitHub: maikerumine
In-game: maikerumine

Re: Search Minetest mods!

by maikerumine » Sat Feb 14, 2015 20:36

This is a great addition! thank you for making this!! Now we need to get all the modders to have a similar name convention and post in this forum!
 

dgm5555
Member
 
Posts: 245
Joined: Tue Apr 08, 2014 19:45

Re: Search Minetest mods!

by dgm5555 » Sat Feb 14, 2015 21:26

dgm5555 wrote:[..] list of links to save from multiple scrapers [..]

I meant I have just run a python bot/scraper over the forum and extracted html links which point to git addresses ('list of links'). However if you're also doing (albeit for a slightly different purpose) the same it doubles the server load (thus the reference to 'multiple scrapers'). Combining this function into your tool would be much friendlier on the forum (and yours sounds better than mine as I searched every post in the forum).
Here's what my list looks like: https://forum.minetest.net/viewtopic.php?p=170199#p170199
 

Next

Return to Minetest-related projects



Who is online

Users browsing this forum: No registered users and 1 guest