[00:24] fabricius joined #tikiwiki [00:28] amette_ left #tikiwiki [00:28] amette_ joined #tikiwiki [00:44] amette_ left #tikiwiki [00:45] wikifan https://demo.tiki.org/17x/ is down ? getting ERR_TOO_MANY_REDIRECTS [03:30] wikifan https://doc.tiki.org/Documentation -> System error. The following error message was returned: Got error 28 from storage engine [05:21] wikifan k that's up now but the search on that page still doesn't work, just returns a blank page [07:43] not_a_robot joined #tikiwiki [09:39] amette_ joined #tikiwiki [09:52] fp joined #tikiwiki [09:53] amette_ polom [09:54] fp hi, i am running a tiki 15.5 installation. the one issue i do have is that i am not happy with the search results. even if my searchstring matches around 60% of a complete tiki article this article is somewhere random in my search-results [09:54] fp all search results have the same relevance of 1 [09:54] fp is that supposed to be like that? [09:55] fp even if i enter the complete article name to my search the article in question is not number 1 in the search result list [09:55] amette_ Hi fp, I assume you use MySQL full-text-search? The results of that are sadly quite arcane... they get better by using either the Lucene PHP implementation or (much better) by using an additional/external elasticsearch server. Both these things are configurable from Admin->Control Panels->Search. [09:56] fp hi amette_ . yes i am pretty sure we currently do use the mysql search [09:57] fp thanks for the pointers [09:59] amette_ np, yw [10:06] fp mh, interesting. the paket elasticsearch is installed on that server and in 'Control Panel' -> 'Search' the unified search index is set to Elasticsearch as well [10:06] fp *package elasticsearch* [10:07] amette_ That sounds pretty good then. Time to get into tuning... ;) [10:08] amette_ Usually though the search results with elasticsearch out-of-the-box are amazingly good. [10:08] fp but i dont see a cronjob to rebuild a search index [10:08] amette_ I'm not sure, if putting 60% of the article into the search field is a good test... but usually, with two/three keywords, it gives me pretty much exactly what I want. [10:09] amette_ yes, that one would be beneficial *nod* ;) [10:09] fp is there a way to check the age of a search index (elasticsearch) [10:09] amette_ And you can set additionally to update the index incrementally.ä [10:09] amette_ it should be mentioned on the Admin Search page [10:10] fp most likely in the advanced settings/view right? [10:11] fp Your index was last fully rebuilt on Friday, 08. July 2016 08:40:53 UTC. ;) [10:11] amette_ Aha! ;) [10:13] fp how often would you recommend to optimize and/or rebuild the index? [10:14] RadoS joined #tikiwiki [10:14] amette_ I usually have it to incrementally update and then do an additional rebuild it via cron nightly (when there are no/little users on the site). [10:15] amette_ If you have ginormous amounts of data, you could even do it just once per week or so. [10:15] fp hopefully my last question then: i do know how to rebuild it, but how to incrementally update it? [10:15] amette_ Optimization, etc. depends a lot on your data, how often it is updated, etc. [10:17] amette_ Admin -> Search: Activate "Advanced" features, then check "Incremental Index Update" [10:34] fp ok. created a daily crontab to rebuild on a daily basis. icremental index update is/was already activated [10:35] amette_ Cool. Then happy searching! :) [10:35] fp to be honest- the results dont look that much better so far ;) [10:35] amette_ lol :D [10:36] amette_ sorry, but hmmm... didn't expect that. [10:36] fp maybe i am assuming wrong that if my searchstring is part of an article it should have a higher relevancy [10:36] fp article-title [10:37] amette_ maybe you need to tweak the weights in Admin Search (never really used those myself, but they are for making these knids of adjustments) [10:37] fp lets see what i can find [10:39] xavi joined #tikiwiki [10:39] xavi polom [10:39] amette_ moloq xavi [10:39] xavi doc.t.o yields error 500 [10:39] amette_ oops, ok, I'm on it [10:39] xavi hi amette [10:39] xavi thks :-) [10:42] xavi and dev.t.o shows db connection lost [10:42] xavi :-/ [10:42] amette_ That was just temporary, when restarting MySQL for doc. [10:43] xavi ok, dev.t.o is up now, doc.t.o shows error 500 still [10:44] amette_ doc.t.o will take a while [10:47] amette_ can the table tiki_rss_feeds be truncated? It's over 2GB in size. [10:49] amette_ ok, no, optimize did just fine, table is now 10MB [10:50] xavi no idea, sorry. I reckon, if that is the source of the problem (is it really?), a better solution for all tikis out there should be found [10:50] xavi ah, ok. I wonder how a table of 10Mb can get 2Gb in size [10:50] amette_ It's not the table data itself, it's the binary log (logging changes). [10:50] xavi amette : fyi, see also this: https://irc.tiki.org/irclogger_log/tikiwiki?date=2017-10-18,Wed&sel=6#l2 [10:51] xavi amette_: ^ [10:51] amette_ yep, same thing, error 28 is no space left [10:52] fp ok - more questions regarding the search: Assuming title & textarea is set as heigh weight-wise for search - should an article which features my search-string several times have a higher relevancy then an article which features the text only once? [10:53] fp using elasticsearch which rebuilded index [10:54] luciash polom [10:56] arildb joined #tikiwiki [10:57] Bsfez joined #tikiwiki [10:57] fp sidenote: my 15.5 install points for more details on elasticsearch to https://doc.tiki.org/ElasticSearch - which throws a 404 [10:58] amette_ xavi, luciash, fp : doc is back [10:59] luciash amette_: thanks! so do we need to buy more disk space? [10:59] Bsfez Thanks Amette ! [10:59] amette_ What happened? tiki_rss_feeds binary logs filled up the disk, then the automatic svn up broke a PHP file, which made php throw a 500. [10:59] amette_ luciash : no [11:00] xavi thanks amette_ [11:00] xavi how can we make things (server-side) less fragile? [11:00] luciash can we have cron warning sent to your mail when disk space becomes critically low? [11:00] amette_ I need to change the setup of the machine. Let me explain it one last time: I had to set it up quickly, because elastichosts was down. I did the normal Debian install, which partitions the disk fully and added a swap area to the end of it. So that's why I can't just resize the disk, but will have to do a more complicated operation. [11:00] amette_ luciash : yes, there is monitoring for this. I was sleeping though. [11:01] luciash ah, cool [11:03] luciash amette_: now https://security.tiki.org please [11:04] fp regarding search: legacy mysql full text search must be enabled for having a search function at all right? even if elasticsearch is configured as unified search engine [11:04] luciash amette_: error 500 [11:04] amette_ luciash : ok, hang on [11:06] amette_ luciash : back [11:13] xavi fp: nope, I'm afraid. Only advanced search, and choose your unified search engine. You need to disable Basic Search [11:13] xavi at some point, this Basic Search feature should dissapear, to prevent usability issues by new users [11:13] xavi imho [11:16] xavi fp: see this: https://doc.tiki.org/Admin-Wizard#Set_up_Search . Basic search should be off, and Advanced Search on, which the unified search index engine of your choice. Mysql Full text Search, as unified search index, should be fine also. [11:16] Bsfez +1 [11:17] Bsfez default was changed and a message should say it is legacy [11:21] xavi doc.t.o needs updating, then, imho [11:21] xavi I'm doing my opart with what I know from a year ago or so [11:23] chibaguy joined #tikiwiki [11:26] chibaguy polom [11:26] amette_ moloq chibaguy [11:27] chibaguy hi amette_ [11:36] fp xavi thanks for the infos. [11:37] xavi fp np. [11:37] xavi hi chibaguy [11:38] chibaguy hi xavi [11:40] fp its getting more and more interessting. if i search via: tiki-searchresults.php the results are pretty "bad" - while searching via tiki-searchindex.php gives really good results. [11:40] fp we always used the search-widget - which seems to use tiki-searchresults.php [11:41] fp therefor the searchresults was disappointing in almost all cases [11:41] amette_ fp : that's what xavi meant earlier: searchresults uses the old, old mysql-search, while searchindex uses the newer "unified search index" with one of its three different backend options (Mysql, Lucene, Elasticsearch). [11:42] fp can i force the search widget to use the new search - aka -tiki-searchindex.php? [11:42] amette_ Just use the correct module. [11:43] xavi fp: disable the basic search, and it will use the new engine [11:43] xavi the same module, afaik [11:43] amette_ ah, k, my mistake then [11:43] xavi s/afaik/afair [11:43] amette_ (thought there were two, but true, didn't see two of them the last time I configured a Tiki search) [11:43] fp xavi: havent found that setting yet, as your linked screenshot looks totally different then my ui here ;) [11:43] fp still digging [11:44] xavi fp: use the Wizards [11:44] xavi https://doc.tiki.org/Wizards [11:49] jonnyb joined #tikiwiki [11:50] fp xavi: i did find and used the wizard to jump to "set up Search". i did disable 'basic search' and 'advanced search' already was enabled. I did finish that step via "Save and continue. Butthe search widget still is using tiki-searchresults.php [11:51] fp ignore that [11:52] fp reloading the wizard had basic search enabled once again. -redid my steps and it seems to work now [11:54] fp guys - big thanks to all of you - the search is now as i would expect a good search. this bumps my wiki [11:56] amette_ Cool! Glad to hear that. :) [11:59] fp until now search in our tiki setup was always the ugly-child nobody was loving ;) [12:00] amette_ Yeah, I've heard that often. *g* [12:00] fp one final sidenote regarding search: why are you splitting searchstrings on the - character? [12:00] amette_ This changes massively though once people start using the elasticsearch based one. ;) [12:01] amette_ hmm, no idea. What do you mean by splitting them? [12:01] fp i do have articles for each host in our network so i.e.: vm-wsus [12:01] fp if i search for vm-wsus the search is highlightning VM and WSUS as individual search strings in my results [12:02] fp so i do enter 1 searchstring "vm-wsus" but search seems to search for "vm" "wsus" [12:02] fp which works still pretty good with the new search, but i was/and/am wondering why you implemented it that way [12:02] amette_ Aaah, good question, no idea. Maybe it's even not us doing it, but elasticsearch. Maybe there's an option for this!? [12:03] fp as it is uncommon at least for me [12:03] amette_ if you put vm-wsus in quotes, like so "vm-wsus", when searching, does it still split it up? [12:03] fp even if i really quote "vm-wsus" it is used as 2 strings [12:03] amette_ hehe, k [12:03] fp yes ...same idea ;) [12:03] amette_ :) [12:08] amette_ xavi, luciash : I added a cron job to optimize tiki_rss_feeds table every night. It shouldn't hurt performance, but stop the disk from running full. [12:12] xavi thanks amette_ [12:13] xavi chibaguy: btw, I visited themes.t.o today (after many months of no visit ) and I see a popup in the browser saying: "A problem occurred while detecting JavaScript on this page, click ok to retry." (in both FF and Chromium [12:13] xavi ) [12:14] chibaguy Yes, xavi, I noticed that, too. I'll try to track it down. [12:15] xavi ok. Clikcing ok in FF did the trick after page reloadē [12:15] xavi ah, in Chromium too. [12:15] xavi who knows [12:41] amette_ left #tikiwiki [12:41] amette_ joined #tikiwiki [12:47] Bsfez joined #tikiwiki [13:01] fp bye [13:26] jonnyb polom [13:39] chibaguy Hi jonnyb [13:40] jonnyb hi chibaguy - bs4 branch looks good, i see you are starting to modify some tpls, woo! :) [13:41] chibaguy Thanks. Yes, a few as I come across things that are an easy fix. [13:42] Bsfez joined #tikiwiki [13:45] chibaguy Forms aren't looking too bad, but break pretty much when Chosen is activated. I commented out the Chosen CSS temporarily because it created many compile problems. [13:48] chibaguy Same for tablesorter and I think pivottable. They can be addressed later. [13:54] luciash amette_: awesome, cheers [13:54] jonnyb sounds like progress - i think it would be a good idea to keep a note (and diff's) of files you are changing outside of themes, as by the time tiki 19 comes we will get terrible conflicts otherwise i fear... [13:54] jonnyb moqmoq luciash amette_ xavi and all :) [13:55] luciash hello jonny [13:55] luciash still good with the hurricane? [13:56] luciash (except the yellow sky) [13:57] chibaguy ok [13:59] jonnyb wind seems to have stopped, bit gloomy and dark but not yellow today, thanks luciash :) [14:03] Bsfez joined #tikiwiki [14:09] luciash jonnyb: cool, I hope ppl in the Irelands are safe as well [14:35] Jyhem_laptop joined #tikiwiki [15:03] luciash jonnyb: did you have a look at the H5P in cached wiki pages issue by any chance? [15:03] luciash https://dev.tiki.org/item6403 [15:04] jonnyb no sorry, critical client issues only so far this week, maybe next week? [15:32] Bsfez joined #tikiwiki [15:40] amette_ left #tikiwiki [15:40] amette_ joined #tikiwiki [16:27] xavi left #tikiwiki [16:36] amette_ left #tikiwiki [16:44] amette_ joined #tikiwiki [17:28] trebmuh joined #tikiwiki [18:33] amette_ left #tikiwiki [18:33] amette_ joined #tikiwiki [18:55] Bsfez joined #tikiwiki [19:00] Telesight joined #tikiwiki [19:15] jonnyb joined #tikiwiki [19:40] Jyhem_laptop joined #tikiwiki [19:55] Jyhem_laptop_ joined #tikiwiki [20:13] Jyhem_laptop joined #tikiwiki [20:27] Jyhem_laptop_ joined #tikiwiki [20:42] Jyhem_laptop joined #tikiwiki [21:01] Jyhem_laptop_ joined #tikiwiki [21:14] Jyhem_laptop joined #tikiwiki [21:29] Jyhem_laptop_ joined #tikiwiki [21:47] Jyhem_laptop joined #tikiwiki [22:05] Jyhem_laptop_ joined #tikiwiki [22:19] Jyhem_laptop joined #tikiwiki [22:37] Jyhem_laptop_ joined #tikiwiki [22:51] Jyhem_laptop joined #tikiwiki [23:09] Jyhem_laptop_ joined #tikiwiki [23:27] Jyhem_laptop joined #tikiwiki [23:41] Jyhem_laptop_ joined #tikiwiki [23:56] Jyhem_laptop joined #tikiwiki