[00:13] amette__ left #tikiwiki [00:13] amette__ joined #tikiwiki [01:23] amette__ left #tikiwiki [01:52] Tiki-KGB 03lindonb r62297 04trunk/templates/access/include_ticket.tpl [01:52] Tiki-KGB [KIL] Delete include_ticket.tpl file as it's function has been replaced by the smarty ticket function. Redo of r62266 now that all uses have apparently been deleted. [02:42] Tiki-KGB 03lindonb r62298 10trunk/tiki-setup_base.php * Remove assign of smarty variable no longer needed [07:18] fabricius joined #tikiwiki [12:34] Telesight joined #tikiwiki [13:05] jonnyb joined #tikiwiki [14:35] nelsonko joined #tikiwiki [14:35] nelsonko left #tikiwiki [14:53] jonnyb polom [14:53] jonnyb rescue script about half done, going to commit it as it is so far (into trunk) [15:02] Tiki-KGB 03jonnybradley r62299 03trunk/doc/devtools/rescue_wiki_changes_from_elastic.php [15:02] Tiki-KGB Part one of a script to rescue wiki page updates from an elastic search index - for data recovery for doc.tiki.org [15:02] Tiki-KGB Here we get all the activity stream wiki page events over a period of time (novemeber to april) - thanks to amette, luciash and others [15:02] Tiki-KGB TODO: The actual page updates next [16:01] jonnyb so amette_ - are you about? i have a script ready for testing (nearly)... [16:01] jonnyb oops, it just broke ;) [16:14] amette__ joined #tikiwiki [16:14] amette__ plm [16:15] amette__ hi jonnyb - let me check out the code and check out what you did [16:15] jonnyb hi amette__ [16:15] jonnyb it's sort of wokring but i haven't committed the actual page creation part yet [16:16] jonnyb just trying to get the version numbers working properly [16:16] amette__ ok, how does it work? Does it use the configured mysql and elastic? [16:19] jonnyb it uses the usual db defined in local, but gets the info from an elastic url you can specify (defaults to localhost:9200 though) [16:19] jonnyb do 'php doc/devtools/rescue_wiki_changes_from_elastic.php help rescue' for the help [16:20] amette__ alright, sounds cool. I'll check it out on the doc server then (as the database is there) and connect to the remote elastic as a cli parameter then. [16:22] jonnyb i thought i'd see if i could make a devtools script using the funky symfony console application stuf, so we get coloured output and progress pabrs etc - seems to work! :) [16:24] amette__ Getting a professional tool out of this - nice one! :) [16:25] jonnyb well, i thought it would make it more fun! :) [16:25] amette__ ;) [16:27] amette__ ok.... maybe I should actually do this on a completely different machine... and then later just dump, scp and replay the resulting database... *thinkingoutloud* [16:28] jonnyb yes, i think would be wise [16:28] * amette__ agrees [16:28] jonnyb i'm getting some indexing errors but i have es5 installed here (for extra pain) [16:30] amette__ right, had similar issues with feature regressions in elastic - decided to downgrade it then [16:38] jonnyb amette__: note that the version committed to trunk so far doesn't actually create or update any pages, so you should be fairly safe... :) [16:38] amette__ alright, cool! :) [16:39] jonnyb odd that some of the edits don't seem to have old version info indexed - but maybe that was added later (i think i might have added it for 16.x) - so for the missing ones i'll just guedd (version-1) [16:45] amette__ sounds reasonable... and good solution... or should one do (version-2) so it can be distinguished? or does that sound really dirty and consistency killing? [16:45] jonnyb yes, that's what i'm currently working out - i seem to get the current version duplicated... [16:57] jonnyb ok, here comes the dangerous bit! :D [17:00] Tiki-KGB 03jonnybradley r62300 10trunk/doc/devtools/rescue_wiki_changes_from_elastic.php [17:00] Tiki-KGB Part two of a script to rescue wiki page updates from an elastic search index - for data recovery for doc.tiki.org [17:00] Tiki-KGB Here we update (or create) the wiki pages - only lightly tested so far, not for use on "live" data yet :) [17:00] jonnyb there you go amette__ (feeling brave?) [17:00] amette__ hehe, sure... still setting up the test environment... hang on a bit [17:01] jonnyb if you get jip from the indexing turning off incremental indexing should help (and run quicker, actually) [17:02] jonnyb making t now... brb [17:02] amette__ alright, enjoy! [17:27] jonnyb i'm getting errors from aliasses being duplicated in structures, but don't seem to be able to do anything about it... [17:27] * amette__ is fighting with getting MySQL into shape [17:42] fabricius joined #tikiwiki [18:25] amette__ ok, I think I'm getting there... currently importing the DB dump from November and so far no errors. [18:28] jonnyb joined #tikiwiki [18:37] amette__ jonnyb : there's no --dry-run or such? Something that would tell me what will happen, but not do anything? That would be handy, cause replaying the database takes ages. [18:38] * amette__ should probably just revert to the previous svn revision [18:38] jonnyb hmmm [18:38] jonnyb ok, let me add a dry-run option, shoudln't take long [18:39] amette__ cool, thanks [18:39] jonnyb actually i'll add a confirm option and do dry run by default [18:39] amette__ superb! [18:58] jonnyb ok, there you go [18:59] amette__ w00t, nice one, bro! :) [19:00] Tiki-KGB 03jonnybradley r62301 10trunk/doc/devtools/rescue_wiki_changes_from_elastic.php [19:00] Tiki-KGB Part three of a script to rescue wiki page updates from an elastic search index [19:00] Tiki-KGB Add confirm option and use dry run mode by default, no changes to pages saved without the -c option (thanks scaredy-cat amette ;) [19:00] jonnyb ah, there it is amette__ [19:00] jonnyb i was guessding jusdt an edit or create summary is ok, youi don't want a full diff i hope ;) [19:01] amette__ yep, very nice output, well done! (if you wanna be ultra-diff-fancy, add it in with -v ;) ) [19:08] amette__ I have multiple times: [19:08] amette__ Page: “PhantomJS and CasperJS” (version 11) “Page created by rescue script 2017-04-22T17:07:34+00:00” [19:09] amette__ just with different version (12, 13, 14...) - shouldn't those be edits instead of creations then? [19:20] Tiki-KGB 03jonnybradley r62302 10trunk/doc/devtools/rescue_wiki_changes_from_elastic.php [19:20] Tiki-KGB Script to rescue wiki page updates from an elastic search index [19:20] Tiki-KGB Make the dry run output less noisy [19:21] jonnyb amette__: no, the pages don't get created in dry run mode [19:21] amette__ aah, so it doesn't realise that the second action is a modification intead of a creation!? [19:34] jonnyb if the page exists it updates it, if not it creates it (so i could test it on an empty database) [19:46] fabricius joined #tikiwiki [19:46] amette__ Great work, jonnyb! This starts looking really good! :) [20:01] jonnyb think i'm done for now, need food, mbbl or tomorrow... [20:14] fabricius Hey guys, I have seen a rising number of doc.tiki.org edits ... whats happening? A community wide documentation saving session? [20:15] fabricius “Page created by rescue script 2017-04-22T17:07:34+00:00” [20:15] fabricius This is more than awsome. [20:15] fabricius You are so cool guys. THX! [20:30] amette__ fabricius : that's a test run on nextdoc. Did you get notification e-mails from that? [20:47] Dekthro joined #tikiwiki [21:18] fabricius amette__: not sure .. what I postest was a citation from the IRC above ... I got this type of notivicatons: "wiki page “Wiki Plugin de” changed by luciash d' being wiki page noreply@tiki.org" [21:19] fabricius amette_ amete__ ^ [21:19] amette__ I was referring to: ‎"[20:14:39] ‎fabricius‎: Hey guys, I have seen a rising number of doc.tiki.org edits" [21:19] fabricius I did *NOT* get a notification like that: “Page created by rescue script 2017-04-22T17:07:34+00:00” [21:20] amette__ yes, that's from the script [21:20] amette__ but where did you get the rising number from? [21:20] fabricius This I did read at 19:12:56 - amette__: I have multiple times ... [21:20] amette__ aha [21:20] amette__ thanks for the confusion [21:20] fabricius sry, did not want to confuse you [21:21] fabricius :) [21:21] amette__ well, we got it cleared up [22:27] fabricius joined #tikiwiki [23:44] fabricius joined #tikiwiki