amette__: joined #tikiwiki Tiki-KGB: 03sokoloski r62621 10trim/ 10scripts/clone.php 10Makefile * [FIX] Seems these changes were lost/reverted?
03rjsmelo r62622 10branches/ 10(60 files in 52 dirs) * [MRG] Automatic merge, trunk 62582 to 62620
03rjsmelo r62623 10branches/ 10(9 files in 3 dirs)
[ENH] Use Symfony Process and Processbuilder for commands, multiple improves in formating and documentation nelsonko: joined #tikiwiki
left #tikiwiki
joined #tikiwiki Tiki-KGB: 03jyhem r62624 10branches/17.x/lib/filegals/filegallib.php
[FIX] Also display visible subgalleries in galleries listings when user does not have global list_file_galleries permission. Plus a minor garbled indent
03jyhem r62625 10branches/16.x/lib/filegals/filegallib.php
[FIX][bp/r62624] Also display visible subgalleries in galleries listings when user does not have global list_file_galleries permission. Plus a minor garbled indent
03jyhem r62626 10branches/15.x/lib/filegals/filegallib.php
[FIX][bp/r62624] Also display visible subgalleries in galleries listings when user does not have global list_file_galleries permission. Plus a minor garbled indent
03jyhem r62627 10branches/12.x/lib/filegals/filegallib.php
[FIX][bp/r62624] Also display visible subgalleries in galleries listings when user does not have global list_file_galleries permission. Bsfez: joined #tikiwiki Tiki-KGB: 03yonixxx r62628 10branches/17.x/lang/fr/language.php * [TRA] String translated Tiki|bot: Recent Bug: - http://dev.tiki.org/item6336 redflo: joined #tikiwiki fabricius: joined #tikiwiki
joined #tikiwiki jonnyb: joined #tikiwiki RadoS: joined #tikiwiki RobertIT: joined #tikiwiki
hello
i have a problem with setting searching in tiki wiki. My company are adding pdf files to tiki wiki, and i want to add search option wia my pdf files... i found poppler-utils and installed it... it works but manually... and now what i need to do to use poppler-utils inside tiki wiki?
i have found file gallery and searching indexing and added there in MIME: application/pdf in System Command: pdftotext %1
but it is not working
anybody can help with setting up pdftotext in tiki?
anyone online? chibaguy: joined #tikiwiki
polom jonnyb: polom Bsfez: polom Jyhem: RobertIT: have you reindexed all documents after installing and configuring pdftotext in tiki? Bsfez: ... it took me 2 hours to set it right ! (if(equals (more-than 604800 (sub (add (date) 0) (add dateDeCrAtion 0))) 1) (str new) (str notnew)) jonnyb: RobertIT: that is possible, you need to change the command it runs to the one you have installed Jyhem: polom everybody jonnyb: pompom Jyhem anbd Bsfez and all :) Bsfez: (waving hand) -: Jyhem feels being able to categorise blog posts has been a disastrous idea Jyhem: blog posts should follow the blo's permissions :-( jonnyb: it's optional isn't it Jyhem? ;) RobertIT: yes i reindexed after set Jyhem: it is? jonnyb: RobertIT: what happens if you do this in a terminal? pdftotext /path/to/an/existing/file.pdf RobertIT: but still not working
lemme check
it creating the txt file
from pdf jonnyb: ok, sounds promising RobertIT: with the same name like pdf file jonnyb: i have a feeling pdftotext needs another param to make it return the text to the stdout, not create a file... it might be in the doc page, hang on RobertIT: ok Jyhem: no, definitely not optional :-(
bbl jonnyb: amette and amette__: i see what you mean by the index on doc being borked :(
ok RobertIT - on https://doc.tiki.org/Search+within+files it says use "pstotext %1 or pdftotext %1 -" so i tihnk you need a - char at the end? amette__: jonnyb : ok.. any ideas what that could be? it's a bit scary.. RobertIT: well... i try it :)
im adding pdf, btw searching will works for old pdf or for just the new ones added after changes?
0 pages :/
not woeking
is any logs for tiki? maybe it wont see path? where i can find it?
maybe this will help find solution... my pdf files are added to database
not to the folders
and when from icoon menu i click on icon named "rebuild search index" then i have 2 simillar errors "•Tracker Field Factory Error: Pref "trackerfield_starsystem" required for field type "Tracker_Field_Rating""
but if this not a problem for search via attached pdfs then i ignore it for now
btw i have Version 12.11 LTS ^_^
and ubuntu on server
12.04.4 LTS jonnyb: sry, phone RobertIT: np jonnyb: RobertIT: maybe try anabling trackerfield_starsystem - it might be preventing indexing - try logging it and see if your files get indexed?
amette__: it just says "no such index" so i can't see what the problem was - sorry, need to go for a while now, bbl amette__: right, cya RobertIT: "anabling trackerfield_starsystem" - means? amette__: it enables the tracker field of the type starsystem. RobertIT: im main features? amette__: main features!? hmm, no idea. jonnyb: in the admin/trackers control panel
byeee :) RobertIT: i had enable
but plugin insert tracker item is disable
and tracker attachment preferences is set to database
maybe this one... in trackers settings the checkbox named" currency field" is unchecked
nope... its not this one :/ QMS: joined #tikiwiki QMS_: joined #tikiwiki
i'm getting a persistent error; indexing failed on processing; had added a new field to a tracker that's when it started. i deleted the filed, but it still persists. RobertIT: QMS_: maybe u know how to add search from pdf in tiki? QMS_: adding; could not perform indexing modification; too many columns
i don't know how to search from pdf in tiki QMS: joined #tikiwiki
accidently logged off; had asked a question about a persistent error; indexing failed while processing with error could not perform index modification; too many columns
had added a new field to a tracker and that's when the error started; deleted the field but the error persists
cleared caches' and rebooted the server; nothing helped
i can save new/edited records, but get web message this page is not working; error 500
last line in the error message; search index could not be updated
also; in the footer it says no tracker indicated jonnyb: joined #tikiwiki nelsonko: joined #tikiwiki RobertIT: maybe i need to assign some module? jonnyb: repolom QMS: i've encountered this problem before, and found the permanent filed name was either a duplicate or too long; not the case here Bsfez: joined #tikiwiki RobertIT: hi jonnyb :)
still nothing with searching :( jonnyb: Hi RobertIT RobertIT: i tried reboot server... but wont help aswell
maybe i need add some module?
i have php 5.3 maybe this is the problem? QMS: i don't know how/where the pdf search feature is
i have tried to rebuild the search index, but it won't complete RobertIT: this is sad when wanna look at some example and uncle google wont help ^_^ jonnyb: sorry, busy - php 5.3 should be fine, did you manage to get the pdftotext command to output the text to the shell output, rather than a file? QMS: i tried to run the rebuild index and just get the error and redirect; this page is not working error code 500; had to close the browser altogether
jonnyb; that's a little above my knowledge/ability (shell output) RobertIT: what do u mean shell output? the monitor?
i just get a file via pdftotext jonnyb: when you do the command in the terminal (sometimes called CLI or shell) you need the command that makes it read out all the text, not just create a file QMS: everything was fine before i added the additional field; i deleted the field but the problem persists RobertIT: u mean the cat or less command? QMS: the problem is pervasive now through all trackers when editing/adding records jonnyb: RobertIT: no, the pdftotext command
QMS: clear caches?
QMS: although i don't know what your issue is i'm afraid, was replying to RobertIT QMS: yes, cleared caches RobertIT: i have text inside the file equals to pdf file if u asking about it jonnyb: the text needs to be returned by the command, tiki can't see it if it's in a file RobertIT: but how? jonnyb: you need the manual for the comand - i can't seem to find it
somewhere in the options should be one that make it output to STDOUT (standard output) - that's what you need
it used to be a hyphen after the file name RobertIT: ok jonnyb: forinstance, here https://linux.die.net/man/1/pdftotext it says "If text-file is '-', the text is sent to stdout." RobertIT: so i have it.... meh jonnyb: so in the mime thingy on filegallery admin... use pdftotext %1 - RobertIT: i have it....
i changed 2 hrs ago when u show me that ive eat "-" QMS: in saving records i get the error message; search index could not be updated jonnyb: Hi QMS - so can you recap your setup pls? Tom_____: joined #tikiwiki RobertIT: root@ubuntu:~# pdftotext /home/tiki/Downloads/test.pdf -
shows me into shell text from pdf Tom_____: Hi, I was wondering if you can create a whitelist of IP addresses that internal employees can be on in order to see the content of our Tiki Wiki jonnyb: busy here today ;)
Hi Tom_____ there is a feature that assigns users to groups automatically... hold on
hmm, that only works on people's email addresses, not IP QMS: recap; i added a field to a tracker that only has about 6 fields, after i added that field i began to see the error, could not index, i deleted the field but the error persists, and now when creating/editing records in any tracker i get the error
jonnyb; indexing failed while processing, too many columns, search index could not be updated jonnyb: QMS: that's odd - you only have 6 fields and got too many columns? Tom_____: Ah, so no way to with IP addresses? How would I go about doing it with email addresses? QMS: jonnyb; i've had this error before and found the field permanent name was either duplicate or too long, not the case this time jonnyb: QMS: so the index rebuild fails, even after you deleted the new field?
Tom_____: it's on the group edit page, somewhere near the bottom, sry, can't find it no
w
amette__: we need to get the search index working on doc, i haven't got time to do it manually! :) amette__: jonnyb : I agree, but I don't know what to do. QMS: jonnyb; yes, rebuild fails, when it does it throws me out to a php error page amette__: the current index exists on es01.tiki.org jonnyb: is there an error message when you rebuild? amette__: nope jonnyb: anything in the rebuild log? QMS: jonnyb; i can't even get that far now; it just loops and i can't get to the log amette__: nope jonnyb: amette__: so nothing is getting indexed? amette__: no, I mean: nothing special in there... lots of "addDocument wiki page", etc. and then it ends with "Finished rebuild" jonnyb: QMS: try going to the database and deleting the index_**** tables maybe?
amette__: and if you do: curl http://thetiki.es.server:9200/_alias/?pretty do you see docto_new_main_591b0bfbefd78 in there? amette__: yes jonnyb: (curl from the doc server, i mean) amette__: yes jonnyb: ew... amette__: yes
so... do I need to whip out the debugger again? jonnyb: amette__: did that one maybe get upgraded to ES 5.x somehow?
because i don't think 16.x works on that yet (ever) amette__: version 2.4.4 jonnyb: sorry, just rememebred i can check that :) amette__: np :) jonnyb: amette__: "Cluster Status: yellow" doesn't souind great, does it? amette__: that's because it's only one node, nothing critical, that's why it's not red QMS: jonnyb; delete the tables or just the content? jonnyb: QMS: hmmm, always scared of suggesting deleting things, back them (everything) up first then delete the tables themselves, then try a rebuild? QMS: jonnyb; i'll give that a try. my IT guy is very experienced with tiki. jonnyb: QMS: do you really only have 6 fields in total?
cos that "too many columns" error usually happens only when tehre are loads of them RobertIT: wait... maybe tiki dont have enough permissions to get respond with text??? :D
what number to set chmod and on which file to get respond from db to wiki?
and where i have find the log file from tiki wiki after when i attach the pdf file? maybe there i find solution :) Tiki-KGB: 03jonnybradley r62629 10branches/17.x/lib/jquery_tiki/tiki-jquery.js
[FIX] ajax: Improve the mysterious "0 error" AJAX errors by supplying as much other information as can be gathered (no much, but the URL should help) jonnyb: RobertIT: are you using the filesystem for filegal storage? as i don't think this works if the data is in the database
amette__: when you do a rebuild on doc does the "docto_new_main_591b0bfbefd78" pref change? Maybe clear that out then rebuild? amette__: alright, I'll test jonnyb: amette__: just guessing... :P amette__: need to start somewhere ;) jonnyb: yup, it changed QMS: jonnyb; i was wrong, 15 fields, but i have nearly 100 trackers, and thousands of fields in total jonnyb: and it says "Your index was last fully rebuilt on Wednesday 17 May, 2017 15:23:25 BST."
ok, that's the issue then QMS, sounds like you need to move to using elastic search for that big a tiki, i think Tom_____: Thanks jonnyb, I haven't added Tiki Wiki to my organization's hosting platform as now, just looking to do research. Can it be restricted so that every user that lands on the domain be prompted to login before accessing the wiki? RobertIT: filegal storage jonnyb: (which as you can see is not without it's quirks ;) )
RobertIT: do you mean file system storage? amette__: hang on... that Tiki hasn't been upgraded in quite a while... I'll svn up before we do anything else. jonnyb: Tom_____: yes you can be very precise which groups of users can see which pages, or which categories of pages RobertIT: i have activate the feature and store sets at store in database QMS: jonnyb; i've researched elastic search but didn't understand the context, will look into it thank you jonnyb: RobertIT: i think you need to have actual files for pdftotext to index (it should tell you that really) RobertIT: ok ill check it tomorrow, for now im finishing the work for today, but i have installed it yesterday so i guess its actual.
byeee amette__: ok, doc.t.o svn upped, index rebuilt, all looking good, still same error on search jonnyb: amette__: what happens if you try to rebuild in the browser? (apart from a timeout probably)... amette__: let's see jonnyb: although the web server (process) must be able to contact ES to get the version info etc...
was just wondering if it might be a perm or firewall issue amette__: nope, can't be, they are communicating all the time jonnyb: going to make tea, that usually helps ;) amette__: enjoy :) jonnyb: indeed
brb
bwt amette__: wb :)
index rebuilding here... got distracted in between
Internal Server Error *scratchinghead* -: amette__ tests with another browser amette__: ah, no, it's just the max_execution_time that got hit. jonnyb: sort of expected i guess amette__: yep, lemme test the override settings, never did so far jonnyb: and as you say doc.t.o webserver talks to ES quite happily otherwise amette__: yep, that's for sure jonnyb: but it sort of would rule that out
also i can't think of anything else just yet ;) amette__: ok, rebuilding with 300s exec time
yeah, I'm a bit baffled by this issue Tiki-KGB: 03jonnybradley r62630 10branches/17.x/lib/wiki-plugins/wikiplugin_convene.php
[FIX] convene: Deploy AJAX semaphore service to avoid editing conflicts in the convene plugin. It only happens during the save operation so doesn't lock the page when you start editing but new functions and some refactoring would be required for that. But better than spinning busy indicators and a broken page i think...
03jonnybradley r62631 10(6 files in 6 dirs) * [MRG] Automatic merge, branches/17.x 62616 to 62630
03jonnybradley r62632 10branches/17.x/lib/ckeditor_tiki/tiki-ckeditor.js
[FIX] ajax: Alter the "page being edited" error message for the wysiwyg plugin to be the same as the convene one (also needs refactoring) amette__: ok, rebuild worked, but error persists jonnyb: amette__: ok, i'll look into the code and see where we need to debug - can you get your remote debugging thing working again? amette__: jonnyb : ok, I'll have to put some finishing touches to the servers anyway, so I put this on that list jonnyb: actually there may be a coupld of curl things we could try first
might be easier
ok, this is my local version of the requests that probably fails and generates the "no such index" error: http://localhost:9200/tiki17_main_58e8d4ae1da89/_stats?pretty
obviously replace localhost with the ES server, and my index name with the current doc one
hmmm, although may be not... Tiki-KGB: 03yonixxx r62633 10branches/16.x/lang/fr/language.php * Typo. (thanks Chealer) jonnyb: amette__: i meant to switch back to here, re the federated search thing amette__: right
not sure about dev's index - checking jonnyb: i did a fix a while back because i had the same problem in my local which took ages to work out... i'll see if i can backport the fix to 16... amette__: dev_to_
instead of tikidevlive
_ jonnyb: http://sourceforge.net/p/tikiwiki/code/62132
ok, that's probably it but let's test that fix - stand by...
ok amette__ , here it comes... r62634 in 16.x Tiki-KGB: 03jonnybradley r62634 10branches/ 1016.x/lib/core/Search/Elastic/Index.php 1016.x
[bp/r62132][FIX] search: Warn but carry on if a federated index is missing (plus add a phpdoc) jonnyb: svn up there and we should see the culprit in the rror message amette__: ok, done
and rebuilding jonnyb: coolio, now i get "Federated index themes_live_main not found" amette__: alright jonnyb: do you happen to know what it should be? amette__: themes_to_main jonnyb: i'll change the dev one to dev_to_main amette__: and actually doc.t.o's index is named wrongly
should be doc_to_main
cool jonnyb: ok, dev and themes done
yay woo, we have search back on doc! :) amette__: w00t! Good job, jonny! :)
And my doorbell rang, friend arriving - perfect timing! ;) jonnyb: sorry it took so long to remember :P
coolio, have fun!
cya amette__: thanks, same, cya! Tiki-KGB: 03chealer r62635 10branches/17.x/lang/fr/language.php * [FIX] "Active Directory" is a proper noun luciash: jonnyb: amette: well done, thanks guys! Telesight: joined #tikiwiki Tiki-KGB: 03chealer r62636 10trunk/vendor_extra/pear/ 10(10 files in 2 dirs)
Replace our customized Net_LDAP2 2.0.10 with a vanilla 2.2.0
This breaks LDAP. Next commit will fix.
03chealer r62637 10trunk/vendor_extra/pear/ 10(8 files in 2 dirs)
Fix our Net_LDAP2 integration following r62636 by re-applying part of the delta we had to the upstream version (includes removal)
This also fixes the version number in LDAP2.php (see ticket #21211). fabricius: joined #tikiwiki Tiki-KGB: 03yonixxx r62638 10branches/17.x/lang/fr/language.php * Typo nelsonko: joined #tikiwiki jonnyb: joined #tikiwiki
joined #tikiwiki Bsfez: joined #tikiwiki
joined #tikiwiki Tiki-KGB: 03chealer r62639 10branches/17.x/tiki-login.php
[FIX] "Invalid username or password" when ldap extension is missing
Make default error vaguer Telesight: joined #tikiwiki Tiki-KGB: 03chealer r62640 10trunk/ 10(86 files in 6 dirs)
popup Smarty function: Fix handling of arguments such as "text" and remove plethora of workarounds Bsfez: joined #tikiwiki