Issue 51: Can’t turn doc into internal representation for Missing helper program: python:midi

For every file (including those which are not midi files) I have tried to preview, I have gotten the error message : Can’t turn doc into internal representation for Missing helper program: python:midi

Hello,

I need more data about what’s happening. Please follow the instructions on the following page to obtain a log file. I would also like to know the exact recoll version which is having the problem, and what system you are running it on.

https://bitbucket.org/medoc/recoll/wiki/GettingAStackTrace

jf

I am running Recoll 1.15.7 on Wreathe OS 1r3(alpha) (my customised breed of Linux; this version is based on Ubuntu 10.10). Ok, well, I tried to repro the issue with the debug version but it just died without the error. I have attached the core dump from the crash (segmentation fault).

Hi, Sorry, I can’t do anything with a bare core file (I’d need at the very least the debug executable that produced it): * Please follow the instructions in the above entry to obtain a log file and a stack trace * Please tell me if a recollindex command goes trough (to isolate an indexing problem from a GUI one).

Sorry! I’m new to this sort of thing…I will do my best to do that, but it might take a little while :-)

Ok this time I got a different error Could not turn doc into internal representation text/python (or something like that ; I accidentally overwrote my clipboard before pasting it here… :-(

I have attached the log and stack trace.

By goes trough, do you mean is it successful? That seems to make sense given the accompanying parenthetical.

Yes, I meant successful by "goes through". But actually, I think that the problem has nothing to do with the indexing.

I can’t make much sense of the stack dump, and close to my wit’s end here, this is going to be difficult to solve if I can’t reproduce it.

The "Could not turn doc into internal representation" message means that the thread which does the doc conversion for previewing failed. The message about the missing helper is clearly bogus, this probably comes from a bad assumption about how the load can fail.

Obviously none of the recoll version that I know of present a systematic preview failure like this one. This really looks like a build issue. Are you using an Ubuntu package or a local build ?

I was using the default Ubuntu package but then when you requested the debug information I built it and installed it (uninstalling the other first). The bug seems to appear only during indexing. I have had it with both builds, and IIRC I have had it with previous versions of Recoll too. I experienced it again to-day (with recollindex running and Recoll’s gui open, but not indexing), when I did a search then clicked preview for a plain text file. This time there was no missing helper message. I will attach a screenshot. Also, after that happened I left Recoll sitting for a while and when I got back there was huge CPU & memory usage (both normal process usage and huge IOWait also), so much that the locked screen’s password entry form timed out several times while it was loading because it took very long. :-P I have recollindex running for long time now and I have log level 6 — I will send the log once it finishes, if it compresses very nicely (more than 400megs already) ; also I have been sending errors to a separate file to send when ready.

I stopped it. I hope I let it go long enough for you to get some useful information from it. I will attach the logs.

I stopped it. I hope I let it go long enough for you to get some useful information from it. I will attach the logs.

Ok, I now have two new and interesting pieces of information: the problem is not systematic (does not occur everytime you click preview), and it only or mostly occurs while indexing is running (either in-process or as an external recollindex).

I am going to try to reproduce it. Can’t seem to do it on the mac though, so I’m going to install an Ubuntu instance in a vmware client (away from home with no access to my usual ubuntu install). I’m still lacking one piece of info though, what Xapian version are you using ?

Cheers, jf

I have libxapian-dev 1.0.20-2, libxapian15 1.0.20-2, libxapian22 1.2.4-1, and python-xapian 1.0.20-1. I hope this helps. Good luck! :-)

Hello, I see that there are two versions of libxapian installed, could you please run "ldd /usr/bin/recoll" so that I know which one is in use by recoll ? Thanks, jf

Fix problems that occurred when multiple threads were trying to read/convert files at the same time (ie: indexing and previewing threads in the GUI calling internfile()). Either get rid of or lock-protect all shared data, eliminate misc initialization possible conflicts by using static initializers. Hopefuly closes issue #51

→ <<cset 388dc14f2dea > >