Issue 50: Crash in rclzip

rclexecm.py:75:answer:UnicodeEncodeError: ascii codec can’t encode character u'\xfc' in position 30: ordinal not in range(128)

Traceback (most recent call last): File "/usr/share/recoll/filters/rclzip", line 54, in <module > rclexecm.main(proto, extract) File "/usr/share/recoll/filters/rclexecm.py", line 144, in main proto.mainloop(extract) File "/usr/share/recoll/filters/rclexecm.py", line 137, in mainloop self.processmessage(processor, params) File "/usr/share/recoll/filters/rclexecm.py", line 117, in processmessage self.answer(data, ipath, eof) File "/usr/share/recoll/filters/rclexecm.py", line 75, in answer sys.stdout.write(ipath) UnicodeEncodeError: ascii codec can’t encode character u'\xfc' in position 30: ordinal not in range(128)

Local variables in innermost frame: ipath: u’versuch1/motor_kennlinie_mit R\xfcckw\xe4rtsfahren.txt' self: <rclexecm.RclExecM instance at 0x27180e0 > iseof: 0 iserror: 0 docdata: '0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n0,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n2,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n4,0,0\n6,0,0\n6,0,0\n6,1,0\n6,0,

I’ve deleted the following 100 or so lines of docdata because I don’t know whats encoded there

yum -C info recoll Name : recoll Arch : x86_64 Version : 1.14.4 Release : 2.fc15

Hello,

I could reproduce this with files having non-ascii utf8 paths, for which there is special handling in zipfile.

I think I have a fix. If you want to try it, it’s in: http://www.lesbonscomptes.com/recoll/filters/rclzip-utf8paths

Download the file, then rename it as /usr/share/recoll/filters/rclzip (backup the old one first), and make it executable: chmod +x /usr/share/recoll/filters/rclzip

I’d be interested by the test results :)

Cheers, jf

So I have deleted my .xapiandb, than I’ve only indexed the folder with the zipfile which contains ipath: u’versuch1/motor_kennlinie_mit R\xfcckw\xe4rtsfahren.txt And it has crashed, than i have replaced /usr/share/recoll/filters/rclzip with the new one, deleted my .xapiandb again and it works without crashing. Bug fixed! Thanks!

Fixed by commit 2217