Unknown reporter writes
Indexing of emails (Thunderbird local database of IMAP) fails for some reason which is apparently related to xapian. I have created a log file (level 4) and include below the last 20 lines of it, perhaps it will help identify the issue. Although the problem doesn’t seem to be related to recoll directly, it would be nice if you could provide at least an advice on how to solve it. For the moment I just excluded the email directory, but not being able to index emails at all is not so nice :-(
TAIL OF LOG FILE BELOW
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/msgFilterRules.dat|] parent []
:4:../rcldb/rcldb.cpp:1092:Db::add: docid 3695 added [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/msgFilterRules.dat|]
:4:../rcldb/rcldb.cpp:1151:Db::needUpdate:yes (new): [Q/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf|]
:4:../internfile/internfile.cpp:206:FileInterner::FileInterner: [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf] mime [(null)] preview 0
:4:../index/mimetype.cpp:119:mimetype: fn [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf] in stopsuffixes
:4:../internfile/internfile.cpp:249:internfile: (no mime) [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf]
:3:../internfile/internfile.cpp:260:FileInterner:: ignored: [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf] mime []
:4:../internfile/internfile.cpp:744:FileInterner::internfile. ipath []
:4:../internfile/internfile.cpp:747:FileInterner::internfile: no handler: constructor failed
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf|] parent []
:4:../rcldb/rcldb.cpp:1092:Db::add: docid 3696 added [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX.msf|]
:4:../rcldb/rcldb.cpp:1151:Db::needUpdate:yes (new): [Q/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX|]
:4:../internfile/internfile.cpp:206:FileInterner::FileInterner: [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX] mime [(null)] preview 0
:4:../internfile/mh_mail.cpp:82:MimeHandlerMail::set_document_file(/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX)
:4:../internfile/internfile.cpp:284:FileInterner::FileInterner: message/rfc822 [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX]
:4:../internfile/internfile.cpp:744:FileInterner::internfile. ipath []
:4:../internfile/mh_mail.cpp:160:MimeHandlerMail::next_document m_idx -1 m_havedoc 1
:4:../internfile/internfile.cpp:661:FileInterner::addHandler: next_doc is text/plain
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/razvan/pers/thunderbird_profile.razvan/ImapMail/localhost/INBOX|] parent []
:2:../rcldb/rcldb.cpp:1097:Db::add: replace_document failed: Caught unknown xapian exceptionmedoc writes
I’d like to help but there is not enough detail in the report. At the very least, the test should be re-run with loglevel at 6. What Xapian and Recoll versions are you running ? It might be worth trying to rebuild Recoll with the Xapian version you are using.
Unknown User writes
Thank you for your offer to help. I didn’t know what is the sufficient loglevel for debugging, but I will follow your advice and run recoll again using level 6 and a separate index for database. I will do this sometime next week and let you know. As for the Recoll version that I am using, it is the one from the RPM recoll-1.13.01-1.i586.rpm downloaded from your web page. It reports that it is using Xapian 1.0.16.
Unknown User writes
I finally managed to find the time to continue tracking this problem. I set the debug level to 6, and recollindex finished with "Segmentation fault". The last part of the log file is below. Note that I replaced the names of some persons and institutions with XXXXX and such for privacy reasons. Processing fails at the very first message in my INBOX. Any suggestions are welcome.
:4:../rcldb/rcldb.cpp:1092:Db::add: docid 41 added [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.sbd/pers.msf|]
:4:../rcldb/rcldb.cpp:1151:Db::needUpdate:yes (new): [Q/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat|]
:5:../index/fsindexer.cpp:388:processone: processing: [25 B ] /home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat
:4:../internfile/internfile.cpp:206:FileInterner::FileInterner: [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat] mime [(null)] preview 0
:4:../index/mimetype.cpp:119:mimetype: fn [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat] in stopsuffixes
:4:../internfile/internfile.cpp:249:internfile: (no mime) [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat]
:3:../internfile/internfile.cpp:260:FileInterner:: ignored: [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat] mime []
:4:../internfile/internfile.cpp:744:FileInterner::internfile. ipath []
:4:../internfile/internfile.cpp:747:FileInterner::internfile: no handler: constructor failed
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat|] parent []
:5:../rcldb/rcldb.cpp:1078:Rcl::Db::add: new doc record:
url=file:///home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat
mtype=
fmtime=01264395851
origcharset=
fbytes=25
sig=251264395851+
dbytes=0
caption=msgFilterRules.dat
:4:../rcldb/rcldb.cpp:1092:Db::add: docid 42 added [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/msgFilterRules.dat|]
:4:../rcldb/rcldb.cpp:1151:Db::needUpdate:yes (new): [Q/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf|]
:5:../index/fsindexer.cpp:388:processone: processing: [27 KB ] /home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf
:4:../internfile/internfile.cpp:206:FileInterner::FileInterner: [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf] mime [(null)] preview 0
:4:../index/mimetype.cpp:119:mimetype: fn [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf] in stopsuffixes
:4:../internfile/internfile.cpp:249:internfile: (no mime) [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf]
:3:../internfile/internfile.cpp:260:FileInterner:: ignored: [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf] mime []
:4:../internfile/internfile.cpp:744:FileInterner::internfile. ipath []
:4:../internfile/internfile.cpp:747:FileInterner::internfile: no handler: constructor failed
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf|] parent []
:5:../rcldb/rcldb.cpp:1078:Rcl::Db::add: new doc record:
url=file:///home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf
mtype=
fmtime=01271035053
origcharset=
fbytes=28122
sig=281221271035053+
dbytes=0
caption=INBOX.msf
:4:../rcldb/rcldb.cpp:1092:Db::add: docid 43 added [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX.msf|]
:4:../rcldb/rcldb.cpp:1151:Db::needUpdate:yes (new): [Q/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX|]
:5:../index/fsindexer.cpp:388:processone: processing: [362 MB ] /home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX
:4:../internfile/internfile.cpp:206:FileInterner::FileInterner: [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX] mime [(null)] preview 0
:4:../internfile/mh_mail.cpp:82:MimeHandlerMail::set_document_file(/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX)
:4:../internfile/internfile.cpp:284:FileInterner::FileInterner: message/rfc822 [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX]
:4:../internfile/internfile.cpp:744:FileInterner::internfile. ipath []
:4:../internfile/mh_mail.cpp:160:MimeHandlerMail::next_document m_idx -1 m_havedoc 1
:4:../internfile/internfile.cpp:661:FileInterner::addHandler: next_doc is text/plain
:4:../rcldb/rcldb.cpp:875:Db::add: udi [/home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX|] parent []
:5:../rcldb/rcldb.cpp:921:Db::add: field [abstract] pfx []: [Dear Dr YYYYYY,If the pages run from the estimated, on our side, it is alright to proceed.
Thanks and regards,
ZZZZZZZ
XXXXX YYYYYY wrote:
>> Dear ZZZZZZZ,>> I understood your point about book size. I shall start to use the > 9 ...]
:5:../rcldb/rcldb.cpp:921:Db::add: field [author] pfx [A]: [ZZZZZZZ B WWWWW <ZZZZZZZ@PPPPPPPPP.com >]
:5:../rcldb/rcldb.cpp:916:Db::add: no prefix for field [md5], no indexing
:5:../rcldb/rcldb.cpp:916:Db::add: no prefix for field [msgid], no indexing
:5:../rcldb/rcldb.cpp:921:Db::add: field [recipient] pfx [XTO]: [XXXXX YYYYYY <XXXXX@NNNN.go.jp >]
:5:../rcldb/rcldb.cpp:921:Db::add: field [title] pfx [S]: [Re: Introduction to NNNNNN EEEEEE]
:5:../rcldb/rcldb.cpp:1078:Rcl::Db::add: new doc record:
url=file:///home/local/XXXXX/pers/thunderbird_profile.XXXXX/ImapMail/localhost/INBOX
mtype=message/rfc822
fmtime=01271031507
dmtime=01234492292
origcharset=
fbytes=379916346
sig=3799163461271031507
dbytes=385444568
caption=Re: Introduction to NNNNNN EEEEEEE
abstract=Dear Dr YYYYYY, If the pages run from the estimated, on our side, it is alright to proceed. Thanks and regards, ZZZZZZZ XXXXX YYYYYY wrote: > > Dear ZZZZZZZ, > > I understood your point about book size. I shall start to use the > 9 ...
author=ZZZZZZZ B WWWWW <ZZZZZZ@PPPPPPPPPPP.com >medoc writes
Hello, Sorry about the delay, I just missed your last update. Would you mind if we could please pursue this by email ? I need more details about software versions etc, and it’s excessively tedious to go through the ticket comments. You can reach me at "jfd at recoll dot org". Thanks, jf
medoc writes
Problem went away all by itself. Has to be a Recoll bug, but we’ll catch this one later…
Unknown User writes
I am seeing this problem at the moment. hexayurt@gmail.com is my email addy. I have a 5mb logfile from log level 9 sitting on my hd, get in touch if you need it.