Project

General

Profile

Bug #60188

not all messages are indexed

Added by Alexey Bobyr almost 4 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Immediate
Assignee:
Alexey Bobyr
Category:
Scalix SIS
Target version:
Start date:
12/17/2015
Due date:
12/21/2015
% Done:

100%

Estimated time:
Operation System:
--

Description

Scalix server can change some messages at runtime .

as an example

[root@web logs]# grep '0026fc2aa6ebbe33' ./* | grep '0c3300001b539725-6.1.4.01'
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:37:09 -0500] "GET /sis/indexer?fn=delete&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567273cb-a2b000 HTTP/1.1" 200 4
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:37:09 -0500] "GET /sis/indexer?fn=add&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567273cb-a2b001&flags=seen,unflagged,unanswered,undeleted,undraft,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 204 -
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:37:09 -0500] "POST /sis/indexer?fn=index&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567273cb-a2b001&flags=seen,unflagged,unanswered,undeleted,undraft,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 200 4
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:45:31 -0500] "GET /sis/indexer?fn=delete&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567273cb-a2b001 HTTP/1.1" 200 4
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:45:31 -0500] "GET /sis/indexer?fn=delete&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567275c1-a2b04b HTTP/1.1" 200 4
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:45:31 -0500] "GET /sis/indexer?fn=add&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567275c1-a2b04c&flags=seen,unflagged,unanswered,undeleted,undraft,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 204 -
./web.madeit.com_access_log.2015-12-17.txt:10.4.1.6 - - [17/Dec/2015:03:45:31 -0500] "POST /sis/indexer?fn=index&uid=0c3300001b539725-6.1.4.01&pdref=00010697a89fa94f&dref=0026fc2aa6ebbe33&indexid=601040a-527935b1-567275c1-a2b04c&flags=seen,unflagged,unanswered,undeleted,undraft,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 200 4

appointment wont exists in index.
So need to rethink current implementation to prevent removing msg's from index files.
Because user can create appointment at mobile and will shown at device and webmail becasue they are using imap. But this appointment
will be missing for Dav protocol when some external Dav client is requesting appointments between some dates this client will
never show them because search relays to SIS and indexed document and if msg not in indexes it will return empty results....

History

#1

Updated by Alexey Bobyr almost 4 years ago

  • Due date set to 12/21/2015
  • Status changed from Answered to Resolved
  • % Done changed from 0 to 100

added some fixes:
- moved to more relay-able queue model
- force execute delete docs not checking current queue.
- group tasks by user.
- made sure that some methods are thread safe (synchronized)

Alexey Bobyr wrote:

Scalix server can change some messages at runtime .

as an example
[...]

appointment wont exists in index.
So need to rethink current implementation to prevent removing msg's from index files.
Because user can create appointment at mobile and will shown at device and webmail becasue they are using imap. But this appointment
will be missing for Dav protocol when some external Dav client is requesting appointments between some dates this client will
never show them because search relays to SIS and indexed document and if msg not in indexes it will return empty results....

#2

Updated by Alex I about 3 years ago

  • Subject changed from not all message is indexed to not all messages are indexed

Also available in: Atom PDF