1 (edited by superinterstellar 2015-01-23 18:42:04)

Topic: Adding plugins to dovecot.conf - FTS Solr

==== Required information ====
- iRedMail version: 0.8.7
- Store mail accounts in which backend (LDAP/MySQL/PGSQL): MySQL
- Linux/BSD distribution name and version: Ubuntu 14.04
- Related log if you're reporting an issue:
====

Hi Zhang,

I need to add FTS to my plugin. From what I understand is that the /etc/dovecot/conf.d/10-mail.conf is not used by iredmail.
In this case I would need to add it to the dovecot.conf. Correct?


plugin {
  fts = solr
  fts_solr = url=http://127.0.0.1:8983/solr/ break-imap-search
}

Also please advise how do I include it.
Do I just paste it in the mail_plugins field?, Appreciate if you could provide me an example of how to do it.


Below is part of my current dovecot.conf :-

mail_plugins = quota fts


Thanks
Kevin

----

Spider Email Archiver: On-Premises, lightweight email archiving software developed by iRedMail team. Supports Amazon S3 compatible storage and custom branding.

2

Re: Adding plugins to dovecot.conf - FTS Solr

Dovecot supports multiple "plugins {}" blocks, so your settings i ok.

Here's a user contributed tutorial about fts support, hope it helps:
https://extremeshok.com/6622/enabling-a … ompatible/
https://blog.vbonhomme.fr/add-full-text … ntu-14-04/

3

Re: Adding plugins to dovecot.conf - FTS Solr

I see you posted another topic on Jan 2, i'm afraid that i missed this. sorry about this.
http://www.iredmail.org/forum/topic8451 … lp-me.html

[I closed above topic moment ago, let's discuss in this thread instead.]

4

Re: Adding plugins to dovecot.conf - FTS Solr

Hey Zhang,
No problem about missing my last post. I understand that you are quite busy and at times its difficult to address all the issues on forums. Hope you are doing well.

I just wanted to confirm if adding this(text below) in dovecot.conf :-

plugin {
  fts = solr
  fts_solr = url=http://127.0.0.1:8983/solr/ break-imap-search
}


mail_plugins = quota fts

Please advise if the above makes senses.
Thanks
Kevin

5

Re: Adding plugins to dovecot.conf - FTS Solr

Dear Kevin,

I don't run Dovecot with fts plugin, so i cannot answer this question. I suggest you check mentioned tutorial in my last reply, or try it on a virtual machine for testing, then you can answer yourself quickly. Sorry about this.

6

Re: Adding plugins to dovecot.conf - FTS Solr

Hi Zhang,
Noted that you dont use FTS with dovecot. How else would you address fast searching/indexing of mails? I imagine with all the e-mails that server handles, there must be some mechanism for fast searching/indexing of mails?
Appreciate your feedback on this.
Thanks
Kevin

7

Re: Adding plugins to dovecot.conf - FTS Solr

Dear Kevin,

superinterstellar wrote:

I just wanted to confirm if adding this(text below) in dovecot.conf

Yes. iRedMail configures Dovecot to use only dovecot.conf as MAIN config file, all files under /etc/dovecot/conf.d/ are ignored.

P.S. There may be some questions others can give exact answers, but maybe others can help give a direction. What you need to do is doing some testing yourself.

8 (edited by superinterstellar 2015-01-27 23:52:50)

Re: Adding plugins to dovecot.conf - FTS Solr

Dear Zhang,
Sorry for my tardiness in replying. I have extremely slow e-mail search times. Almost 2minutes to search record of 20,000 emails. Thats why I am so desperately trying to get a solution for this.

This is my search performance below. I will do more testing to figure out why is it behaving like this.
Thanks

. OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in
. select inbox
* FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded)
* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded \*)] Flags permitted.
* 49225 EXISTS
* 73 RECENT
* OK [UNSEEN 46791] First unseen.
* OK [UIDVALIDITY 1414214135] UIDs valid
* OK [UIDNEXT 106460] Predicted next UID
* OK [NOMODSEQ] No permanent modsequences
. OK [READ-WRITE] Select completed (0.548 secs).
. search text dear
* OK Searched 9% of the mailbox, ETA 1:39
* OK Searched 20% of the mailbox, ETA 1:18
* OK Searched 29% of the mailbox, ETA 1:12
* OK Searched 38% of the mailbox, ETA 1:03
* OK Searched 50% of the mailbox, ETA 0:49
* OK Searched 60% of the mailbox, ETA 0:39
* OK Searched 69% of the mailbox, ETA 0:30
* OK Searched 79% of the mailbox, ETA 0:20

Below is the output of my dovecot -n

# 2.2.9: /etc/dovecot/dovecot.conf
# OS: Linux 3.10.62-xenU-25-0e6777a-x86_64 x86_64 Ubuntu 14.04.1 LTS 
auth_master_user_separator = *
auth_mechanisms = PLAIN LOGIN
dict {
  acl = mysql:/etc/dovecot/dovecot-share-folder.conf
  quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf
}
first_valid_uid = 2000
last_valid_uid = 2000
listen = *
log_path = /var/log/dovecot.log
mail_debug = yes
mail_gid = 2000
mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/
mail_plugins = quota fts
mail_uid = 2000
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave
namespace {
  inbox = yes
  location = 
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox Junk {
    auto = subscribe
    special_use = \Junk
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    auto = no
    special_use = \Sent
  }
  mailbox Spam {
    auto = no
    special_use = \Junk
  }
  mailbox Trash {
    auto = subscribe
    special_use = \Trash
  }
  prefix = 
  separator = /
  type = private
}
namespace {
  list = children
  location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u
  prefix = Shared/%%u/
  separator = /
  subscriptions = yes
  type = shared
}
passdb {
  args = /etc/dovecot/dovecot-mysql.conf
  driver = sql
}
passdb {
  args = /etc/dovecot/dovecot-master-users-password
  driver = passwd-file
  master = yes
}
plugin {
  acl = vfile
  acl_shared_dict = proxy::acl
  auth_socket_path = /var/run/dovecot/auth-master
  quota = dict:user::proxy::quotadict
  quota_rule = *:storage=1G
  quota_warning = storage=85%% quota-warning 85 %u
  quota_warning2 = storage=90%% quota-warning 90 %u
  quota_warning3 = storage=95%% quota-warning 95 %u
  sieve = /%Lh/sieve/dovecot.sieve
  sieve_default = /var/vmail/sieve/dovecot.sieve
  sieve_dir = /%Lh/sieve
  sieve_global_dir = /var/vmail/sieve
}
protocols = pop3 imap sieve lmtp
service auth {
  unix_listener /var/spool/postfix/private/dovecot-auth {
    group = postfix
    mode = 0666
    user = postfix
  }
  unix_listener auth-master {
    group = vmail
    mode = 0666
    user = vmail
  }
  unix_listener auth-userdb {
    group = vmail
    mode = 0660
    user = vmail
  }
}
service dict {
  unix_listener dict {
    group = vmail
    mode = 0660
    user = vmail
  }
}
service imap-login {
  process_limit = 500
  service_count = 1
}
service lmtp {
  executable = lmtp -L
  inet_listener lmtp {
    port = 24
  }
  process_min_avail = 5
  unix_listener /var/spool/postfix/private/dovecot-lmtp {
    group = postfix
    mode = 0600
    user = postfix
  }
  user = vmail
}
service pop3-login {
  service_count = 1
}
service quota-warning {
  executable = script /usr/local/bin/dovecot-quota-warning.sh
  unix_listener quota-warning {
    group = vmail
    mode = 0660
    user = vmail
  }
}
ssl = required
ssl_cert = </etc/ssl/certs/sicl.net.crt
ssl_key = </etc/ssl/private/sicl.net.key
userdb {
  args = /etc/dovecot/dovecot-mysql.conf
  driver = sql
}
protocol lda {
  auth_socket_path = /var/run/dovecot/auth-master
  lda_mailbox_autocreate = yes
  log_path = /var/log/dovecot-sieve.log
  mail_plugins = quota fts sieve
  postmaster_address = root
}
protocol lmtp {
  info_log_path = /var/log/dovecot-lmtp.log
  lmtp_save_to_detail_mailbox = yes
  mail_plugins = quota sieve
  postmaster_address = postmaster
  recipient_delimiter = +
}
protocol imap {
  imap_client_workarounds = tb-extra-mailbox-sep
  mail_plugins = quota fts imap_quota
}
protocol pop3 {
  mail_plugins = quota fts
  pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
  pop3_uidl_format = %08Xu%08Xv
}