1 Topic by llamberto

  • llamberto
  • Member
  • Offline
  • Registered: 2020-09-26
  • Posts: 15

Topic: amavisd max process and mlmmj mailing

==== REQUIRED BASIC INFO OF YOUR IREDMAIL SERVER ====
- iRedMail version (check /etc/iredmail-release): 1.3.2 MARIADB edition.
- Deployed with iRedMail Easy or the downloadable installer? downloadable
- Linux/BSD distribution name and version: centos 8
- Store mail accounts in which backend (LDAP/MySQL/PGSQL): MySQL
- Web server (Apache or Nginx): NGINX
- Manage mail accounts with iRedAdmin-Pro?
- [IMPORTANT] Related original log or error message is required if you're experiencing an issue.
====
Hi
i have 2000+ mailbox on my system and a mailing list with mlmmj
when sending a digest to them  the system take many minuts and seems that
amavis run only a child process  and mails are sent one  at one  (5 per second)
is it normal ?
if i send another email to the list while the first is running i see 2 amavisd process
is possible have amavis running al 4 process/child  to  serve  more fast ?

my config
n amavisd.conf
$max_servers = 4;
in main.cf
smtp-amavis_destination_recipient_limit = 4
and in master.cf
smtp-amavis unix -  -   n   -   4  smtp

while mlmmj send email    ps is
ps wax | grep amavisd 
  1646 ?        Ss     0:16 /usr/sbin/amavisd (master)                                                                                                                                   
   1967 ?        Ssl    1:27 /usr/sbin/clamd -c /etc/clamd.d/amavisd.conf
385524 ?        S      0:04 /usr/sbin/amavisd (ch1-385524-01-87)                                                                                                                         
385583 ?        S      0:03 /usr/sbin/amavisd (virgin child)                                                                                                                             
385784 ?        S      0:00 /usr/sbin/amavisd (virgin child)                                                                                                                             
385849 ?        S      0:00 /usr/sbin/amavisd (virgin child)

----

Spider Email Archiver: On-Premises, lightweight email archiving software developed by iRedMail team. Supports Amazon S3 compatible storage and custom branding.

2 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: amavisd max process and mlmmj mailing

llamberto wrote:

smtp-amavis_destination_recipient_limit = 4

This must be set to 1, not same as the "max_servers".
Other settings are ok.

I'm not sure whether it's an issue without related log lines.

3 Reply by llamberto (edited by llamberto 2020-11-20 17:48:43)

  • llamberto
  • Member
  • Offline
  • Registered: 2020-09-26
  • Posts: 15

Re: amavisd max process and mlmmj mailing

ZhangHuangbin wrote:
llamberto wrote:

smtp-amavis_destination_recipient_limit = 4

This must be set to 1, not same as the "max_servers".
Other settings are ok.

I'm not sure whether it's an issue without related log lines.


i have  correct restarted postfix and retry

in attach maillog for 1800 sent  in 5 minutes  and  3 ps wax during process
and now i noted that list is with 2850 subsrcibers ... missing 1050 not in log but i see that email is in their mailbox ... like the log sometimes skip someone   searched in log but log stop after 1800 mails ... mail delivered in mailbox but no track in log  , some mechanism stop log of mlmmj after 1800 mail?

thanks

Post's attachments

maillog.zip 243.13 kb, file has never been downloaded. 

ps_wax.txt 4.07 kb, file has never been downloaded. 

You don't have the permssions to download the attachments of this post.

4 Reply by llamberto (edited by llamberto 2020-11-20 22:29:36)

  • llamberto
  • Member
  • Offline
  • Registered: 2020-09-26
  • Posts: 15

Re: amavisd max process and mlmmj mailing

llamberto wrote:
ZhangHuangbin wrote:
llamberto wrote:

smtp-amavis_destination_recipient_limit = 4

This must be set to 1, not same as the "max_servers".
Other settings are ok.

I'm not sure whether it's an issue without related log lines.


i have  correct restarted postfix and retry

in attach maillog for 1800 sent  in 5 minutes  and  3 ps wax during process
and now i noted that list is with 2850 subsrcibers ... missing 1050 not in log but i see that email is in their mailbox ... like the log sometimes skip someone   searched in log but log stop after 1800 mails ... mail delivered in mailbox but no track in log  , some mechanism stop log of mlmmj after 1800 mail?

thanks

and ... when resatrt mlmmj i have this two error in log Nov 20 09:57:03 mail2 uwsgi[1066]: [uWSGI] getting INI configuration from /opt/www/iredadmin/rc_scripts/uwsgi/rhel8.ini
Nov 20 09:57:03 mail2 uwsgi[1058]: [uWSGI] getting INI configuration from /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini
Nov 20 09:57:03 mail2 uwsgi[1058]: open("./python_plugin.so"): No such file or directory [core/utils.c line 3732]
Nov 20 09:57:03 mail2 uwsgi[1058]: !!! UNABLE to load uWSGI plugin: ./python_plugin.so: cannot open shared object file: No such file or directory !!!
Nov 20 09:57:03 mail2 uwsgi[1058]: open("./syslog_plugin.so"): No such file or directory [core/utils.c line 3732]
Nov 20 09:57:03 mail2 uwsgi[1058]: !!! UNABLE to load uWSGI plugin: ./syslog_plugin.so: cannot open shared object file: No such file or directory !!!

is safe install this plugin from centos.pkgs.org/8/getpagespeed-x86_64/ ??


add 2 mail header  one is passed in log other not in log but arrived  deifference  somethings about dkim ..

Post's attachments

ghost_in_log_email.txt 2.57 kb, file has never been downloaded. 

inlog_email.txt 1.53 kb, file has never been downloaded. 

You don't have the permssions to download the attachments of this post.

5 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: amavisd max process and mlmmj mailing

llamberto wrote:

Nov 20 09:57:03 mail2 uwsgi[1058]: open("./python_plugin.so"): No such file or directory [core/utils.c line 3732]
Nov 20 09:57:03 mail2 uwsgi[1058]: !!! UNABLE to load uWSGI plugin: ./python_plugin.so: cannot open shared object file: No such file or directory !!!

Please upgrade to the latest mlmmjadmin-3.0.5 to fix it. FYI:
https://docs.iredmail.org/upgrade.mlmmjadmin.html

6 Reply by llamberto

  • llamberto
  • Member
  • Offline
  • Registered: 2020-09-26
  • Posts: 15

Re: amavisd max process and mlmmj mailing

ZhangHuangbin wrote:
llamberto wrote:

Nov 20 09:57:03 mail2 uwsgi[1058]: open("./python_plugin.so"): No such file or directory [core/utils.c line 3732]
Nov 20 09:57:03 mail2 uwsgi[1058]: !!! UNABLE to load uWSGI plugin: ./python_plugin.so: cannot open shared object file: No such file or directory !!!

Please upgrade to the latest mlmmjadmin-3.0.5 to fix it. FYI:
https://docs.iredmail.org/upgrade.mlmmjadmin.html

updated,  rebooted  and  checked  link in  /opt/mlmmjadmin -> /opt/mlmmjadmin-3.0.5
but problem persist.
so  i solved  with comment of
#plugins = python,syslog   in /opt/mlmmjadmin-3.0.5/rc_scripts/uwsgi/rhel.ini

i hope is good choice  ( centos 8 not provide syslog_plugin.so  and python_plugin.so i have seen is old problem with centos 8 )

logs now are ok but problem was not iredmail

Problem with  amavisd    bottleneck due  for one process at time remain  mlmmj send to local account 6 email per second   and other three amavisd process sleep

7 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: amavisd max process and mlmmj mailing

Sad, it's another bug of our upgrade script. sad
Fixed in mlmmjadmin-3.0.6, could you help test it?
https://docs.iredmail.org/upgrade.mlmmjadmin.html

8 Reply by llamberto

  • llamberto
  • Member
  • Offline
  • Registered: 2020-09-26
  • Posts: 15

Re: amavisd max process and mlmmj mailing

ZhangHuangbin wrote:

Sad, it's another bug of our upgrade script. sad
Fixed in mlmmjadmin-3.0.6, could you help test it?
https://docs.iredmail.org/upgrade.mlmmjadmin.html

Hi
Zhang of course.
I have updated  and cheched . Now correct version of rhel.ini with commented plugin is OK

apropose mlmmj i sent a mail with some attched pdf  1 max 2 mail per second ....
mlmmj is so slow ?
Please help me to speedup if possible

here ps wax during sending

ps wax | grep "amavisd\|mlmm"
   1065 ?        Ss     0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1172 ?        S      0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1173 ?        S      0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1174 ?        S      0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1175 ?        S      0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1176 ?        S      0:00 /usr/local/bin/uwsgi --ini /opt/mlmmjadmin/rc_scripts/uwsgi/rhel.ini --pidfile /var/run/mlmmjadmin/mlmmjadmin.pid
   1941 ?        Ssl    0:01 /usr/sbin/clamd -c /etc/clamd.d/amavisd.conf
  11207 ?        Ss     0:01 /usr/sbin/amavisd (master)                                                                                                                                                                                   
  11212 ?        S      0:00 /usr/sbin/amavisd (ch1-avail)                                                                                                                                                                                 
  11213 ?        S      0:52 /usr/sbin/amavisd (ch1-11213-01-69)                                                                                                                                                                           
  11214 ?        S      0:00 /usr/sbin/amavisd (virgin child)                                                                                                                                                                             
  11215 ?        S      0:00 /usr/sbin/amavisd (ch1-avail)                                                                                                                                                                                 
  15408 ?        S      0:00 pipe -n mlmmj -t unix flags=ORhu user=mlmmj mlmmj argv=/usr/bin/mlmmj-amime-receive -L /var/vmail/mlmmj/${nexthop}
  15415 ?        S      0:18 /usr/bin/mlmmj-send -L /var/vmail/mlmmj/anpac.it/anpacmail -m /var/vmail/mlmmj/anpac.it/anpacmail/queue/5ba3c0c005fbe16c
  15999 pts/1    S+     0:00 grep --directories=skip --color=auto amavisd\|mlmm

9 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: amavisd max process and mlmmj mailing

llamberto wrote:

apropose mlmmj i sent a mail with some attched pdf  1 max 2 mail per second ....
mlmmj is so slow ?

Sent email has spam/virus scanning enabled in Amavisd by default, maybe the scanning took some time. You'd better check Postfix log to figure it out.