1 Topic by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Topic: Emails recieved and shown as delivered in log but not on server

==== REQUIRED BASIC INFO OF YOUR IREDMAIL SERVER ====
- iRedMail version (check /etc/iredmail-release):      0.9.8
- Linux/BSD distribution name and version: CentOS Linux 7.5.1804
- Store mail accounts in which backend (LDAP/MySQL/PGSQL): PGSQL
- Web server (Apache or Nginx):Nginx
- Manage mail accounts with iRedAdmin-Pro? yes
- [IMPORTANT] Related original log or error message is required if you're experiencing an issue.
====

Emails received and shown as delivered by postfix in log but are not on server or show up in email client. i have no supporting log file or files with any errors as to why the emails disappear after they show as delivered. this is a random issue that is for one user account so far but happens enough it is interfering with workflow. the emails are not even in the email accounts folder in the dir tree under vmail.

things Ive change in the last month:
created a symlink to a user account in /home due to /root partition filling up becuase it was setup with a smaller partition when Centos was installed
upgraded packages via yum which installed a newer uwsgi package back on 9-24-18

the problem started from what i can tell 3 to 4 weeks ago due to the amount of complaints of emails not showing up

any ideas would be helpful
Justin

----

Spider Email Archiver: On-Premises, lightweight email archiving software developed by iRedMail team. Supports Amazon S3 compatible storage and custom branding.

2 Reply by MattHo

  • MattHo
  • Member
  • Offline
  • Registered: 2017-06-06
  • Posts: 34

Re: Emails recieved and shown as delivered in log but not on server

==== REQUIRED BASIC INFO OF YOUR IREDMAIL SERVER ====
- iRedMail version (check /etc/iredmail-release):      0.9.8
- Linux/BSD distribution name and version: CentOS Linux 7
- Store mail accounts in which backend (LDAP/MySQL/PGSQL): MySQL
- Web server (Apache or Nginx):Nginx
- Manage mail accounts with iRedAdmin-Pro? yes
- [IMPORTANT] Related original log or error message is required if you're experiencing an issue.
====

I also have the same problems for few users but it's on the send mail case.
Postfix and iRedAdmin-Pro log file show the email is sent but the mail didn't show in the sent folder, it disappeared. Whatever send from Outlook or Webmail are the same randomly.

Regards,
Matt

3 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

Please check both Postfix and Dovecot log files, there MUST be some log related the issue.

4 Reply by justinr (edited by justinr 2018-11-13 03:22:16)

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

Below is a log entry for one of the missing emails which shows it was delivered to the mailbox, but going into the mail box and also into the directory structure you will find no email at all. I have gone through all the logs i can find for this one date/time and found not a single error which is extremely puzzling.

On Friday I deleted the user account and recreated the account while preserving the old email directory to see if the issue might be resolved that way.


MAIL LOG:
Oct 30 09:15:44 mx postfix/postscreen[30558]: PASS OLD [209.85.161.97]:33909
Oct 30 09:15:44 mx postfix/smtpd[30559]: connect from mail-yw1-f97.google.com[209.85.161.97]
Oct 30 09:15:45 mx postfix/smtpd[30559]: 8E3F78163E07: client=mail-yw1-f97.google.com[209.85.161.97]
Oct 30 09:15:45 mx postfix/cleanup[30779]: 8E3F78163E07: message-id=<06E242923803464881F2AF448A38C59901152FF580@Legend-Mail.legend.local>
Oct 30 09:15:45 mx postfix/qmgr[1694]: 8E3F78163E07: from=<tericXXXX@XXXXXXX.XXX>, size=5599, nrcpt=1 (queue active)
Oct 30 09:15:45 mx postfix/smtpd[30559]: disconnect from mail-yw1-f97.google.com[209.85.161.97]
Oct 30 09:15:45 mx postfix/smtpd[30791]: connect from mx.XXXX.XXX[127.0.0.1]
Oct 30 09:15:45 mx postfix/smtpd[30791]: F04A48163E08: client=mx.XXXX.XXX[127.0.0.1]
Oct 30 09:15:45 mx postfix/cleanup[30779]: F04A48163E08: message-id=<06E242923803464881F2AF448A38C59901152FF580@Legend-Mail.legend.local>
Oct 30 09:15:46 mx postfix/smtpd[30791]: disconnect from mx.XXXX.XXX[127.0.0.1]
Oct 30 09:15:46 mx postfix/qmgr[1694]: F04A48163E08: from=<tericXXXX@XXXXXXXX.XXX>, size=6442, nrcpt=1 (queue active)
Oct 30 09:15:46 mx amavis[27906]: (27906-20) Passed CLEAN {RelayedInbound}, [209.85.161.97]:33909 [209.201.111.85] <tericXXXX@XXXXXXXX.XXX> -> <schedule@XXXXXX.XXX>, Queue-ID: 8E3F78163E07, Message-ID: <06E242923803464881F2AF448A38C59901152FF580@legend-mail.legend.local>, mail_id: YYUKxUboxfhV, Hits: -, size: 5599, queued_as: F04A48163E08, dkim_sd=20150623:XXXXXXXXXXX.20150623.gappssmtp.com, 348 ms
Oct 30 09:15:46 mx postfix/smtp[30788]: 8E3F78163E07: to=<schedule@XXXXXXX.XXX>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.52, delays=0.15/0/0/0.36, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as F04A48163E08)
Oct 30 09:15:46 mx postfix/qmgr[1694]: 8E3F78163E07: removed
Oct 30 09:15:46 mx postfix/pipe[30898]: F04A48163E08: to=<schedule@XXXXXXXX.XXX>, relay=dovecot, delay=0.3, delays=0.03/0/0/0.27, dsn=2.0.0, status=sent (delivered via dovecot service)
Oct 30 09:15:46 mx postfix/qmgr[1694]: F04A48163E08: removed


SIEVE LOG:
Oct 30 09:15:46 lda(schedule@XXXXXXX.XXX): Info: sieve: msgid=<06E242923803464881F2AF448A38C59901152FF580@Legend-Mail.legend.local>: stored mail into mailbox 'INBOX'

IREDAPD LOG:
2018-10-30 09:15:45 INFO [209.85.161.97] RCPT, tericXXX@XXXXX.XXX -> schedule@XXXXXX.XXX, OK wblist=(10, 3, 'W') [sasl_username=, sender=tericXXX@XXXXXXX.XXX, client_name=mail-yw1-f97.google.com, reverse_client_name=mail-yw1-f97.google.com, helo=mail-yw1-f97.google.com, encryption_protocol=TLSv1.2, process_time=0.0067s]
2018-10-30 09:15:45 INFO [209.85.161.97] END-OF-MESSAGE, tericXXXX@XXXXXXX.XXX -> schedule@XXXXXXX.XXX, DUNNO [recipient_count=1, size=5424, process_time=0.0021s]
2018-10-30 09:17:21 INFO Whitelisted: wblist=(10, 3855, 'W')


Thank you for your time and help
Justin

5 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

justinr wrote:

Oct 30 09:15:46 lda(schedule@XXXXXXX.XXX): Info: sieve: msgid=<06E242923803464881F2AF448A38C59901152FF580@Legend-Mail.legend.local>: stored mail into mailbox 'INBOX'

According to this log, message should be delivered to user's INBOX folder.

Does this user have some sieve rule to discard or forward/redirect email to other email addresses?

6 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

ZhangHuangbin wrote:
justinr wrote:

Oct 30 09:15:46 lda(schedule@XXXXXXX.XXX): Info: sieve: msgid=<06E242923803464881F2AF448A38C59901152FF580@Legend-Mail.legend.local>: stored mail into mailbox 'INBOX'

According to this log, message should be delivered to user's INBOX folder.

Does this user have some sieve rule to discard or forward/redirect email to other email addresses?


this user is a straight of the box user using global spam protection and nothing else, and that's what has me stumped. none of the other 18 user accounts show any signs of missing mail, just this one account.

7 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

I have no idea why email was missed. Do you remember any difference between this user and other normal mail users?

8 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

the only true difference is that this email account receives a hundred plus emails a day with some coming in all at one time, i have not looked to see if this issue is happening during one of the spurts of emails or not. could a mass of emails all coming in around the same time cause a bottleneck so to speak and create an issue like this?

9 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

justinr wrote:

could a mass of emails all coming in around the same time cause a bottleneck so to speak and create an issue like this?

I don't think so in your case.

I suggest turn on debug mode in Dovecot to check this mail delivery to this account.
FYI: https://docs.iredmail.org/debug.dovecot.html

10 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

sorry for the delay, was on vacation last week. debug mode is on and i will report what i find.

11 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

here is the dovecot sieve log for an email that never showed up under the schedule user account, and the dovecot log doesn't have anything for this user at that timestamp.

Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Loading modules from directory: /usr/lib64/dovecot
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Module loaded: /usr/lib64/dovecot/lib20_mailbox_alias_plugin.so
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: auth USER input: schedule@xxxxxx.xxx home=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18/ quota_rule=*:bytes=10485760000
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Added userdb setting: plugin/quota_rule=*:bytes=10485760000
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Effective uid=2000, gid=2000, home=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18/
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota root: name=user backend=dict args=:proxy::quotadict
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota rule: root=user mailbox=* bytes=10485760000 messages=0
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=10485760000 (100%) messages=0 reverse=no command=quota-warning 100 schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=9961472000 (95%) messages=0 reverse=no command=quota-warning 95 schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=9437184000 (90%) messages=0 reverse=no command=quota-warning 90 schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=8912896000 (85%) messages=0 reverse=no command=quota-warning 85 schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota grace: root=user bytes=1048576000 (10%)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: dict quota: user=schedule@xxxxxx.xxx, uri=proxy::quotadict, noenforcing=0
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//Maildir/:INDEX=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//Maildir/
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: maildir++: root=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//Maildir, index=, indexpvt=, control=, inbox=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//Maildir, alt=
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: initializing backend with data: vfile
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: acl username = schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: owner = 1
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl vfile: Global ACLs disabled
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt=
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: initializing backend with data: vfile
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: acl username = schedule@xxxxxx.xxx
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl: owner = 0
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: acl vfile: Global ACLs disabled
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: quota: quota_over_flag check: quota_over_script unset - skipping
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota root: name=user backend=dict args=:proxy::quotadict
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota rule: root=user mailbox=* bytes=1073741824 messages=0
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=1073741824 (100%) messages=0 reverse=no command=quota-warning 100 raw mail user
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=1020054732 (95%) messages=0 reverse=no command=quota-warning 95 raw mail user
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=966367641 (90%) messages=0 reverse=no command=quota-warning 90 raw mail user
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota warning: bytes=912680550 (85%) messages=0 reverse=no command=quota-warning 85 raw mail user
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Quota grace: root=user bytes=107374182 (10%)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: dict quota: user=raw mail user, uri=proxy::quotadict, noenforcing=0
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt=
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: quota: quota_over_flag check: quota_over_script unset - skipping
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Destination address: schedule@xxxxxx.xxx (source: user@hostname)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Pigeonhole version 0.4.20 (7cd71ba) initializing
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file storage: Storage path `/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//sieve' not found
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file storage: Failed to normalize active script directory (path=/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//sieve): Part of the path does not exist (yet)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file storage: Using Sieve script path: /var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//sieve/dovecot.sieve
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file storage: Storage path `/var/vmail/vmail1/xxxxxx.xxx/s/c/h/schedule-2018.11.08.15.33.18//sieve/dovecot.sieve' not found
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: storage: No default script location configured
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: User has no personal script
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file storage: Using Sieve script path: /var/vmail/sieve/dovecot.sieve
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: file script: Opened script `dovecot' from `/var/vmail/sieve/dovecot.sieve'
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Executed before user's personal Sieve script(1): /var/vmail/sieve/dovecot.sieve
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Mailbox stdin: Opened mail UID=1 because: header Message-ID (Cache file is unusable)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Opening script 1 of 1 from `/var/vmail/sieve/dovecot.sieve'
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Loading script /var/vmail/sieve/dovecot.sieve
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Script binary /var/vmail/sieve/dovecot.svbin successfully loaded
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: binary save: not saving binary /var/vmail/sieve/dovecot.svbin, because it is already stored
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: sieve: Executing script from `/var/vmail/sieve/dovecot.svbin'
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Mailbox stdin: Opened mail UID=1 because: header X-Spam-Flag (Cache file is unusable)
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: INBOX: Mailbox opened because: lib-lda delivery
Dec 03 13:06:09 lda(schedule@xxxxxx.xxx): Debug: Mailbox stdin: Opened mail UID=1 because: copying

the mail log below shows it come in, in which the email was to both schedule and Lorenzo, but only Lorenzo received the email and the email cannot be found on the server at all.

Dec  3 13:06:07 mx postfix/smtpd[8997]: connect from mail-eopbgr1390138.outbound.protection.outlook.com[40.107.139.138]
Dec  3 13:06:08 mx postfix/smtpd[8997]: A83A08161045: client=mail-eopbgr1390138.outbound.protection.outlook.com[40.107.139.138]
Dec  3 13:06:09 mx postfix/cleanup[9017]: A83A08161045: message-id=<3A3359C5-068C-45CF-8173-8328106D37D8@xxxxxx.xxx>
Dec  3 13:06:09 mx postfix/qmgr[27333]: A83A08161045: from=<richard@xxxxxx.xxx>, size=5863, nrcpt=2 (queue active)
Dec  3 13:06:09 mx clamd[1767]: SelfCheck: Database status OK.
Dec  3 13:06:09 mx postfix/smtpd[8997]: disconnect from mail-eopbgr1390138.outbound.protection.outlook.com[40.107.139.138]
Dec  3 13:06:09 mx postfix/smtpd[9028]: connect from mx.diamondplumbingtexas.com[127.0.0.1]
Dec  3 13:06:09 mx postfix/smtpd[9028]: 9DCB28171891: client=mx.diamondplumbingtexas.com[127.0.0.1]
Dec  3 13:06:09 mx postfix/cleanup[9017]: 9DCB28171891: message-id=<3A3359C5-068C-45CF-8173-8328106D37D8@xxxxxx.xxx>
Dec  3 13:06:09 mx postfix/qmgr[27333]: 9DCB28171891: from=<richard@xxxxxx.xxx>, size=6634, nrcpt=2 (queue active)
Dec  3 13:06:09 mx postfix/smtpd[9028]: disconnect from mx.diamondplumbingtexas.com[127.0.0.1]
Dec  3 13:06:09 mx amavis[1192]: (01192-18) Passed CLEAN {RelayedInbound}, [40.107.139.138]:6126 [40.107.139.138] <richard@xxxxxx.xxx> -> <lorenzo@xxxxxx.xxx>,<schedule@xxxxxx.xxx>, Queue-ID: A83A08161045, Message-ID: <3A3359C5-068C-45CF-8173-8328106D37D8@xxxxxx.xxx>, mail_id: KmDf5hoBfiFE, Hits: -, size: 5856, queued_as: 9DCB28171891, dkim_sd=selector1-xxxxxxx-com:xxxxxxxxxx.onmicrosoft.com, 363 ms
Dec  3 13:06:09 mx postfix/smtp[9025]: A83A08161045: to=<lorenzo@xxxxxx.xxx>, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.72/0.01/0/0.38, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 9DCB28171891)
Dec  3 13:06:09 mx postfix/smtp[9025]: A83A08161045: to=<schedule@xxxxxx.xxx>, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.72/0.01/0/0.38, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 9DCB28171891)
Dec  3 13:06:09 mx postfix/qmgr[27333]: A83A08161045: removed
Dec  3 13:06:09 mx postfix/pipe[9030]: 9DCB28171891: to=<schedule@xxxxxx.xxx>, relay=dovecot, delay=0.33, delays=0.03/0.02/0/0.28, dsn=2.0.0, status=sent (delivered via dovecot service)
Dec  3 13:06:10 mx postfix/pipe[9029]: 9DCB28171891: to=<lorenzo@xxxxxx.xxx>, relay=dovecot, delay=0.36, delays=0.03/0.01/0/0.32, dsn=2.0.0, status=sent (delivered via dovecot service)
Dec  3 13:06:10 mx postfix/qmgr[27333]: 9DCB28171891: removed

12 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

- Do these 2 users have personal filter rules with forwarding / redirect rules configured with Roundcube/SOGo?
- What's the log in /var/log/dovecot/lda.log?
- What's the content in /var/vmail/sieve/dovecot.sieve?

13 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

ZhangHuangbin wrote:

- Do these 2 users have personal filter rules with forwarding / redirect rules configured with Roundcube/SOGo?
- What's the log in /var/log/dovecot/lda.log?
- What's the content in /var/vmail/sieve/dovecot.sieve?

there are no filter rules or redirect on the above 2 accounts, there isn't an lda.log since everything dumps into the mail.log and sieve.log and the sieve log is posted above from one of the missing emails out of the the 20 or so that are missing from the schedule@ account from 11/28 to 12/3.

14 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

my office just handed me 18 more emails in a row from Friday between 2:2pm and 2:07pm that are not on the server but show as received and put into the mail box.

15 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

I'm going to build a new server from ground up and start over. how do i import the emails from the old server over to the new one when its ready?

16 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

justinr wrote:

I'm going to build a new server from ground up and start over. how do i import the emails from the old server over to the new one when its ready?

With same iRedMail-0.9.8 version, you can simply export/import SQL databases, then copy mailboxes with "rsync" to same directory.

justinr wrote:

I'm going to build a new server from ground up and start over. how do i import the emails from the old server over to the new one when its ready?

Have to dive into Postfix+Dovecot log files to figure it out.

17 Reply by justinr (edited by justinr 2018-12-18 23:54:57)

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

I just fired up the new server running iredmail with pro license so i can start rebuilding the email server, wanted to let you know so you don't think I am trying to run two instances at the same time and disable my license smile

Server Specs:

     *-cpu:0
          description: CPU
          product: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz
          vendor: Intel Corp.
          vendor_id: GenuineIntel
          physical id: 400
          bus info: cpu@0
          version: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz
          slot: CPU1
          size: 2933MHz
          capacity: 3600MHz
          width: 64 bits
          clock: 2105MHz
          capabilities: lm fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp x86-64 constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida spec_ctrl intel_stibp flush_l1d
          configuration: cores=4 enabledcores=4 threads=8

      *-cpu:1
          description: CPU
          product: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz
          vendor: Intel Corp.
          vendor_id: GenuineIntel
          physical id: 400
          bus info: cpu@1
          version: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz
          slot: CPU2
          size: 2933MHz
          capacity: 3600MHz
          width: 64 bits
          clock: 2105MHz
          capabilities: lm fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp x86-64 constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida spec_ctrl intel_stibp flush_l1d
          configuration: cores=4 enabledcores=4 threads=8
 
     *-memory
          description: System Memory
          physical id: 1000
          slot: System board or motherboard
          size: 32GiB
          capabilities: ecc
          configuration: errordetection=multi-bit-ecc

18 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

OK, did you test the issue on new server?

19 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

not as of yet, I am currently recreating domain and users manually rather then importing the database, then going to move the older emails over into each users folder on the server. at that point i can make the new server live

20 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

ok first day running and missing 4 emails, i have turn on debugging on the server and will check the logs for missing emails from here on and report back what i find.

21 Reply by justinr

  • justinr
  • Member
  • Offline
  • Registered: 2016-04-21
  • Posts: 22

Re: Emails recieved and shown as delivered in log but not on server

After building a new server and installing the software from scratch i found missing emails, well it turns out the issue was actually one of the two mail clients that was receiving all the emails was somehow intercepting the mail and removing it from the server before the other email client could download them. as of now i don't know why or how the one client was doing this with out something in a log file but after removing that client from being able to connect to the server the issue went away.

22 Reply by ZhangHuangbin

  • ZhangHuangbin
  • ZhangHuangbin
  • iRedMail Developers
  • Offline
  • Registered: 2009-05-06
  • Posts: 31,088

Re: Emails recieved and shown as delivered in log but not on server

Thanks for sharing.