Invite E-Mail not sending on 2.1.4 even when testing SMTP is successful

[degoya]

Past Issues Searched

• I have searched open and closed issues to make sure that the bug has not yet been reported

Issue is a Bug Report

• This is a bug report and not a feature request, nor asking for self-hosted support

Using official Plausible Cloud hosting or self-hosting?

Self-hosting

Describe the bug

I'm not able to send invite Links. Doesn't matter if i invite as Admin or Viewer User.

in my docker compose file i've added the following enviromentvars:

      - 'MAILER_ADAPTER=Bamboo.Mua'
      - '[email protected]'
      - 'SMTP_HOST_ADDR=mail1.mydomain.de'
      - 'SMTP_HOST_PORT=25'
      - '[email protected]'
      - 'SMTP_USER_PWD=mypassword'
      - 'SMTP_HOST_SSL_ENABLED=false'

i tried to debug the mail and it is working
when i connect to the docker container and start
bin/plausible remote
and execute:
Application.get_env(:plausible, Plausible.Mailer)
i get as result:

[
  adapter: Bamboo.Mua,
  ssl: [middlebox_comp_mode: false],
  protocol: :tcp,
  relay: "mail1.mymailserver.de",
  port: 25,
  auth: [username: "[email protected]", password: "mypassword"]
]

what matches my settings in the environment.

when i try to send a test email with

email = Bamboo.Email.new_email(from: "[email protected]", to: "[email protected]", subject: "test", text_body: "test")
Plausible.Mailer.deliver_now(email)

i get a mail delivered to my inbox.

As soon when i go and send an invite link via the plausible UI i get a error in the log:
2024-11-19T17:10:52.573292413Z 17:10:52.566 request_id=GAlty2uNwBoaMdoAADUC [error] Failed to send e-mail

this error with different request_id comes for every email adress i try to add.

i'm running on a Hetzner Cloud Server (blocking of Ports is disabled by support)

is there any way i could debug it futher?
why i'm able to send mails via STMP in test but plausible fails?

Here is my complete Docker Compose File to have everything togehter in that issue:

services:
  plausible:
    image: 'ghcr.io/plausible/community-edition:v2.1.4'
    command: 'sh -c "sleep 10 && /entrypoint.sh db createdb && /entrypoint.sh db migrate && /entrypoint.sh run"'
    environment:
      - SERVICE_FQDN_PLAUSIBLE
      - 'DATABASE_URL=postgres://${SERVICE_USER_POSTGRES}:${SERVICE_PASSWORD_POSTGRES}@plausible-db:5432/${POSTGRES_DB:-plausible-db}'
      - 'CLICKHOUSE_DATABASE_URL=http://plausible-events-db:8123/plausible_events_db'
      - 'BASE_URL=${SERVICE_FQDN_PLAUSIBLE}'
      - 'SECRET_KEY_BASE=${SERVICE_BASE64_64_PLAUSIBLE}'
      - 'TOTP_VAULT_KEY=${SERVICE_REALBASE64_32_TOTP}'
      - 'MAILER_ADAPTER=Bamboo.Mua'
      - 'MAILER_NAME=Plausible'
      - '[email protected]'
      - 'SMTP_HOST_ADDR=mail1.mydomain.de'
      - 'SMTP_HOST_PORT=465'
      - '[email protected]'
      - 'SMTP_USER_PWD=mypassword'
      - 'SMTP_HOST_SSL_ENABLED=true'
    depends_on:
      plausible-db:
        condition: service_healthy
      plausible-events-db:
        condition: service_healthy
      mail:
        condition: service_healthy
    healthcheck:
      test:
        - CMD
        - wget
        - '--no-verbose'
        - '--tries=1'
        - '--spider'
        - 'http://127.0.0.1:8000/api/health'
      interval: 10s
      timeout: 5s
      retries: 5
      start_period: 45s
  plausible-db:
    image: 'postgres:16-alpine'
    volumes:
      - 'plausible-postgres-data:/var/lib/postgresql/data'
    environment:
      - 'POSTGRES_DB=${POSTGRES_DB:-plausible-db}'
      - 'POSTGRES_USER=${SERVICE_USER_POSTGRES}'
      - 'POSTGRES_PASSWORD=${SERVICE_PASSWORD_POSTGRES}'
    healthcheck:
      test:
        - CMD-SHELL
        - 'pg_isready -U $${POSTGRES_USER} -d $${POSTGRES_DB}'
      interval: 5s
      timeout: 20s
      retries: 10
  plausible-events-db:
    image: 'clickhouse/clickhouse-server:24.3.3.102-alpine'
    volumes:
      - 'plausible-events-data:/var/lib/clickhouse'
      -
        type: bind
        source: ./clickhouse/clickhouse-config.xml
        target: /etc/clickhouse-server/config.d/logging.xml
        read_only: true
        content: '<clickhouse><profiles><default><log_queries>0</log_queries><log_query_threads>0</log_query_threads></default></profiles></clickhouse>'
      -
        type: bind
        source: ./clickhouse/clickhouse-user-config.xml
        target: /etc/clickhouse-server/users.d/logging.xml
        read_only: true
        content: '<clickhouse><logger><level>warning</level><console>true</console></logger><query_thread_log remove="remove"/><query_log remove="remove"/><text_log remove="remove"/><trace_log remove="remove"/><metric_log remove="remove"/><asynchronous_metric_log remove="remove"/><session_log remove="remove"/><part_log remove="remove"/></clickhouse>'
    ulimits:
      nofile:
        soft: 262144
        hard: 262144
    healthcheck:
      test:
        - CMD-SHELL
        - 'wget --no-verbose --tries=1 -O - http://127.0.0.1:8123/ping || exit 1'
      start_period: 30s

Expected behavior

Sending invite links via the setup mailer

Screenshots

No response

Environment

- Host OS: community-edition Docker Container
- Client OS: Windows 10
- Browser: FF 
- Browser Version: 132.0.2 (64-Bit)

[degoya]

tried to test with this method and it get sent aswell and has the correct from data:

you = "[email protected]"
email = Bamboo.Email.new_email(to: you, from: PlausibleWeb.Email.mailer_email_from(), text_body: "test")
Plausible.Mailer.deliver_now(email)

but invite mails stll not sent and i receive an error in the log
2024-11-20T00:45:05.458826769Z 00:45:05.458 request_id=GAmGlKv2xiNKBg0AAALi [error] Failed to send e-mail

i've tested on ports 25, 465 and 587 all send via bamboo but not via the plausible backend,

[ruslandoga]

👋 @degoya

Please use a concrete example for an email address that fails and the one that works. From your configuration it seems you are using a relay but send to port 25, that might work if it coincides with your mail server, but that wouldn't work for someone on, say, Gmail. And please show the configuration you would were using during that test. Right now each new snippet contains different values for SMTP port :)

[degoya]

@ruslandoga i'm using an mailserver that supports port 25, 465 and 587 i've used the same email account/server/settings for sending my mails from V2.0. i've tried every port and all ports send via Bamboo over CLI but noch from Plausibe UI. The Snippets contain different ports because i've tried all of them without any luck. is there a way to get a more detailed error log for the [error] Failed to send e-mail?

[ruslandoga]

Yes, you can connect Sentry by setting SENTRY_DSN env var and it would show the full error message.

[Aboitier]

How do you do that ? Just SENTRY_DSN=true ? I don't see this env var in the doc

[ruslandoga]

Just SENTRY_DSN=true ?

No, you set SENTRY_DSN to your Sentry's DSN. It's usually shown prominently on your "app" page when you create one or when you register.

I don't see this env var in the doc

Yeah, it's not documented.

I think something like this would work. Modifying https://github.com/plausible/community-edition#quick-start

$ echo "SENTRY_DSN=https://[email protected]/xxx" >> .env

$ cat > compose.override.yml << EOF
services:
  plausible:
    ports:
      - 80:80
      - 443:443
    environment:
      - SENTRY_DSN
EOF 

[ruslandoga]

Or you can just manually modify compose.yml and paste SENTRY_DSN there :)

[degoya]

@ruslandoga after setting up Sentry i was able to see the real reason for the problem. The Mail has been rejected by the Mailserver because rspamd classified it as SPAM. So the Error Message was a bit misleading, it would be great to have better Error messages in Plausible and don't need to use sentry to get to this informations. Thanks for pointing me to Sentry, otherwise i would spend another day with the problem.

[ruslandoga]

I agree, the error message can be improved similar to #4657

PR: #4846

[Aboitier]

@degoya So how did you fix it ?

[ruslandoga]

The error reply might include the steps required for the fix, e.g. Gmail requires either SPF or DKIM at the minimum.

[degoya]

@degoya So how did you fix it ?

i've used a mail from the same domain like plausible, then i don't get any SPAM filtering by RSPAMD becuase the domain matches the links in the email. Then the E-Mail gets send without any problems and without being rejected.