I mean, assumming that the sender doesn't have broken SMTP client or doesn't follow standards.
It's gmail's user's problem if they don't accept mail or check their Junk folder or use an e-mail provider that they can't contact to solve issues on their side.
In the old days, if I didn't receive mail because my mail provider was rejecting it, it was me who had to talk to them. Free has a cost. And it's gmail users who should be paying it in their time and fruitless attempts at communicating with google. At least they'd realize what company they're enabling and how much it doesn't care about their e-mail.
> In the old days, if I didn't receive mail because my mail provider was rejecting it, it was me who had to talk to them. Free has a cost.
In the old days average email user was being inundated with low-quality spam and getting mired in fraud. Google fixed that problem for their end users. In doing so, they made it hard for a small % of people who want to run their own email servers, but they've given all of these people an out -- go sign up with someone who knows what they're doing, and google is going to effectively outsource the fraud/spam management to those companies.
You can tell me I have it wrong but I'm literally just describing the landscape that actively exists and how to navigate around it for anyone who wants to, but you're not taking out google.
That suggests a simple solution to the problem that can be done on the gmail side: for any small mail server (to pull a number out of my behind, say less than <200 emails a month to any @gmail address for the last 12 months), white list them if they satisfy the rest of the usual requirements.
Even if someone attempts to game the system and creates a number of servers, for an effective spam campaign it means a large number of servers, costs go up.
It might be worth experimenting with "abusing" this behaviour to put your small server on the Gmail whitelist. Start sending a large number of generated emails to a @gmail.com mailbox, log in and ensure none of it ends up in spam (ideally automate that too :), and there we are. Anyone have any idea how many emails that is? :)
That said, like the OP, despite having DKIM, SPF, proper DNS, and every other measure applied, it's conceivable that gmail might reject some emails from us. I don't have any memory of that actually happening, but I have heard stories like the OP's several times. It's a fairly common topic in conversation forums about self-hosting email servers. I don't expect the situation to change any time soon—I don't expect Google to change their ways and it would require significant pain for me to surrender to the gmail hegemony.
Best to assume gmail is flawed, which it is, as the parent poster did. At some point Google will realize the image problem and act.
Now that I live in a lot of Gmail accounts, the Spam folder is just another folder I have to check on a weekly basis.
I still have quite a few a accounts under Gmail, but I'll probably do a full change this year.
Having control of my email is very important for me. Google could close my account for any number of reasons (billing dispute, hacked account, etc), and I would lose my actual address since the domain isn't mine
I do have a very old address that is on my own domain, and though that is currently routed to Google, at least that simplifies things a lot, but unfortunately for many years I was not consistently using that address for signing up to things etc.
If anything, it means that teams are probably too independent and that there is no central approval process for things like sending emails.
For example, a lot of companies use products like Greenhouse. I am sure this will send email from your domain on your behalf. If you don't know what you have to talk to the DNS administrators to add a bunch of TXT records to enable that, you will just notice that some percentage of emails never get delivered (or if the product doesn't tell you that they're bouncing, you may never know. how could you?)
If you use something like Zendesk, you'll note how many people have been burned by this. By default, they end up using something like support.yourdomain.com because despite detailed instructions on how to set up the necessary DNS records to send email from youdomain.com, people still fail to do it right and then complain "nobody ever sees my support tickets".
My point is, email has been abused so heavily that it is somewhat difficult to set up a working system. That was my experience when I ran my own email server. Although I did OK with delivery, I also aggressively filtered messages and used greylisting. This broke a lot of broken email systems, whose administrators immediately blamed me. (I had a long back-and-forth with some company that wanted to hire me. Their email system was super broken. They blamed me and said that they weren't interested in a programmer that couldn't set up a mail server. LOL.)
Tangent, but this kind of stuff is super annoying and probably happens far more often than anyone wants to admit. A few friends and I have been commiserating re the incompetence of potential employers who've rejected us because of their own misconfigured environments or fundamental misunderstandings of the systems they run. We had one interviewer close out a candidacy because the code sample "didn't run" on their interview's system -- the traceback showed he had a broken half-Py2/half-Py3 install.
Hey, at least they're _trying_ to migrate to 3 :P