Manifestos, Fear, and ‘Loser Thinking’: Inside Proton’s AI Reckoning

Andy Yen, the CEO of Proton, had a message for an worker within the firm’s safety Slack channel who urged the corporate to at the least take a couple of days to pentest newly written code earlier than pushing it reside. “That’s bullshit and loser thinking. Of course it’s possible to be fast and secure,” Yen wrote within the channel on the finish of August. “Stop thinking always of how to be slower, and focus more on how to be faster.”

In a follow-up message, Yen reiterated his level: “only losers think like that.” His final message for the workforce was to “stop lovingly handcrafting all our code and use AI more.”

That change was simply one in every of many who confirmed how Yen and different firm executives are aggressively pushing Proton in direction of AI. Proton is a Swiss firm that famously makes the encrypted e-mail service Proton Mail and a set of privateness and security-focused merchandise, together with an encrypted drive service, an authenticator app, a password supervisor, and extra.

In the previous couple of months, Yen arrange an e-mail tackle for workers to contact if they arrive throughout something blocking adoption of AI at Proton, so management can “ruthlessly smash everything that stands in the way of AI velocity;” Proton put in software program on employees’ computer systems that observe how a lot AI code the corporate is producing; and Yen stated that is the final yr that Proton will rent engineers in any respect, and as a substitute solely rent folks to construct issues with AI.

That AI push got here to move this week when 404 Media reported Proton stated it could re-interview employees about their use of AI, with the clear implication that these interviews, and workers’ willingness to embrace AI, might determine whether or not a employee is fired or not.

404 Media spoke to eight present and one former Proton workers and reviewed Slack chats, assembly recordings, and an AI manifesto written by the corporate’s CTO. Our reporting reveals a tradition of concern inside Proton, the place many workers are hesitant to even mildly critique Yen’s views or focus on engineering issues. Workers describe an surroundings the place workers have real issues about safety or being requested to develop safety merchandise with AI, however really feel unable to voice them, lest Yen berates them in entrance of everybody or threatens their employment on the firm.

“The CEO is in full AI psychosis and has been for a while now,” one of many sources informed 404 Media.

Our reporting additionally paints an image of Proton that’s doubtless very totally different to the general public’s notion of an organization with a purpose of rigorously defending privateness: one which in actuality is barreling forward with AI as rapidly as potential so it could actually obtain the express purpose of extra annual income.

“Due to insufficient velocity,” Proton shouldn’t be on observe to realize its annual recurring income goal by the top of the yr, one inside doc obtained by 404 Media reads. Proton’s year-over-year development can also be “far away from what the market today considers to be good,” and, “By all metrics that matter, we’re an underperforming company.”

In response to detailed questions from 404 Media, a Proton spokesperson didn’t dispute any of our reporting or characterization of what’s occurring inside the corporate. 

“It’s clear that some people at Proton are unhappy with our direction, or misunderstand it, and many people are anxious,” they stated. “In our determination to move fast, we have sometimes been too blunt or too slow in explaining ourselves to our people. We will work on that, as their questions are the ones we most need to answer.”

Yen, a former CERN particle physicist, tasks a measured approach in public, however internally he acts extra like what one worker described as a “petulant child.” In May, Proton announced it was implementing post-quantum cryptography which ought to shield in opposition to future assaults from quantum computer systems. The work took years of effort, with one caveat that it could not work on older emails, solely these written after the characteristic’s launch, at the least for the second. Yen was not pleased that Proton was drawing consideration to this limitation.

In a Slack channel devoted to thanking folks for his or her work, Yen jumped in. “Get it fixed,” he wrote, referring to Proton’s Reddit post announcing the characteristic. “Now Reddit is pissed and we look worse than Tuta,” he added, referring to a Proton competitor. When workers defined to Yen the nuances of the encryption and why that was not instantly potential, Yen wrote, “I find this whole thing stupid. You cannot announce this in this way.”

“Now we are left with two shitty choices. Deprioritize more important tasks for the business to re-encrypt old emails, or constantly get attacked online for not doing it. So maybe you can enlighten me on which of the two shitty choices we will take,” he wrote. “In the future there are two options. Either you guys are confident enough to not fuck this up, or you get my advice to make sure it is not fucked up,” he added. He then informed a member of the workforce that made it to “go on Reddit.”

“So go on there with your personal account and comment to set the record straight,” he wrote. “Perception is more important than truth, the truth doesn’t matter if you don’t win on perception.”

One worker informed 404 Media, “Whatever persona Andy [Yen] has out of Proton, he’s a straight up bully inside. He routinely breaks his little facade in Slack and calls people losers and stupid, often for stuff he’s paying them for.”

Ever since launching Proton Mail in 2014 after the Snowden revelations, Proton has steadily launched new merchandise that make Proton extra of a worksuite than a easy e-mail supplier. More just lately, these merchandise have been centered round AI, with the launch of Lumo, a big language mannequin (LLM) chatbot that the corporate says doesn’t log conversations or practice on consumer information. In June, Proton launched a 2.0 version of its chatbot.

Up till this level, Yen’s public feedback on AI have been comparatively tame. In an August interview with WIRED, he stated Proton is “building AI features and AI tools, because I think if the privacy companies do not find a way to step in to build privacy-first AI, we are essentially ceding the future to tech companies that don’t have the best interests of users at heart,” and that the corporate was “capitalizing” on the backlash to corporatized, invasive AI from corporations like Google. Last yr, Yen and Proton were criticized for statements he made suggesting the Republican Party and Donald Trump could be more durable on Big Tech than Democrats. 

Toward the top of August, Yen’s inside tone on AI shifted to having Proton use it as a lot as potential, and as rapidly as potential, in accordance with the Slack chats and a number of workers.

“The train is coming, get onboard or get crushed. Don’t be the professional fax machine operator in the internet age,” he wrote to the safety Slack channel. “I think by the end of this year most developers stop programming and start writing specs for tests that AI will code and run, to validate AI written code that humans will no longer be able to review. This will be the last year that we hire engineers, and starting next year we hire what we used to call product managers, to build things with AI.”

AI is changing how cybersecurity works, with AI brokers hacking into corporations, and AI aiding within the discovery of gaping vulnerabilities in essential code. Many corporations throughout the privateness and safety house are grappling with find out how to cope with AI, both within the improvement of their merchandise or find out how to defend themselves in opposition to hackers who’re utilizing AI. Some could do that rigorously. Others try to do it as rapidly as potential for revenue. This account of Proton’s personal reckoning with AI offers an unprecedented perception into what is occurring inside one security-focused firm customers particularly belief. 

Initially, utilizing AI was banned inside Proton, however the firm has since permitted AI for all types of use instances internally, together with processing monetary information, drafting customer-facing responses on Reddit and LinkedIn, and writing code “except when that source code contains information that would give immediate advantage to a competitor” or is expounded to “innovation or R&D [research and development],” in accordance with an inside Proton doc seen by 404 Media. Ninety % of code at Proton in October was written by AI, the corporate’s CTO Bart Butler stated in a gathering, in accordance with audio 404 Media obtained. Much of that code is written with Anthropic’s Claude, a number of workers informed 404 Media. And Yen tells workers in Slack chats to make use of Claude, too. 

“We are a tech company against Big Tech who are spending loads on Claude,” one worker informed 404 Media.

In the “bullshit and loser thinking” dialog, one other worker pushed Yen for specifics on making certain that AI-generated code was freed from safety points. “AI won’t magically solve our problems, because security is low in our prioritization at present,” the engineer stated. Yen didn’t reply straight, and went on to insult one of many different workers in entrance of your complete channel. The worker “is saying his usual bs of we can do it but we will be even slower than we are today and I’m saying only losers think like that,” Yen wrote, including that employees ought to immediate “better.”

“You have the models and the time every developer should be doing this and checking their code which they were doing before manually but now they can do faster with AI,” Yen added. (One worker harassed that engineers nonetheless try to construct in a safe manner.) 

The second clear sign that Proton was going deep into AI for a lot of workers occurred when Butler, the CTO, printed a self-described AI manifesto one Friday afternoon final month.

“Your old job is gone,” the manifesto, posted to Slack, informed engineers. It laid out a future for Proton that totally embraced AI, and stated if the corporate didn’t achieve this, that posed an “existential threat to the success of the mission itself.”

Butler stated that Proton wants to vary in three key methods: settle for that an engineers’ job is now to assist LLMs write higher code, quicker; that Proton must get to the purpose the place most code shouldn’t be reviewed by people however by AI; and to extra essentially change the corporate as an entire, and “commit, as an organization, to the transformation that the moment requires.”

One Proton worker replied in Slack, “Perhaps scaring people with: We are in a new world. ‘Programming’ is dead […] your old job is gone wasn’t really necessary on a Friday afternoon.”

Butler replied, “It’s supposed to be provocative, because it needs to be. I suggest you read it, think about it over the weekend, and come with your questions to me on Monday rather than on Slack. Thanks!”

An worker informed 404 Media, “​​People were surprised and somewhat cringed out, since the document clearly exaggerates what you can do with LLMs today and doesn’t address any of the problems you get in return for giving up your code base to the AI Jesus (e.g. AI cannot really maintain a large code base over time).” Another referred to as it “ethically bankrupt.”

Earlier this week, Proton despatched the e-mail to workers saying they might re-interview employees about how they use AI of their jobs. The tone was clear; you could lose your job due to these interviews, present workers informed 404 Media. “These re-interviews are consequential,” the e-mail learn. Soon after, a senior worker spoke up in Slack to Yen concerning the re-interviewing course of. He advised as a substitute that Proton detect who’s falling behind and assist them and implement prime quality coaching.

Yen’s response was blunt: “Let’s put it this way, we already know more or less who is behind. If we were giving up on them, we would not bother with this process.”

The worker replied, “That messaging is fear-based. Which is probably why I suspect there are dozens of other employees watching us talk about this live and except for [other employee] no one else is chiming in.”

“People shouldn’t be scared to talk about this in public and to push back on you and leadership. A fear based culture feels like a cancer to me. It’s the opposite of engineering, you need to talk about things, even uncomfortable things,” they added. Yen ultimately informed the worker, in entrance of everybody: “If you are making the accusation that this is a financially driven decision and you don’t trust me when I tell you it’s not, then I think this might not be the place for you.”

Only one different worker chimed in throughout that change: “It’s about the culture you instil, people don’t want to feel like they’re on a tightrope, and yes we understand you want to move fast but there needs to be a balance, people also need support, not everyone is the same.”

“It was also faster for my parents to beat me until I ate my vegetables but I’m not sure it was healthy,” they added.

The change with Yen was uncommon not solely in that somebody was debating a few of Yen’s concepts, but additionally that it straight referenced the tradition of concern at Proton. “Whenever someone talks back to Andy it tends to be highlighted since very few people talk back to him,” one worker informed 404 Media.