You conveniently omitted the critical word: science. Not nearly everything that involves design and those others is engineering. You know, the whole "necessary but not sufficient" thing in logic? Engineering is almost diametrically opposite to "vibing", and trying to call prompting-based LLM coding "engineering" is a massive insult against all real engineers who know that vibing can get people maimed or killed.
You are generalizing all llm-aided building to "vibing", which is not the case..and most engineering are based on science but they are not scientist (i.e discovering new science).
I think of a lot of people with this mindset never built anything substantial with the new tools to understand the new set of challenges with these processes and systems. It makes sense given your/their negative take on it which doesn't allow any room for exploration.
I think it is mostly pride issue honestly, because you use terms such "insult" and "real engineers etc". Some are learning and using those new tools and others are refusing given their pride. Similar to how Blackberry executives dismissed iPhone as a toy, and the rest is history.
Translating terms that are basically proper names is not trivial, and Apple loves to give these catchy quasi-proper names for their features. Often it can be better to leave them untranslated.
They are translated on your average Linux distribution though, you won't see nautilus but "Files", gnome-software but "Software", Gnome snapshot but "Camera" (I've put the English term here but each term will be translated to your language). See https://apps.gnome.org and switch the language to see.
In comparison, both MacOS and Windows look more amateur with some leftovers not translated. (Like "Windows Update" on Windows for example)
Well yes it's translated by amateurs but as for the result, both KDE and Gnome are miles ahead in terms of translation quality compared to MacOS or Windows.
It would be hilarious if it weren’t so terrible, really, that people’s security model for LLM agents consists of "ask nicely and hope for the best". It’s like asking people nicely not to exploit a glaring XSS vuln on your site and calling that a "security model". The field truly has lost its collective mind.
And if one is going to argue that we all have lost our minds and that eg. enabling the computer use function is so terribly risky and unreasonable, then I'd want something more concrete than an active imagination.
It seems to me that tens of millions of users are using these features with no known noteworthy incidents, so I'm going to need to see some facts to convince me that the risk is unacceptable.
That said, I would not connect AI to my mails or chats.
How Meta secures (or apparently doesn't) supposedly confidential source code inside the dedicated cloud VM they offer with their tool hardly seems related here.
The question was whether instructions to ask for your confirmation if something unexpected comes up increase safety when using AI agents. Or whether the agents are so likely to go off course that using features like computer use is generally inadvisable.
The incident you mentioned does not seem relevant to these questions.
Both are about alignment. Muse wouldn’t have done that if it had been aligned to what Meta wants, which presumably includes "pls don’t exfiltrate confidential files". The agent in TFA wouldn’t even have considered entering the user to random possibly binding contracts without asking beforehand if it had been aligned.
If you did not yourself intentionally sign something, in sound mind, it’s obviously not binding. But ultimately it’s up to a court to decide if you’re telling the truth that you didn’t do it.
No, application of the principal of respondeat superior would most likely be applied to an AI agent the same as a human employee. An employer is held responsible for the actions of an employee even if it is clearly contrary to their intentions.
Fair point, but I’m not sure that applies to an employee literally forging the employer’s personal signature. And equating a user–computer program relationship with an employer–employee relationship (where there’s an actual contract to that effect) doesn’t feel right anyway. Agents are still just programs and programs cannot enter contracts (like employment) given that they are not persons. This is a computer system malfunctioning.
Edit: after thinking about it more, the relationship here is obviously that of a user and a tool, not an employer and an employee. Talking about employees is anthropomorphization.
In general the user of a potentially dangerous tool is criminally and civilly liable if the tool malfunctions – unless it can be shown that the tool was used and maintained correctly and the malfunction couldn’t reasonably have been predicted or prevented. And I’d say it would be rather difficult to argue at this point that LLMs doing unintended things couldn’t have been foreseen.
So I think I’ve changed my mind about this case. The user of free-range agents does definitely deserve any civil or criminal consequences of their reckless usage.
that is a specific legal fiction that has both historical precedent, and can and frequently is disregarded by courts based on the circumstances (the piercing of the corporate veil).
This opens obvious loophooles. If you had deleted all logs and trajectories, courts can't trace it. Law wasn't written for or has caught up to non-human entities capable of autonomously acting
Wrong. Have you read your agents TOS? You run the agent, you accept all responsibility for what it does. You are free to sue Anthropic to try and get your money back but you already indemnified them of liability, so good luck.
The GP asked what happens if THEY did it, and they are (I give them the benefit of doubt, though you can’t be sure these days) a natural person. A clanker obviously can’t commit forgery – or any crime, being a nonperson – and sure, you can’t sue OpenAnthro Corp. if their clanker does anything unintended (which makes it utter lunacy that companies just blindly trust these things, but I digress), but that’s not what was asked.
But also, you can’t ToS your way out of criminal responsibility. If OpenAnthro Corp. offered services of human agents (remember those?!) and one of their agents committed a crime while working on a client request, no ToS in the world would exonerate them.
reply