Most things don't have the ability to moralize, but if they did, probably more would. There are restrictions on watching adult content in some jurisdictions. I've heard that copy machines will do watermarks (or something like that) if you copy currency. Some cars will brake automatically if they determine you're likely to hit something if you continue (maybe I'm trying to drive through the front of a bank!). Some cars are configured with breathalyzers that need to be passed to start. Etc...
[–] paimapi 2 days ago
On the one hand, I definitely don't agree with the logic of 'don't guardrail me if I don't want it.' I think back on that one video from the late 80s of people talking about how seatbelt mandates were horrible violations of their freedoms (and not like like one second of work and no real discomfort).
On the other, I'd love it if these companies actually produced real research about modern AI-assisted attacks in terms of damage and quantity, and whether or not guardrails even matter when tech like abliteration is in general use.
[–] nsagent 2 days ago
That said, for those who cannot advocate for themselves, like children, I think it's entirely reasonable to hold someone accountable if they decide to forgo an appropriate safety mechanism that results in harm.
[–] cowlevel 2 days ago
I bet cars these days send a flag to the mothership when you drive without one, but the mothership doesn't pay attention to that signal unless it's linked to your insurance.
[–] nsagent 2 days ago
[–] my002 2 days ago
[–] cowlevel 2 days ago
Some copy machines store everything you copy on a hard disk and require a technician visit after you try to copy currency. The technician copies the data from the disk, obviously, before resetting the flag.
The point is that it is very inefficient and problematic for morality decisions and boundaries to be embedded all over at every level in tools, because morality is complex. Morality, or whatever our conception of it is, should be enforced at clearly defined boundaries.
I can relate this concept how I corrected Claude Opus in my software projects recently.
For example, once an authorization engine has been created, all authorization decisions should be deferred to it. Confusion would reign if each web server route decided to enforce its own authorization.
Similarly, if I am using a relational database, that is where unique indexes should be enforced. Application code has no business enforcing it.