Pay up for license to unlock full capacity, pay up for license to use encrypted models from AI moguls, paid per billion tokens processed or just operations in GPU
[–] bayindirh 3 days ago
[–] iamnothere 3 days ago
[–] hhh 4 days ago
[–] novaRom 4 days ago
[–] skew-aberration 4 days ago
[–] bayindirh 3 days ago
Note, these models generally run 60/120/240 FPS depending on the camera range, and can command the connected lenses at ~100FPS (because physics).
[–] jval43 4 days ago
I wonder if this space is explored fully enough at the moment.
Aside from some implementation details, it's conceptually much easier than doing it for a SQL database.
[–] AlAjem 4 days ago
The consumer has access to free and open models for local use.
The supplier has better control and wider market to serve running the models in data centers.
Only way I can see encrypted models being widespread is if they are bundled as part of a software package (OS/Browser/etc) and not sold as the product.
[–] petu 4 days ago
[–] bri3d 3 days ago
And, the same GPUs are run in datacenter, where there's a big insider risk that vendors want to mitigate with encrypted models (if you're Anthropic and you want AWS to host your models, you don't want 5000 or even 500 or even 50 AWS employees with access to your highly valuable/desirable model weights).
[–] sva_ 4 days ago
[–] selicos 3 days ago
There will be ways for them to segment the market and make their money. Maybe not 100x stock in 5 years but money all the same.
Remember, the kernel module is open source, but rest of the driver is closed source, and any kernel level code which can't be open sourced but had to be is moved to card firmware. Only the kernel module is open source. Not the libraries, not the driver, nothing else.
NVIDIA is holding to its pearls like a sloth holding to its branch, because their all business model and livelihood is dependent on that control. I still commend AMD's decision to allow full card enablement with any driver which talks the correct language.