Sovereign AI has never been more important.
Controlling AI is so much more powerful and impactful than controlling search or social algorithms.
Centralized AI a 10x on social control over everything we have seen before, and there is no way that a free and open society survives contact with centralised, high capability AI if the system is manipulated towards guiding outcomes. It’s essentially mind control, as people will offload an even greater share of their cognition to AI than they do with search and social.
Build and maintain sovereign AI while you still can.
[–] GuB-42 4 days ago
[–] Schlagbohrer 4 days ago
[–] FuriouslyAdrift 3 days ago
These are multi-million dollar datacenter systems, not consumer. If you mean the consumer market, it's coming but it's going to be 2028-29 most likely (if the bubbled hasn't popped by then).
Strix Point is quite good but not the same thing as a DGX, though. Same idea, different methodology.
[–] smallmancontrov 3 days ago
[–] Fr0styMatt88 3 days ago
I miss the old days when they released enthusiast products like the R9 295X2. Though that’s just the gaming enthusiast market in general declining (not that this happened organically though, it feels like a deliberate choice).
[–] SR2Z 3 days ago
I have many pleasant memories of keeping myself warm just by opening Witcher 3 on my R9 390.
[–] FuriouslyAdrift 3 days ago
AMDs revenue this quarter just passed Intels for the first time in history and they still are dominating in the HPC market which is fairly immune to the AI bubble (while also selling everything they can build at a high premium to AI datacenters).
AMDs margins on their Instinct datacenter GPUs is nearly as good as nVidia's. They just can't get contract volume at TSMC to make more because nVidia buys all of it.
[–] Betelbuddy 3 days ago
https://d1.awsstatic.com/onedam/marketing-channels/website/a...
[–] podocarp 4 days ago
[–] tiahura 3 days ago
[–] sidewndr46 4 days ago
[–] smolder 3 days ago
[–] embedding-shape 4 days ago
[–] CamperBob2 3 days ago
[–] giwook 3 days ago
They're still getting plenty of Nvidia GPUs. Someone in Jensen Huang's inner circle apparently runs a number of companies in Singapore that have been found to source GPUs at scale. The catch is that she has close ties to Beijing and is suspected of working closely with their government, potentially even spying for them.
This was reported just a week or two ago and is just one example of how China is still getting their hands on resources they're supposedly unable to get.
[–] zelphirkalt 3 days ago
[–] InsidiousWombat 4 days ago
Pay up for license to unlock full capacity, pay up for license to use encrypted models from AI moguls, paid per billion tokens processed or just operations in GPU
[–] bayindirh 3 days ago
Remember, the kernel module is open source, but rest of the driver is closed source, and any kernel level code which can't be open sourced but had to be is moved to card firmware. Only the kernel module is open source. Not the libraries, not the driver, nothing else.
NVIDIA is holding to its pearls like a sloth holding to its branch, because their all business model and livelihood is dependent on that control. I still commend AMD's decision to allow full card enablement with any driver which talks the correct language.
[–] iamnothere 3 days ago
[–] hhh 4 days ago
[–] novaRom 4 days ago
[–] skew-aberration 4 days ago
[–] bayindirh 3 days ago
Note, these models generally run 60/120/240 FPS depending on the camera range, and can command the connected lenses at ~100FPS (because physics).
[–] jval43 4 days ago
I wonder if this space is explored fully enough at the moment.
Aside from some implementation details, it's conceptually much easier than doing it for a SQL database.
[–] AlAjem 4 days ago
The consumer has access to free and open models for local use.
The supplier has better control and wider market to serve running the models in data centers.
Only way I can see encrypted models being widespread is if they are bundled as part of a software package (OS/Browser/etc) and not sold as the product.
[–] petu 4 days ago
[–] bri3d 3 days ago
And, the same GPUs are run in datacenter, where there's a big insider risk that vendors want to mitigate with encrypted models (if you're Anthropic and you want AWS to host your models, you don't want 5000 or even 500 or even 50 AWS employees with access to your highly valuable/desirable model weights).
[–] sva_ 4 days ago
[–] selicos 3 days ago
There will be ways for them to segment the market and make their money. Maybe not 100x stock in 5 years but money all the same.
[–] Geof25 4 days ago
[–] ReptileMan 4 days ago
[–] motbus3 4 days ago
[–] somat 4 days ago
So it is something that has been done for a long time now. Still feels like unethical rent-seeking that should not be tolerated by the customer.
See Also: car companies that charge additional fees for hardware already on the car. Additional services, I sort of understand(remote start via cell network), but stuff like heated seats, that is just wrong.
[–] esseph 4 days ago
Yep, "Batterygate"
https://www.npr.org/2020/11/18/936268845/apple-agrees-to-pay...
[–] motbus3 4 days ago
[–] mschuster91 4 days ago
It saves the car manufacturer on logistics cost. The per-unit cost of a seat heater is (much) smaller than the cost related to keeping two variants of seat in stock and to provide spare parts. Say the heating mat costs 100€ per seat including materials and installation, and can be sold to the customer for 400€ permanent, that means as long as 1 in 4 customers buys the seat heating option, the books are balanced, and all money you save on logistics is pure profit.
Adding subscription on top of that is financially even better, if there is one thing companies LOVE thanks to stonk market incentives it is monthly recurring revenue.
[–] motbus3 4 days ago
I think more than that, it is probably a lie they tell us that you are not paying for the hardware/equipment.
[–] somat 3 days ago
Yeah, Nothing morally wrong there.
[–] podocarp 4 days ago
[–] graemep 3 days ago
A license has zero marginal cost in the first place. Software distribution over networks have a negligible marginal cost. An ebook as zero margin cost. We are constantly paying lots of things with zero or negligible marginal cost.
[–] xhkkffbf 3 days ago
[–] graemep 3 days ago
[–] SoftTalker 3 days ago
[–] boltzmann64 4 days ago
AI is a software just like operating systems and executables where open source absolutely dominates the industry. Remember when the compiler engineers optimized the shit out of llama.cpp.
Right now the bottleneck for AI software is compute and data. Moore's law is give us compute, StackOverflow, arXiv (and it's children like bioRxiv), gutenberg and others (3lib, anna, internet.org) will give us data.
It's a waiting game. Open source always wins.
[–] torben-friis 4 days ago
Tons of stuff happenning behind closed doors today though. No more stackoverflow for the next decade, that could create a problem if all new context only exists in chatgpt conversations only openAI has access to (or whoever).
[–] Helmut10001 4 days ago
[–] oblio 3 days ago
Based on... what? Thoughts and prayers? Feelings? Vibes?
I don't know if you looked around but open source is basically unusable for the largest platform in the world, mobile.
The next platform, whatever that is, will also be closed source (maybe VR, once it finally matures...).
LLMs are closed source, is there even 1 (ONE) LLM which is both open source and open weights and publishes its training data and methodology and is also remotely competitive with the frontier lab LLMs?
Consoles are closed source. Appliances are closed source. Embedded devices are closed source.
Even the web is basically closed source. Blobs of encrypted, obfuscated JS used to serve news pages (!).
Maybe I'm looking in the wrong places, but closed source has won.
[–] lilbigdoot 3 days ago
[–] oblio 3 days ago
And regarding servers, who cares? The platforms users interact with are their clients and the actual server software on top of the Linux OS is closed source 99% of the time.
Don't post lazy comments.
[–] FartyMcFarter 4 days ago
[Hanlon's Razor] This is such a contrived performance drop scenario that I find it hard to believe it was done with the purpose you're inferring.
I'd interpret this as Nvidia not caring that much about Linux desktops/laptops once again (as opposed to Windows desktops/laptops), rather than anything to do with local vs cloud.
[–] keybrd-intrrpt 3 days ago
Even that argument is weak - the DGX Spark is Linux, and the RTX Spark is practically the same exact chip.
Sorry to remind people of HN, but most of the consumer market still runs Windows. This was a joint project to have a consumer-level Windows-on-ARM machine, likely requiring lots of development efforts from both NVIDIA and Microsoft.
So, for these specific laptops, they put 100% of their attention for it to be on Windows for launch to capture as much market mindshare as they can. Local AI, Graphics and creative work, and some gaming.
I doubt Microsoft would have been happy about NVIDIA having Linux on their laptop right at launch.
Market Share by OS for consumer laptops & desktops:
• Windows: 76.65%
• OS X / macOS (Combined): ~15.67% (OS X at 9.86% + macOS at 5.81% due to user-agent reporting quirks)
• Linux: 5.63%
• Chrome OS: 2.04%
[–] duskdozer 4 days ago
[–] pantalaimon 3 days ago
[–] joshspankit 4 days ago
[–] tranceylc 4 days ago
[–] pbasista 3 days ago
[–] 4ggr0 3 days ago
[–] buggeryorkshire 3 days ago
[–] rkozik1989 4 days ago
[–] phoghed 4 days ago
Who exactly?
[–] smolder 3 days ago
Beyond him, I would bet most of his bilderberg group friends agree. E.g. Peter Thiel, the owner of JD Vance.
[–] nonethewiser 3 days ago
This is a linux driver problem. On laptops designed for windows.
Read the article and stop sensationalizing.
This is a problem on the MSI Prestige laptop using the RTX Spark platform and Linux. Lets assume it also applies to the Asus and Dell machines using RTX spark and Linux.
RTX Spark is a new platform and all of these laptops ship with Windows. You cant get Linux on any of these machines from the factory. NVIDIA may even ship drivers for linux later as they did with Dynamic Boost.
Kindly remove this from your list of "Evidence that NVIDIA is Colluding to Centralize Inference" and everyone else take note of this confirmation bias in action.
[–] advael 3 days ago
[–] prcrstntr 3 days ago
[–] rcxdude 3 days ago
[–] advael 3 days ago
[–] nomel 3 days ago
edit: even more important for mobile computers
[–] advael 3 days ago
[–] nomel 3 days ago
That them trying to protect IP around something very profitable isn't crazy. That not being fully supported in Linux, when the product was literally designed around Windows, also isn't crazy or really evidence of anything, including evil (see the whole fucking history of Linux compatibility of made-for-Windows hardware).
Maybe let them cook.
[–] Peaches4Rent 3 days ago
It obviously can't be because of ulterior motives!
[–] saidnooneever 3 days ago
nvidia has always been crap like this. Look at amd and intel, they let u write proper drivers (even if its real difficult to do so). No encrypted blobs or voodoo needed.
the nvidia drivers u need to use a card on Linux are unintelligible binary blobs. thats sad as it is. this is worse. they might give some shitty blobs at some point, after they made enough ppl give up on it and switch to give them and their partners their money, souls and firstborn
[–] shevy-java 3 days ago
[–] ErroneousBosh 3 days ago
Is the problem one that could be easily countered by assuming that laptops are generally better when they're not on fire?
[–] Matl 3 days ago
No. It's 'the NVidia way or the highway' problem. NVidia is so full of themselves they refuse to work under anyone's rules (i.e. the Linux kernel where they're constantly trying to work around them).
They're egomaniacs who are so full of themselves, riding high on the AI bubble, they think they're above everyone else in the ecosystem, while utilising all kinds of other people's work for their own benefit.
Look at the way they develop their 'open' Linux drivers where it's just a shim that loads a huge binary blob off the GPU rather than a proper driver like amdgpu has.
Meanwhile they wouldn't be a $5T company without Linux and the wider FLOSS ecosystem.
It's kind of like when Secure Boot debuted and the plan was to allow only Windows with it enabled, then no doubt someone would claim the fact that only Windows can boot with it enabled as a 'Linux driver problem'.
[–] Fr0styMatt88 3 days ago
[–] mywittyname 3 days ago
Claude, make a driver that runs at full capacity on my laptop. (make no mistakes).
[–] alexgoodhart 3 days ago
[–] user01237123674 3 days ago
[–] jhowards 3 days ago
[–] terabyterex 4 days ago
[–] Roark66 3 days ago
[–] lp92 2 days ago
[–] f6v 4 days ago
As in, make your own inference and training hardware?
[–] embedding-shape 4 days ago
[–] f6v 4 days ago
[–] lcampbell 3 days ago
Sovereign AI is less about being able to build it from first principles and more about being able to tinker and modify what already exists. I can’t train a 30B model, but I can modify the weights of one. I can’t fab my own chips, but I can putter with the software that interfaces with them.
Sovereignty is lost when encryption hides your toys and attestation tells you “you may not”.
[–] f6v 3 days ago
Estonian only has sovereign AI as long as they’re allowed to buy from Nvidia. Oh wait, they’re already restricted in what they can get.
[–] embedding-shape 2 days ago
But those servers most likely use CPUs not made in China, if I were to hazard a guess, doesn't that mean that that AI isn't "truly sovereign" in your mind then?
[–] hoppp 4 days ago
I stopped using my laptop for dev and switched to talking to claude code on my phone and as you can imagine I am faster at producing code.
100% cloud with a single entry point device to manage dedicated servers + agents
Nothing stops you from giving Nvidia half a million for their latest and greatest AI GPUs, unless you are in China I guess, but China does very well despite the export control.
It is just classic market segmentation, the thing Nvidia and just about every company that can benefit from it has done for decades. Cloud providers are ready to pay a lot of money, consumers wanting local AI have a lower budget, and gamers even lower. But a low budget is greater than zero, and there is still money to be made on these markets. But they also don't want to compete against themselves, so they are going to find ways of crippling enterprise-class workloads on consumer hardware.
It used to be that they crippled high precision arithmetic on consumer hardware, because it was a differentiating factor, but AI doesn't care about high precision, so now, it is something else.