Hacker News

Nvidia Kubernetes Engine (NVKE)(github.com)

124 points by gkapur 2 days ago | 29 comments

This is for tenant-isolated k8s clusters using NVIDIA's DSX reference stack, relying on NICo / BlueField to set up isolated networking, and wipes/re-attests each host between tenants. Mostly useful if you're chasing NVIDIA Cloud Partner status or need NVIDIA support across the whole stack.

[–] eel 1 day ago

> Mostly useful if you're chasing NVIDIA Cloud Partner status or need NVIDIA support across the whole stack.

What if I don't care about the cloud partner status or support, but I still have a lot of Nvidia hardware I need to hand out to run isolated workloads? Seems like deploying straight k8s is the way to go?

[–] itintheory 1 day ago

I'm not super familiar with this tool, but I am a k8s administrator. I think it depends on how isolated you need those workloads to be. This seems like a good fit if you want cluster level isolation. There are other projects that implement the Cluster API (CAPI) though, which provide similar functionality, eg declaratively managing tenant clusters.

[–] websap 2 days ago

Its great to see them open source this stack!

Lots of negativity from HN posters who usually manage 3 Kubernetes clusters in a single region via a managed service on AWS or GCP.

[–] debarshri 2 days ago

I got lot of hate too when I tried building a api server compatible engine in rust [1]

[1] https://github.com/debarshibasak/superkube

[–] random3 2 days ago

I just got flashbacks of stuff I forgot long ago like OpenStack and EMC Rex-ray and so many things like that https://www.openstack.org https://github.com/rexray/rexray

[–] esseph 2 days ago

I am seeing a lot of openstack around since Broadcom enraged the vast majority of their vmware customers

[–] Datagenerator 2 days ago

Just deployed OpenStack by using the Kolla Ansible installer. Works great coupled to Ceph for storage. Thanks to Broadcom we are moving in the right direction. Proxmox as fallback plan but it looks like OpenStack is solid.

[–] antimario 1 day ago

This looks overly heavy and non-composable, locking in to one vendor on many levels. I would like to see tools which enrich existing infrastructure in a unix-way

[–] Yasuraka 2 days ago

This seems to mix several (should-be) distinct concerns like CAPI, Kamaji and gpu-operator.

The only things I'd take from this is the kind-based bootstrapper for the management cluster and SPIFFE/TPM integration.

[–] asaiacai 2 days ago

yeah i wish more visibility would go towards CAPI, Kamaji.

tbh i'm not sure from reading this why you wouldn't just roll rke2/k3s if the concern is an environment outside of the well worn hyperscaler managed k8s

[–] jeremy_carroll 2 days ago

This is what happens when AI generates your PR – FAQ. Describe what the product does versus just a data dump.

[–] chandlerh 2 days ago

I’m usually in agreement with this sentiment, but they do say what it is in the first paragraph.

“NVIDIA Kubernetes® Engine (NVKE) provides the management plane that platform teams install to create and operate Kubernetes clusters for their customers.”

[–] hedora 2 days ago

Ok, so say I have a platform team to install k8s or k3s. Why do I need NVKE? Also, how do I resell my kubernetes to customers? Like is there stripe integration?

I am more confused by its description than by just reading the product name and guessing.

[–] Foobar8568 2 days ago

Well one needs to read a bit more to understand what that meant...

NVKE is not a Kubernetes distribution and not a Cluster API flavour. It is a self-hosting factory for Kubernetes clusters: a throwaway seed cluster stands up a management cluster, and the management plane on it then provisions and lifecycle-manages many isolated workload clusters on demand.

[–] adastra22 2 days ago

That doesn’t say anything. It doesn’t answer a single question I would have.

[–] aprdm 1 day ago

maybe you're not the user

[–] adastra22 7 hours ago

I am exactly the potential user of this, as I am currently setting up a small collocated cluster and investigating software for management. But this doesn’t tell me anything that would actually matter in that decision.

[–] yukIttEft 13 hours ago

Will this be contained in the new 2000$ GPU annual fee for Nvidia software or will it need a plus subscription?

https://www.tomshardware.com/pc-components/gpus/nvidia-discu...

[–] jimbokun 2 days ago

Can’t regular Kubernetes also deploy to GPUs?

[–] yjftsjthsd-h 2 days ago

Yes. https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus...

[–] topspin 2 days ago

A mention of something Kubernetes related reached the front page! A few years ago, BAI, there was one or more k8s headlines gracing HN's front page at all times.

Kinda glad that ended. k8s is fine and all, but it was a bit much for a while there.

[–] luipugs 2 days ago

Did you just make an acronym that means "before AI"?

[–] topspin 2 days ago

I did, but I'm not the first. I thought maybe I was, so I checked: apparently it's been bouncing around informally among academics for a while now. I hadn't previously seen it though, so I can at least say I came up with it independently.

I come up with things from time to time. At least one US registered trademark is mine.

[–] wannabe44 2 days ago

Future history books will be like: ancient legacy technology conglomerate Google was founded around 24BAI

[–] qlte 2 days ago

I'd guess us throwing around the word "AI" constantly and endlessly debating p(doom) based on current tech will be considered pretty amusing in the future.

Like reading essays from the late 19th century that can't stop pontificating about living in a boundless technological singularity thanks to railroads and the telegraph. Current hackocalypse discourse already has shades of "the bomber always gets through" from the 20s.

"Sure, people in every era since the Renaissance have foolishly believed they were the ones living on the cusp of uniquely transformative and potentially cataclysmic technological change but ... This Time It's Different"

[–] cma 1 day ago

I can imagine someone saying the same in the 60s: don't sign this nuclear test ban treaty, we have induction from 1300s that.. wait let's chose a time just after the Black Death. We have induction from the Renaissance that proves we always worry too much about these things and therefore nothing is different about this time.

[–] iririririr 2 days ago

pretty sure "before wwiii" will take precedence

[–] HeWhoLurksLate 1 day ago

Or something like 32BAGI