Welcome to another Cloud Native Meetup! This time around both talks are related to AI, not about how AI will not replace your job, but how to create a solutions within environments where AI is used. And that sounds like more work for IT engineers. ;)
AGENDA
18:15: Doors open
18:30: Welcome by Cloud Native Latvia
18:45: Creating Platform That Can Move Where GPUs are Available by Nicklas Frahm @ Corti
19:30: Break with snacks
19:45: Secret Agents: Identity for AI Workloads by Andrey Adamovich @ Nuoxera
20:30: Networking
21:00 Doors close
Talk 1
Creating Platform That Can Move Where GPUs are Available by Nicklas Frahm @ Corti
GPUs are expensive and difficult to procure. That and geopolitical tension have motivated an internal push for a more sovereign infrastructure stack at Corti. Most recently the platform team at Corti has been building an open source Kubernetes engine, called Kommodity, which is based on Talos Linux and Cluster API, as well as a KServe-based inference stack using vLLM and NVidia Triton. Now they are using it to move their infrastructure from Azure to Scaleway.
Talk 2
Secret Agents: Identity for AI Workloads by Andrey Adamovich @ Nuoxera
First we shipped servers, then containers, then functions. Now the AI agent is the new primitive running in our infrastructure — autonomous, ephemeral, and acting on our behalf — and it has an identity problem nobody planned for. This talk shows how to give agents identities that are short-lived, attestable, and least-privilege, so "which agent did this, and was it allowed to?" always has an answer.