Cloud Native Aalborg

Securing custom LLMs using HashiCorp Vault and Tools Parade

Attendees:
in-person
Event date
May 23, 24
04:30 PM - 08:00 PM CEST
Location
Netic A/S, 25 Alfred Nobels Vej
About this event

Agenda:

16:30: Doors open, find a seat or network :)

17:00: Welcome by Cloud Native Aalborg

17:05: Welcome by Netic

17:10: Securing custom LLMs using HashiCorp Vault

18:00: Break & food

18:30: Tools Parade

20:00: Thank you and good night!

1#
Securing custom LLMs using HashiCorp Vault
by Nic Jackson from HashiCorp

Building custom Large Language Models (LLM) using private data dramatically benefits your business by allowing the model to understand specific documents and data unavailable in public datasets. However, there are issues with this approach; one problem is how you secure the data used to train the dataset, and another is how you ensure that this data remains private, specifically when using the public cloud. Secondly, how do you ensure that your compiled models are tamper-proof and have not been manipulated by a hostile actor? This talk will show you how to solve both problems using HashiCorp Vault, and how to do it using common Kubernetes patterns that you are used to. You will learn how to install Vault onto your own server using the Helm, how to install the operator, and all the configuration you need to secure and configure Vault. We will wrap up all this in a healthy layer of fun, and as a takeaway, you can try these techniques on your own using the interactive workbook provided at the end of the session.

Speaker Bio:
Nic Jackson is a developer advocate at HashiCorp and has over 25 years of industry experience working with and creating open-source software and distributed systems. One of his core interests is system connectivity and reliability. Nic is the CNCF TAG Network co-chair and a published author working on his second book, Service Mesh Patterns for O'Reilly Media.

2#
Tools Parade
The organisers are showing a couple of tools that we use for working with Cloud Native and Kubernetes and why we think it is useful.
This part of the event is an open part, which means that you can show your tool, og mention your tool and why it is useful for you.
Please  send a message to us -  mention the name of the tool, maybe a link to the tool and the time you need to tell about it.

This will be the last event before summer and we are looking forward to seeing you again after summer.

Agenda
  1. 4:30 PM CEST

    Doors open

    in-person

    Doors open, find a seat or network :)

  2. 5:00 PM CEST

    Welcome

    in-person

    Welcome by Cloud Native Aalborg

  3. 5:05 PM CEST

    Welcome by Host

    in-person

    Welcome by Netic

  4. 5:10 PM CEST

    Securing custom LLMs using HashiCorp Vault

    in-person

    Securing custom LLMs using HashiCorp Vault by Nic Jackson from HashiCorp

    Building custom Large Language Models (LLM) using private data dramatically benefits your business by allowing the model to understand specific documents and data unavailable in public datasets. However, there are issues with this approach; one problem is how you secure the data used to train the dataset, and another is how you ensure that this data remains private, specifically when using the public cloud. Secondly, how do you ensure that your compiled models are tamper-proof and have not been manipulated by a hostile actor? This talk will show you how to solve both problems using HashiCorp Vault, and how to do it using common Kubernetes patterns that you are used to. You will learn how to install Vault onto your own server using the Helm, how to install the operator, and all the configuration you need to secure and configure Vault. We will wrap up all this in a healthy layer of fun, and as a takeaway, you can try these techniques on your own using the interactive workbook provided at the end of the session.

    Speaker Bio: Nic Jackson is a developer advocate at HashiCorp and has over 25 years of industry experience working with and creating open-source software and distributed systems. One of his core interests is system connectivity and reliability. Nic is the CNCF TAG Network co-chair and a published author working on his second book, Service Mesh Patterns for O'Reilly Media.

  5. 6:00 PM CEST

    Food

    in-person

    Food and Beverages and Networking

  6. 6:30 PM CEST

    Tools Parade

    in-person

    Tools Parade The organisers are showing a couple of tools that we use for working with Cloud Native and Kubernetes and why we think it is useful. This part of the event is an open part, which means that you can show your tool, og mention your tool and why it is useful for you. Please send a message to us - mention the name of the tool, maybe a link to the tool and the time you need to tell about it.

  7. 8:00 PM CEST

    Goodbye

    in-person

    The evening finished with some networking and this will be the final event before summer and we are looking forward to seeing you again after summer.

Organizers