Efficient and portable AI / LLM inference with WebAssembly (CNCF Technical Community Group Meeting):
Efficient and portable AI / LLM inference with WebAssembly 🚀
Part of the CNCF Artificial Intelligence Technical Community Group Meeting Series.
Session Overview 🧠
In this session of our bi-weekly TCG meeting series, we have the pleasure to host Vivian Hu and Michael Yuan from the WasmEdge team, who will be sharing an update with the community on the latest and greatest associated with WasmEdge and how it can support AI/LLM Inferencing use cases with WebAssembly.
Why use Web Assembly 💡
-
Privacy-Preserving Local Inferencing, keeping data on device to reduce egress and compliance risks.
-
Lower Latency By Proximity, eliminating round trips to centralized services.
-
Cost Efficiency For Burst Workloads, paying only for brief execution with rapid scale-to-zero.
-
Simplified Observability And Rollbacks, shipping versioned Wasm modules with predictable behavior
-
Strong Sandbox Isolation By Design, reducing blast radius versus native binaries in multi-tenant scenarios.
-
Fine-Grained Resource Controls, limiting CPU, memory, and I/O for predictable, safer inference.
-
Minimal Attack Surface Compared To Full Containers, improving compliance posture for sensitive workloads.
-
Deterministic Execution Model, aiding reproducibility and safer operations at the edge.
Joining Details 🔑
Joining details for the meeting can be found below; please use your LF username and password to avoid challenges with the joining URL.
Alternatively, use the Zoom login credentials to join the session directly.
Ways To Join The Meeting 🔗
-
Join from PC, Mac, iPad, or Android.
-
Join via audio.
-
One tap mobile:
-
US (iOS): +12532158782,,96058530101#,,,,*290975# or +13462487799,,96058530101#,,,,*290975#.
-
US (Android): +12532158782;96058530101#;290975# or +13462487799;96058530101#;290975#.
-
-
Or dial:
-
US: +1 253 215 8782 or +1 346 248 7799 or +1 669 900 6833 or +1 301 715 8592 or +1 312 626 6799 or +1 646 374 8656 or 877 369 0926 (Toll Free) or 855 880 1246 (Toll Free).
-
Canada: +1 647 374 4685 or +1 647 558 0588 or +1 778 907 2071 or +1 204 272 7920 or +1 438 809 7799 or +1 587 328 1099 or 855 703 8985 (Toll Free).
-
-
-
Meeting ID: 96058530101.
-
Meeting Passcode: 290975.
-
International numbers: https://zoom.us/u/alwnPIaVT.