Open Source Summit North America 2025: Full Schedule

June 23 - 25, 2025
Denver, Colorado
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit North America 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Mountain Daylight Time (UTC/GMT -6). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

arrow_back View All Dates

9:50am MDT

Regression Testing Boot-time Performance in the Linux Kernel - Tim Bird, Sony

Tuesday June 24, 2025 9:50am - 10:30am MDT

Bluebird Ballroom 2B

There are numerous tools to measure boot-time performance of Linux. However, there is no standard regression test of boot performance for Linux. This is due to a number of factors, including disparities in system performance, different requirements for quickly-needed functionality, and differences in bootloader, kernel and user-space configuration. In this session Tim will present a boot-time regression test that utilizes a collection of reference value data files for different platforms, kernel versions and configurations. A meta-data matching system is used to select an appropriate reference data file. Boot time data (including initcall durations, and the durations of pre-selected boot operations) is compared with reference values, in order to report regressions in boot-time duration for specific elements of the boot sequence. The upstream status of this effort, along with the test and supporting tools, as well as issues found with this approach, will be discussed.

Speakers

Tim Bird

Principal Software Engineer, Sony

Tim Bird is a Principal Software Engineer for Sony Corporation, where he helps Sony use Linux and other open source software in their products. Tim is the organizer of the Linux Boot-Time Special Interest Group and is involved with various Linux Foundation projects (including being... Read More →

Tuesday June 24, 2025 9:50am - 10:30am MDT
Bluebird Ballroom 2B

Embedded Linux Conference

Audience Experience Level Intermediate

9:50am MDT

Skip the Wait: Maximizing SPI Throughput in the Linux Kernel With SPI Offloading - David Lechner, BayLibre

Tuesday June 24, 2025 9:50am - 10:30am MDT

Bluebird Ballroom 2A

SPI offloading is a new feature slated to land in the 6.15 kernel. Come learn what it is and what it can be used for.

“Offloading” is a generic term that refers to using additional hardware connected to a SPI controller to handle tasks traditionally done in software, like initiating a SPI transfer and handling an interrupt when the transfer is complete. Having these functions offloaded to hardware is useful for applications like high speed data acquisition (think 1 million samples per second for an ADC) or to meet latency requirements (think CAN bus controller).

In this session, we will cover the thought process that went into designing an interface that can handle these varied applications and the solution we arrived at. We will also take a side trip to discuss hardware triggers that can be used as part of the SPI offload functionality and how they could potentially become a standalone subsystem for generic hardware triggers. Then we will take a look at how we put it all together in a real ADC driver to get 2.5 million samples per second. Finally, we will cover other potential use cases for SPI offloading and how one could go about adding support for these.

Speakers

David Lechner

Sr. Software Engineer, BayLibre

David Lechner is an embedded software engineer at BayLibre. He has been working with embedded Linux systems since 2013 and is the kernel maintainer for LEGO MINDSTORMS EV3 among other things. He also has a background in electrical engineering and industrial automation.

Tuesday June 24, 2025 9:50am - 10:30am MDT
Bluebird Ballroom 2A

Embedded Linux Conference

Audience Experience Level Intermediate

11:00am MDT

Bring the Power of Wireshark To Syscalls and Logs With Stratoshark - Gerald Combs, Sysdig, Wireshark Foundation

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 2F

Stratoshark is a powerful system call and log analyzer built on Wireshark's ubiquitous exploration, drill-down, and analysis capabilities. It is enriched with data sources from the libraries of the open source detection engine Falco, the standard for cloud-native threat detection. Stratoshark enables deep analysis and troubleshooting across Linux servers, Kubernetes clusters, and any system that generates Linux system calls or real-time log events. But fear not, Stratoshark maintains Wireshark’s classic, intuitive interface.

In this talk, Gerald Combs, the creator of Wireshark and co-creator of Stratoshark, will provide an update on the project since its announcement in January and showcase a live demo of Stratoshark, including how it extends the familiar Wireshark user experience to system calls and AWS audit events. Learn how Stratoshark builds on a legacy of open source innovation to broaden and modernize Wireshark’s range of use cases into cloud-native computing.

Speakers

Gerald Combs

Director of Open Source Projects, Sysdig, Wireshark Foundation

Gerald has the great fortune of working with fantastic open source teams as part of Wireshark's leadership and at Sysdig.

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 2F

Cloud + Containers

Audience Experience Level Intermediate

11:00am MDT

Towards Confidential AI for the Masses! - Julian Stephen & Michael Le, IBM

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 2G

Confidential AI leveraging GPUs can bring AI to the masses without sacrificing the privacy of end users. Individual open source technologies already exist to configure, deploy, and manage confidential TEEs. However, clobbering a multitude of components into a coherent, secure, and efficient solution is challenging with many pitfalls. For example, depending on use cases and involved parties (cloud/model/service owners), attestation and key management methodology can vary drastically. In addition, for TEEs with confidential GPUs, complexity extends to increased load times, affecting services that serve multiple models.

This talk will go through key components and design decisions needed to enable confidential AI. Specifically: i) implications of different trust models on the solution and (ii) performance tradeoff considerations. To concretize the discussion, we will present a detailed end-to-end 'how to', for deploying an inference service on Nvidia H100 GPUs and AMD-based TEE with a focus on protecting the model and the user input. The audience will be able to appreciate why there can be no one size fit all confidential AI solution and understand what design works for them.

Speakers

Julian James Stephen

Research Scientist, IBM

Julian Stephen is a research scientist in the security group at IBM T. J. Watson Research Center, NY. He is interested in building systems and models that solve real world problems without compromising security and privacy of data. He received his Ph.D. in Computer Science from... Read More →

Michael Le

Security Researcher, IBM

Michael is currently a research staff member at the IBM T. J. Watson Research Center. His general research interest is in systems security with a focus on containers, virtualization, operating systems, and confidential computing. He enjoys long hacks in the kernel.

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 2G

Cloud + Containers

Audience Experience Level Intermediate

11:00am MDT

Sensor Data Acquisition With Linux's IIO Subsystem and Libiio - Robin Getz, MathWorks

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 2A

This presentation showcases optimizing sensor data acquisition for embedded systems using the Linux IIO subsystem and libiio, with a special focus on developing algorithms on the host to capture data from remote hardware. The IIO subsystem offers a versatile framework for interfacing with sensors like ADCs, DACs, and IMUs, streamlining the management of diverse data streams. With libiio, developers can capture data from remote devices efficiently, simplifying integration and allowing for sophisticated data processing in user-space applications. We explore the architecture of the IIO subsystem, highlighting its modular design that enhances scalability and adaptability in embedded settings. The paper also covers practical methods for configuring and optimizing IIO drivers to improve performance and reliability. Real-world examples with Raspberry Pi demonstrate how libiio supports the rapid prototyping and deployment of sensor applications, with an emphasis on developing algorithms on the host. Attendees will learn best practices for creating high-performance data acquisition systems that ensure seamless integration and efficient resource use across distributed systems.

Speakers

Robin Getz

Senior Engineering Manager, MathWorks

Director of System Engineering with 20+ years in embedded systems. Skilled in management, product development, and systems architecture. Passionate about sensors, data acquisition, and SOC designs. I focus on innovation, and delivering quality user experiences.

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 2A

Embedded Linux Conference

Audience Experience Level Intermediate

11:00am MDT

Three Decades in Kernelland - Jonathan Corbet, LWN.net

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 2D

The Linux kernel project has been going for well over 30 years. From its beginnings on floppy diskettes and beige boxes through to its current home in pockets and unseen data centers, the kernel project has been a constant exercise in rapid development and adaptation. I have been present for almost all of the kernel project's history as an observer, contributor, maintainer, and more; all that experience will be boiled down into a fast-moving tour of how the kernel got to where it is, what makes it successful, and what may be coming next.

Speakers

Jonathan Corbet

Executive editor, LWN.net

Jonathan Corbet is the kernel documentation maintainer, co-founder of LWN.net (and the author of its Kernel Page), a member of the Linux Foundation's Technical Advisory Board, and the lead author of Linux Device Drivers, Third Edition. He lives in Boulder, Colorado, USA.

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 2D

Linux

Audience Experience Level Intermediate

11:00am MDT

Open AI (Two Words): The Only Path Forward for AI - Matt White, Linux Foundation

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 3E

The exponential growth in artificial intelligence capabilities has been fundamentally driven by open science and collaborative research. From the publication of the "Attention Is All You Need" paper that introduced the Transformer architecture to OpenAI's strategic release of GPT-2, openness has repeatedly catalyzed breakthrough innovations while enabling crucial public discourse around AI's implications.

This talk presents a compelling case for why open source development is not just beneficial but essential for the future of safe and equitable AI. We'll examine how the open-source ecosystem has democratized access to AI technology, enabled transparency and innovation, and fostered a global community of researchers working to ensure AI systems are robust and aligned with human values.

Through concrete examples, we'll demonstrate how open-source initiatives have already begun addressing critical challenges in AI development. The Model Openness Framework has established clear standards for transparency, while the pioneering OpenMDW license has created a legal framework for responsible sharing of AI artifacts.

Speakers

Matt White

GM of AI, Executive Director, PyTorch, Linux Foundation

Matt White is the Executive Director of the PyTorch Foundation and GM of AI at the Linux Foundation. He is also the Director of the Generative AI Commons. Matt has nearly 30 years of experience in applied research and standards in AI and data in telecom, media and gaming industries... Read More →

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 3E

Open AI + Data

Audience Experience Level Intermediate

11:00am MDT

Building InnerSource Community: What Goes Behind the Scenes? - Shanmugapriya Manoharan, IKEA (Ingka Group)

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 3C

InnerSource involves much more than just opening up the codebase for reuse & contribution. So much nuanced, time sensitive work is done by maintainers behind the scenes to nurture a community around an InnerSource project - answering queries from the community in a timely manner, finding & promoting project to right customers (potential contributors), maintaining regular communication & creating a safe space for community to provide feedback, to name a few. These activities require commitment by the maintainers. It may come naturally for those who are familiar with inclusive, open source ways of working. For teams new to InnerSource and/or not familiar with open source development models, there is a need for a mindset shift to open development models. What can prevent teams within the company from reusing and contributing to an InnerSource project? Will inclusivity matter while building an internal community? What factors in an InnerSource project affect this inclusiveness? Is there a difference in community building strategy between InnerSource and open source projects? In this talk, I will share my learnings on what works and what does not, while building internal communities.

Speakers

Shanmugapriya Manoharan

OSS Engineering Advisor, OSPO, IKEA (Ingka Group)

Shanmugapriya is an Open Source & InnerSource SME, working as Engineering Advisor at OSPO, IKEA IT AB. She has 15+ years of experience in driving initiatives and projects including Open Source and InnerSource projects, while working in organizations like HPE and Dell Technologies... Read More →

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 3C

Open Source Leadership

Audience Experience Level Intermediate

11:00am MDT

Edge AI and MLOPs Practices for Zephyr - Eoin Jordan, Edge Impulse / University of Galway

Tuesday June 24, 2025 11:00am - 11:40am MDT

Bluebird Ballroom 2C

In this presentation, Eoin will introduce a practical approach to Edge MLOps for microcontroller-based systems using the Zephyr RTOS. Edge MLOps unifies DevOps, ML model development, and edge deployment practices to streamline the entire AI lifecycle at the device level—from data collection and processing to model training, deployment, and continuous monitoring.

Attendees will learn how to implement version control for data and models, design automated CI/CD pipelines that handle real-world sensor data, and manage over-the-air (OTA) firmware updates on constrained Zephyr-based devices. We will explore best practices to ensure data integrity, model governance, and security throughout the pipeline, including techniques to mitigate model drift and bias.

Through a demonstration of an end-to-end IoT architecture, participants will see how edge devices can continuously collect new data, trigger remote training in the cloud, and deploy updated ML models back to the field. The talk will also highlight how Git action-based workflows enable seamless version transitions for on-device inference, showing how TFLite Micro or other open-source models —can be integrated platform-agnostic.

Speakers

Eoin Jordan

Developer Relations / PhD Student, Edge Impulse / University of Galway

Eoin Jordan works for Edge Impulse as part of the Developer Relations team, boasting over 14 years of experience in Networking, Cloud, Edge, and IoT technologies. He is passionate about Edge Intelligence, actively pursuing a Ph.D. on the subject, and educating the community on this... Read More →

Tuesday June 24, 2025 11:00am - 11:40am MDT
Bluebird Ballroom 2C

Zephyr

Audience Experience Level Intermediate

11:20am MDT

CD Demands Continuous Testing: Why We Built a Testing Platform Layer on ECS Using Spinnaker - Jaime G. O'Byrne, JPMorgan Chase and Co

Tuesday June 24, 2025 11:20am - 11:40am MDT

Bluebird Ballroom 3B

Functional tests are not just an idealist luxury – at JPMorgan, they’re compulsory. Since designating Spinnaker as the strategic deployment tool for all public cloud deployments, users who were able to easily run tests using closures in our firm’s Jenkins offering were now finding themselves without a run-context. Where are your tests supposed to run when your deployment tool is now a distributed system?
From “bring your own environment” to “we will run all the firm’s tests on our infrastructure” - this talk will walk through some of the challenges, design decisions, tradeoffs, and general wrangling of complexity that comes from operating a distributed system like Spinnaker, in a highly regulated environment to support continuous testing on the cloud.

Speakers

Jaime OByrne

Senior Associate Software Engineer, JPMorgan Chase and Co

Salvadoran immigrant, Husband, Father of two. Early-Mid career Software Engineer and enthusiast of all things CD and automation.

Tuesday June 24, 2025 11:20am - 11:40am MDT
Bluebird Ballroom 3B

cdCon

Audience Experience Level Intermediate

11:55am MDT

Security, Privacy & Authenticity on the Web - Daniel Appelquist, Samsung

Tuesday June 24, 2025 11:55am - 12:15pm MDT

Bluebird Ballroom 3D

In an era of growing concerns over misinformation, surveillance, and data breaches, building a more secure, private, and authentic web has never been more critical.

In this talk, I'll explore the current state of web security, privacy, and authenticity, focusing on key efforts shaping the future of the open web. You'll hear about the latest work in W3C, including advancements in privacy principles, ethical web guidelines, web developer security guidelines, all aimed at creating a more secure, trustworthy, and user-centric web. You'll also learn about how emerging standards like Content Credentials (C2PA) may revolutionise the way we verify the authenticity of digital content, helping to combat misinformation and ensure transparency in the information we consume online.

Speakers

Daniel Appelquist

Open Source Strategist, Samsung

Dan Appelquist is Open Source Strategist at Samsung Open Source Group. He is a web & mobile industry veteran and long-time participant and leader in open source and open standards. He is co-chair of the W3C Technical Architecture Group and is Co-Chair of OpenSSF's Global Cybersecurity... Read More →

Tuesday June 24, 2025 11:55am - 12:15pm MDT
Bluebird Ballroom 3D

Standards + Specifications

Audience Experience Level Intermediate

11:55am MDT

Cross-cloud App Splitting With WebAssembly Components - Matt Butcher, Fermyon

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2G

Take one single application compiled to WebAssembly and split it into pieces at deployment time. Run these pieces in different Kubernetes deployments, different clouds, or even split across edge and cloud.

This code-forward talk will show how to write an application using Wasm components and a combination of Rust and TypeScript. We'll show how to use the CNCF project Spin for developing apps, and then use Kubernetes, Helm, SpinKube, and other open source tools to deploy this application in multiple locations.

Conceptually, we'll tie this new development pattern to microservice architecture and distributed systems to show how WebAssembly's Component Model is paving the way for a new class of application.

Speakers

Matt Butcher

CEO, Fermyon

Matt Butcher (CEO) is a founder of Fermyon. He is one of the original creators of Helm, Brigade, CNAB, OAM, Glide, and Krustlet. He has written or co-written many books, including "Learning Helm" and "Go in Practice." He is a co-creator of the "Illustrated Children’s Guide to Kubernetes... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2G

Cloud + Containers

Audience Experience Level Intermediate

11:55am MDT

Mock Me If You Can: Using Mocks in Container Applications for Integration Testing - John Coyne, Discover Financial Services

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2F

Automated testing needs to offer fast, reliable feedback so that defects can be quickly identified and resolved. In this session, I'll talk about how to use the open-source service virtualization framework, Wiremock, as a sidecar container to mock out the dependent services of an application running in a container platform. This can be used in Narrow Integration testing of an application as part of a CI/CD pipeline to ensure maximum code coverage along with stability of the test suite.

I'll walk attendees through a demo of practical use and share some best practices I've learned when setting up a Wiremock container for testing. Attendees will leave with a better understanding of Wiremock and tips for how to use it in their own testing scenarios.

Speakers

John Coyne

Distinguished Engineer of Application Engineering, Discover Financial Services

John is a Distinguished Engineer of Application Engineering at Discover Financial Services with over 20 years of experience building Java applications. His current interests include Observability, CI/CD automation, Kubernetes, and good API design. Outside of work, John enjoys spending... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2F

Cloud + Containers

Audience Experience Level Intermediate

11:55am MDT

Early Ethernet With Linux - Keerthy Jagadeesh, Texas Instruments

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2B

The automotive world is rapidly moving towards software defined vehicles & zonal architecture. Ethernet is the backbone of zonal architecture. The bandwidth and response time requirements of ethernet are higher than ever. The network stack with Linux makes it a compelling choice of OS for Gateway/ADAS SOCs.

With growing number of ECUs in the car, the gateway SOC needs to be ethernet ready very early to support FOTA and telematics applications. All the ECUs sitting behind the gateway need ethernet functionality for communication. With ROM code, boot loader kernel & the user space application taking time to initialize, the goal of early ethernet is a tricky one.

The presentation aims to cover the optimizations done at each phase of the Linux boot to achieve early ethernet. Top level optimizations:

1. Streamlined the boot flow from bootloader to get to Linux kernel faster.
2. Opening the network device early with driver optimization allows the hardware to be initialized early
3. Configuring majority of network using networkd scripts allows the interfaces to be ready early

Although the demonstration is done using TI's DRA821 Gateway SOC, this is applicable to any SOC using Linux.

Speakers

Keerthy Jagadeesh

Software Applications Engineer, Texas Instruments

Keerthy Jagadeesh is an ardent Linux developer team of the Texas Instruments and has been an active Linux contributor for the past 17+ years. He has worked on thermal management for TI SoCs, PMIC drivers, low power modes. Maintains TI THERMAL DRIVER & maintains TI GPIO DRIVER. He... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2B

Embedded Linux Conference

Audience Experience Level Intermediate

11:55am MDT

Virtio for PCI Endpoint Subsystem in Linux Kernel - Manivannan Sadhasivam, Linaro Ltd

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2A

Traditionally, Virtio is primarily used in virtualized environments to allow the Hypervisor to Guest communication in an agnostic way. But Virtio as a standard can be leveraged outside virtualization for communication between any two entities.

The PCI Endpoint subsystem in the Linux kernel is used to run Linux on tiny PCI endpoint devices such as modems, NIC, GPU, etc... It requires the developers to write function drivers to communicate with the host. On most occasions, these function
drivers also require counterpart drivers on the host systems. This increases the time required for the project's development, as the development needs to happen on both the host and endpoint systems.

This is where Virtio comes in handy for the PCI Endpoint subsystem. With Virtio, developers can focus on developing the back-end drivers on the endpoint side and leverage the existing front-end drivers on host systems (such as virt-net, virt-gpu, etc...).

In this talk, Manivannan Sadhasivam will present the proposals received from the community for adding Virtio backend support to the PCI Endpoint subsystem and elaborate on the one that got a consensus to move forward, along with the future plans.

Speakers

Manivannan Sadhasivam

Senior Engineer, Linaro Ltd

Mani is a Senior Kernel Engineer at the Qualcomm Landing team of Linaro. He maintains the PCI Endpoint Subsystem, Qualcomm MHI bus, and several drivers in the Linux Kernel.

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2A

Embedded Linux Conference

Audience Experience Level Intermediate

11:55am MDT

Extending Container Performance Isolation: Regulating Memory Bandwidth & Cache in the Kernel - Jonathan Perry, Unvariance

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2D

While containers provide isolation for CPU cycles and memory capacity, they offer limited protection against performance interference through shared CPU caches and memory bandwidth. Such contention was shown to increase application response times by 4-13x. The Linux resctrl infrastructure provides monitoring and control mechanisms, but has limitations for controlling real-world applications.

For example, child processes do not inherit their parent's resctrl groups, leaving any application that forks improperly monitored and controlled. Additionally, the current filesystem-based interface makes it difficult to build a controller that can monitor and adjust quickly enough to keep up with frequently changing application memory behavior.

This talk introduces the memory interference problem and presents new kernel mechanisms to address these limitations. A new collector enables effective control by capturing per-container measurements of cache and memory bandwidth usage at millisecond frequencies. We'll cover how the solution combines Intel RDT, AMD QoS, high-resolution timers, perf counters, and cgroups to achieve this. We'll discuss future work and opportunities for collaboration.

Speakers

Jonathan Perry

CEO, Unvariance

Jonathan Perry is a maintainer of the OpenTelemetry eBPF network collector and CEO of Unvariance, which develops tools to detect and mitigate noisy neighbors. At MIT, he built systems to enhance efficiency and reduce response times by mitigating network contention. Jonathan previously... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2D

Linux

Audience Experience Level Intermediate

11:55am MDT

Making EU CRA (Cyber Resilience Act) Simplified and Non-scary for OSS Contributors - Roman Zhukov, Red Hat

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 3C

The EU Cyber Resilience Act (CRA) aims to safeguard European consumers and at first glance it targets only the EU market. But in fact the entire OSS ecosystem falls under its scope, which could be scary not only for Manufacturers or Stewards, but also is seen harmful for Individual Developers. Let’s debunk some of those myths! To preserve CRA’s positive intention, we as a community work hard to make sure its implementation incentivizes contributors to become good Open-Source citizens.

During this session we will explore how CRA impacts all players in the OSS ecosystem and why Maintainers MUST keep going with their brilliant work and shouldn’t be afraid. We will discuss what we at foundations and various expert groups are doing to help the open-source community navigate the actual requirements, as well as what standards and tools are available right now, followed by useful examples. They will include templates, samples, checklists, good practices and ideas how YOU can leverage: open-source tools like Security Scorecard, GUAC, Trustify, Minder, a few others; frameworks like Security Base Line and C2C2F; standards like OpenVEX; collaborations like Global Cyber Policy WG.

Speakers

Roman Zhukov

Principal Security Community Architect, Red Hat

Practicing Cybersecurity expert, engineer and manager (15+ years), (ISC)2 CC (Certified in Cybersecurity). Currently - Principal Security & Community Architect at Red Hat. Ex. - Head of Product Security & Privacy for Data Center & AI SW at Intel. Roman has broad experience from security... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 3C

Open Source Leadership

Audience Experience Level Intermediate

11:55am MDT

Stories From the Trenches: Effective Collaboration Between OSPOs and R&D Organizations - Georg Kunz & David Östman, Ericsson

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 3F

In today's rapidly evolving tech landscape, alignment of open source initiatives and product-focused research & development (R&D) efforts are crucial to achieving strategic business goals. Establishing a dedicated Open Source Program Office (OSPO) plays a critical role in ensuring effective strategy, governance, fostering community engagement, and maximizing the benefits of open source contributions. However, an OSPO must connect these high-level principles with the needs and day-to-day operations of R&D organizations to ensure their effectiveness.

In this presentation, Georg and David will represent the OSPO and R&D at Ericsson. They will share insights into a set of concrete real-world cases and challenges, such as facilitating upstream contributions to the Linux kernel, establishing the Valkey project, and eliminating downstream forks. Based on these examples, they will delve into the intricacies of establishing an effective collaboration between the OSPO and R&D departments, highlighting how to bridge the gap between the needs of product team and the overarching company strategy.

Speakers

Georg Kunz

Open Source Manager, Ericsson

Georg is a passionate advocate for open source software and a long term contributor to a wide range of open source projects and communities. He currently serves on the Technical Advisory Council (TAC) and the Governing Board of the Open Source Security Foundation (OpenSSF) as well... Read More →

David Östman

General Manager Ericsson Software Technology Sweden, Ericsson

David is the General Manager of Ericsson Software Technology (EST) Sweden, leading a dedicated team of engineers developing open source software on projects like Linux, Yocto, and Valkey. With over 25 years of experience in the telecommunications industry, David began his career at... Read More →

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 3F

OSPOCon

Audience Experience Level Intermediate

11:55am MDT

Wait, So Now You're Telling Me We Need FGA? - Carla Urrea Stabile, Auth0

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2E

When building an application, we often start with simple requirements: “Just make sure only the admin can see this page.” Fast forward a few months, and the requirements have grown into a tangled web of roles, attributes, exceptions, and edge cases. Sound familiar?

In this talk, we’ll follow the journey of a fictional project that begins with no access control, progresses to Role-Based Access Control (RBAC), struggles with Attribute-Based Access Control (ABAC), and ultimately finds its footing with Fine-Grained Authorization (FGA). In this process, you’ll learn how OpenFGA addresses the growing complexity of modern applications with a relationship-based model that’s both flexible and scalable.

Speakers

Carla Urrea Stabile

Senior Developer Advocate & Software Engineer, Auth0

Carla is a software engineer and developer advocate at Auth0 by Okta. She’s a language agnostic developer but enjoys working with Ruby and Python. When she’s not working you can find her going on walks with her dogs, hiking or going on a bike ride.

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2E

Wildcard

Audience Experience Level Intermediate

11:55am MDT

IREE: An AI Subsystem for Zephyr? - Peter Kourzanov & Anmol Anmol, IMEC

Tuesday June 24, 2025 11:55am - 12:35pm MDT

Bluebird Ballroom 2C

Machine Learning and AI are experiencing explosive growth. The concentration of AI power in the datacenters, as well as the current trends in training and inferencing infrastructure built around power-hungry GPUs and control nodes running interpretive languages on full-fledged monolithic operating systems brings about an evermore greater need for energy. In this talk we will sketch a different future: one where the needs of scaling are addressed in a way of embedding lightweight control software running on energy-efficient hardware into a sea of heterogeneous compute accelerators arranged in an energy-conserving fashion. One where the edge devices, be it small IoT nodes or an intelligence subsystem inside a mobile device can all be included in one global, distributed, cognitive and sustainable network supporting the users.
We intend to cover our recent developments in the way of porting IREE to run on Zephyr's POSIX layer, as well as experiments to see how Zephyr as a lightweight library kernel can support typical inference tasks that were used as workloads to tune an accelerator's micro-architecture (using gem5 simulator) as well as to emulate the design on the FPGA as a scale-up.

Speakers

Peter Kourzanov

Principal member of technical staff, IMEC

Having started my professional career into CS (at TUDelft DBMS) I moved towards RT & streaming systems for CE (architecture & infra group at Philips Research). Dataflow compiler & middleware project got me further into the DSPs and models for radio & radar transceivers - the focus... Read More →

Anmol Anmol

Development Engineer, IMEC, Belgium

Exploring hardware/software codesign, microarchitecture and related research, and engineering problems.

Tuesday June 24, 2025 11:55am - 12:35pm MDT
Bluebird Ballroom 2C

Zephyr

Audience Experience Level Intermediate

12:15pm MDT

Defining Open Source AI: Can the “Judgement of Solomon” Help the Open Source Community Find Success? - Jeffrey Borek, IBM

Tuesday June 24, 2025 12:15pm - 12:35pm MDT

Bluebird Ballroom 3D

When faced with a difficult challenge sometimes it helps to look back at lessons from ancient history to guide your thinking. The Open Source Initiative (OSI) is working to create a definition for Open Source AI (OSAID), aiming to apply open source principles to artificial intelligence development, but clearly the 1.0 version is a work-in-progress. Can it find success? How may policy-makers react? Join this session to hear about the latest efforts to define open source AI and what's likely in store for 2025.

Speakers

Jeff Borek

WW Sr. Program Director Open Technologies, AI Alliance, and AI Supply Chain Security, IBM Research, IBM

Working across IBM Research to build a scalable and consistent AI software supply chain security framework, while continuing to lead the consumption compliance Open Source Program Office (OSPO), including policy, execution and guidance. Working with IBM Government & Regulatory Affairs... Read More →

Tuesday June 24, 2025 12:15pm - 12:35pm MDT
Bluebird Ballroom 3D

Standards + Specifications

Audience Experience Level Intermediate

2:10pm MDT

ARM64 Linux Laptops Status Report - Stefan Schmidt, Linaro Ltd.

Tuesday June 24, 2025 2:10pm - 2:50pm MDT

Bluebird Ballroom 2A

In June last year a bunch of new laptops, based on the Snapdragon X Elite, have been launched. All major laptop vendors launched devices, with over three
dozen to choose from at the time of this writing. Offering a nice alternative to ChromeBooks or MacBooks for Arm enthusiasts. No matter if you are intrigued by the battery life, performance or always wanted an arm64 based system to natively
compile for your embedded targets.

The core question is, how good is the Linux support. Being designed for Windows-on-ARM there is a risk Linux support is rudimentary at best. Does boot with UEFI work out of the box? Is there a device tree description for your specific device? Which hardware features are already supported mainline?
Is the firmware for various drivers available? How is the performance?

In short, is it usable as a daily driver for a developer? Stefan set out to find out, and report here.

In this talk he will provide details on the current state of development of these devices. An in-depth view on the hardware support: what is in mainline, which patches are pending and what is missing completely.
[Target: ELC North America]

Speakers

Stefan Schmidt

Tech Lead / Senior Linux Kernel Engineer, Linaro Ltd.

Stefan Schmidt is a FOSS contributor for nearly 20 years now. During this time he worked on different projects and different layers of the Linux ecosystem. From bootloader and Kernel over build systems for embedded to user interfaces. After years as a freelancer, member of the Samsung... Read More →

Tuesday June 24, 2025 2:10pm - 2:50pm MDT
Bluebird Ballroom 2A

Embedded Linux Conference

Audience Experience Level Intermediate

2:10pm MDT

Build Zephyr for MicroBlaze-V FPGA Using Yocto Project - Sandeep Gundlupet Raju, AMD

Tuesday June 24, 2025 2:10pm - 2:50pm MDT

Bluebird Ballroom 2C

The Yocto Project can build for a variety of targets: Linux, Zephyr, baremetal, etc. Using multiconfig one can target a combination of these environments in one single configured build. Zephyr is a real-time operating system (RTOS) that is open source and hosted by the Linux Foundation. It’s an collaborative effort uniting developers and users in building a best-in-class small, scalable, real-time operating system (RTOS) optimized for resource-constrained devices, across multiple architectures.

This talk will discuss how to configure a multiconfig builds for MicroBlaze-V(RISC-V) FPGA using Yocto Project meta-zephyr, with integrated binary components for Zephyr using a System DeviceTree(SDT) processed through the lopper tool to generate Zephyr Kconfig, DTS and Multiconfig Configuration files for MB-V. The resulting configuration files are then used to build and package Zephyr including but not limited to the Zephyr Kernel and peripheral drivers using the Yocto Project.

Speakers

Sandeep Gundlupet Raju

Senior Member of Technical Staff - Yocto Project, AMD

Open Source enthusiast, Contributor to Yocto Project(poky, amd xilinx meta layers, meta-ros, meta-virtualization, meta-jupyter), OpenEmbedded, Lopper, AMD Xilinx Device-tree Generator, PetaLinux, Trusted Firmware-A (ATF), Linux Kernel and U-boot trees. Maintainer of AMD Xilinx Yocto... Read More →

Tuesday June 24, 2025 2:10pm - 2:50pm MDT
Bluebird Ballroom 2C

Zephyr

Audience Experience Level Intermediate

2:25pm MDT

Lightning Talk: Serving Guardrail Detectors on Vllm - Evaline Ju, IBM

Tuesday June 24, 2025 2:25pm - 2:35pm MDT

Bluebird Ballroom 3E

With the increase in generative AI model use, there is a growing concern of how models can divulge information or generate inappropriate content. This concern is leading to the development of technologies to “guardrail” user interactions with models. Some of these guardrails models are simple classification models, while others like IBM’s Granite Guardian or Meta’s Llama Guard are themselves generative models, able to identify multiple risks. As new models appear, a variety of large language model serving solutions are being developed and optimized. An open-sourced example, vllm, has become an increasingly popular serving engine.

In this talk I’ll discuss how we built an open-sourced adapter on top of vllm to serve an API for guardrails models, so that models like Granite Guardian and Llama Guard can be easily applied as guardrails in generative AI workflows.

Speakers

Evaline Ju

Senior Software Engineer, IBM

Evaline is a senior engineer working on the watsonx platform engineering team of IBM Research and based in Denver, Colorado. She currently focuses on building guardrails infrastructure for large language model workflows. Her previous experience includes MLOps for IBM’s cloud ML... Read More →

Tuesday June 24, 2025 2:25pm - 2:35pm MDT
Bluebird Ballroom 3E

Open AI + Data

Audience Experience Level Intermediate

3:05pm MDT

Noisy Neighbor Detection: A New OSS Collector - Jonathan Perry, Unvariance

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2G

Why do some requests take so much longer than others? A major contributor, memory-related contention between containers, was shown to increase latency by 4-13x. It can be triggered by garbage collection, and existing observability cannot even detect it! Current collectors just show high CPU utilization, and the standard mitigation is to scale out and run at low utilization: expensive, and does not solve the response time problem.

We set out to build a new detector, but found that measuring every few seconds (current practice for collectors) is inadequate. Servers quickly jump between intense resource competition and under-utilization, so averaging over seconds does not show any contention. We needed measurements at millisecond frequency.

This session first examines real-world patterns that trigger interference and surveys methods for detecting memory interference, including findings from Google, Alibaba, and Meta's production environments. We'll then discuss the design of the OSS collector, and how it combines CPU performance counters, eBPF and high-resolution timers to identify noisy neighbors. We close with future directions and opportunities to get involved.

Speakers

Jonathan Perry

CEO, Unvariance

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2G

Cloud + Containers

Audience Experience Level Intermediate

3:05pm MDT

Composite Video Device Abstraction for Libcamera - Karthik Poduval & Kamalanadh (Kamal) Vedantham, Amazon Lab 126

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2B

In digital imaging, video devices often face limitations that impact output quality and functionality. Post-processors, such as m2m geometric distortion correction, m2m scalers, or m2m JPEG encoders, can be employed to enhance the output of an Image Signal Processor (ISP). Managing multiple post-processors individually can be complex and inefficient. To address this, the concept of a composite device could be used. This abstraction consolidates various functionalities, including a video node and multiple post-processors, under a single abstraction that acts like a composite video device. The composite video device provides an effective abstraction layer for the libcamera pipeline handler. It determines which post-processor to utilize and when, without requiring manual intervention for each operation. Without such an abstraction, designing a pipeline handler would be significantly more complex. In this talk, we go over the design of this abstraction.

Speakers

Karthik Poduval

Principal Software Development Engineer, Amazon Lab126

Karthik Poduval is a Principal Software Development Engineer at Amazon Lab126. In this role, he develops Embedded Linux device drivers and middleware stack for camera/ISP and other imaging devices.

Kamalanadh (Kamal) Vedantham

Senior Software Engineer, Amazon Lab 126

Senior Software Development Engineer at Amazon Lab126. Develops Embedded Linux device drivers and camera/isp pipelines.Previous expertise includes Biometric Sensor / Security TPM / Touch Sensor technlogies.

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2B

Embedded Linux Conference

Audience Experience Level Intermediate

3:05pm MDT

Dynamic VM Memory Resizing daemon (vmrd) - Sudarshan Rajagopalan, Qualcomm

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2A

We describe about a userspace daemon that integrates with the Linux kernel's Pressure Stall Information (PSI) mechanism to monitor and detect memory pressure events, and requests for adding/removing memory blocks from the host based on real-time memory demands in the system without need for intervention of an admin/host. The virtio-mem interface is used for communicating with the host for adding/removing memory blocks.

Detecting increase in memory demand – the daemon registers to certain PSI events and monitors pressure building up when memory allocations occurs. Using these predefined thresholds trigger the daemon to request additional memory from the host when minimal pressure is detected, indicating an active memory-intensive use case is running.

Detecting decrease in memory pressure – the daemon monitors pressure decay and psi averages (avg10, avg60, avg300) along with other memory stats. and makes an educated guess about memory usecases have ended and releases blocks back to host. The process of tracking memory pressure going down and releasing memory back to host is done in a separate thread.

More details on design and logic will be explained in the presentation session.

Speakers

Sudarshan Rajagopalan

Linux Kernel Developer, Qualcomm

Working as Linux Kernel Developer in Qualcomm for the past 7 years. Interests are in Embedded Systems and Firmware, System designs and Computer Architecture.

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2A

Embedded Linux Conference

Audience Experience Level Intermediate

3:05pm MDT

Enhancing Scalability of the Vmalloc Mechanism in the Linux Kernel - Adrian Huang, Lenovo & Uladzislau Rezki, Sony

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2D

The vmalloc mechanism in the Linux kernel provides contiguous virtual memory allocations, even when the underlying physical memory is non-contiguous. However, with increasing adoption and usage, the synchronization of vmalloc data structures poses significant performance challenges, particularly in many-core systems with 256+ cores.

This session will explore the scalability improvements made to the vmalloc mechanism, covering the following key topics:

1. An overview of the legacy vmalloc approach, which relies on a single global lock for data synchronization.

2. Introduction to an enhanced vmap node implementation designed to address the limitations of the legacy approach.

3. Identification and detailed analysis of two remaining performance bottlenecks despite the enhanced vmap node implementation, along with their proposed solutions.

Join us to gain insights into the evolving design of vmalloc and its implications for performance in modern high-core-count systems.

Speakers

Adrian Huang

Senior Engineer, Lenovo

Adrian Huang is a Senior Linux Engineer in the Lenovo Infrastructure Solutions Group (ISG) based in in Taipei, Taiwan. He has experience with Linux kernel IOMMU subsystem, Linux kernel synchronization, Linux kernel interrupt mechanism and memory management.

Uladzislau Rezki

Embedded developer, Sony

My name is Uladzislau Rezki. I am 43 years old. I am married and live with my wife in Sweden, Lund. I graduated from the University in Belarus, since 2011 i moved and work in Sony in Sweden until now. I do some ports, play table tennis, running we both love to walk in the forest... Read More →

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2D

Linux

Audience Experience Level Intermediate

3:05pm MDT

The Open Source Solution That Actually Works - Syed Usman Ahmad, Grafana Labs

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 3A

When you are running an application that contains primary ingredients such as Java, MySQL, Mail Service etc. and all fused up together to be as one, then it is no surprise that you need to rely on more than one monitoring solution. But imagine if there is a one single solution that can bring up the Logs, Metrics, Traces and even Profiling and on top of that, it is completely Open Source? Well, you are in luck, as in this talk we will demonstrate an example on how to monitor your applications by using Grafana and use various integrations and plugins. Later, we will see more advanced features to get key metrics for better observability.

It will be an introduction to the Dashboards, and also an excellent opportunity to learn more about the advanced features, including troubleshooting & debugging.

Join us to learn more about Grafana dashboards, community contributions and share your feedback and suggestions!

Speakers

Syed Usman Ahmad

Senior Developer Advocate, Grafana Labs

Usman is a Senior Developer Advocate at Grafana Labs from Nuremberg, Germany and works with the Open Source community on the community forum, GitHub and Slack. He has over 15 years of experience in IT and Cloud Support where he served multiple customers all over EU, US and Japan... Read More →

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 3A

Open Source 101

Audience Experience Level Intermediate

3:05pm MDT

Navigating FINTECH’s Regulatory Waters With InnerSource - Brittany Istenes, FINOS Ambassador, ToDo Group Steering Committee & Russell Rutledge, InnerSource Commons

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 3F

The financial industry is navigating an ocean of regulations, where compliance and innovation often feel like opposing forces. But what if there was a way to align them? Enter InnerSource—the open-source-inspired approach that fosters collaboration, accelerates development, and enhances regulatory transparency within financial institutions. Explore how the InnerSource Commons Foundation and the FINOS foundation are partnering to navigate the murky waters of regulation within the concept of openness inside of the FINTECH industry.

In this session, Brittany Istenes (FINOS) and Russ Rutledge (InnerSource Commons) will share how they are using InnerSource principles and guidance as a life preserver to help FINTECH firms navigate regulatory challenges.

Join us to explore real-world success stories and actionable strategies that demonstrate how InnerSource can transform challenges into opportunities for innovation to sail into calmer seas.

Speakers

Brittany Istenes

OSPO Strategist, FINOS Ambassador, ToDo Group Steering Committee Member

Brittany Istenes started off her career as an elementary school educator which then led to a path of tech. Brittany has led advisory councils, special interest groups, open source contributions, community building, InnerSource initiatives and all the gray areas in between. As a FINOS... Read More →

Russell Rutledge

Executive Director, InnerSource Commons

Russ Rutledge is the Senior Director of InnerSource and Collaboration at WellSky, a leading technology company offering a range of software solutions that help organizations across the healthcare continuum. In this role, Russ is leading a transformational change in the company towards... Read More →

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 3F

OSPOCon

Audience Experience Level Intermediate

3:05pm MDT

Solving the Phantom Dependency Problem for Python Packages - Seth Larson, Python Software Foundation

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2E

Endor Labs coined the term "Phantom Dependency Problem" to describe dependencies that are bundled into software packages but not represented in the package metadata. This is common in many software package ecosystems, but it is most prevalent in the Python package ecosystem (PyPI) where many packages include compiled C, C++, and Rust dependencies.

Bundled software not being included in package metadata is meaning means that software composition analysis (SCA), SBOM, and vulnerability scanning tools are not able to detect the bundled software. This can cause vulnerabilities to be missed and make.

The Security Developer-in-Residence at the Python Software Foundation, Seth Larson, worked on solving to the Phantom Dependency problem for Python packaging, involving work on standards and tooling.

By the end of this session attendees will understand the Phantom Dependency problem, how it relates to Python and other packaging ecosystems, how SBOM and SCA tools work, and what work was done to make bundled dependencies measurable and what that means for users.

Speakers

Seth Larson

Security Developer-in-Residence, Python Software Foundation

Seth is the Security Developer-in-Residence at the Python Software Foundation working to improve the security posture of the Python ecosystem. Seth maintains widely used open source Python projects like urllib3, truststore, and Requests.

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2E

Wildcard

Audience Experience Level Intermediate

3:05pm MDT

Simulating Embedded Systems With Zephyr - Mohammed Billoo, MAB Labs Embedded Solutions

Tuesday June 24, 2025 3:05pm - 3:45pm MDT

Bluebird Ballroom 2C

Hardware availability is among the many challenges embedded software engineers face when working on new designs. In the case of MCU-based applications, embedded software engineers need to wait for the hardware to arrive to validate portions of their application that exercise the underlying hardware. Additionally, if the application is part of a network and the network can contain hundreds or thousands of nodes, engineers may find it difficult to evaluate their design when the network is under load. Fortunately, The Zephyr Project RTOS has the infrastructure to allow embedded software engineers to evaluate as much of their design with access to the necessary hardware. In this talk, I will walk through these tools and how they can be used to evaluate the embedded software design before hardware is ready. The tools covered in this talk will be QEMU, BabbleSim, and Renode. They will be showcased with code, invocations, and results to demonstrate their value.

Speakers

Mohammed Billoo

CEO, MAB Labs Embedded Solutions

Mohammed Billoo is an embedded software consultant with over 15 years of experience. He focuses on The Zephyr Project RTOS, Embedded Linux, and The Yocto Project. He has also developed user interfaces using the Qt framework. He has helped clients across numerous verticals, including... Read More →

Tuesday June 24, 2025 3:05pm - 3:45pm MDT
Bluebird Ballroom 2C

Zephyr

Audience Experience Level Intermediate

4:20pm MDT

The Life of a Kernel Bugfix - Thadeu Lima de Souza Cascardo, Igalia

Tuesday June 24, 2025 4:20pm - 5:00pm MDT

Bluebird Ballroom 2D

Ever wonder how a bug fix lands on the kernel you are running on your system?

Would you like to know how to effectively get such fixes in the hands of most users?

From the time it gets submitted for review until an update is available in a distro, a lot of processes need to be followed and many people are involved.

The talk will go over some of these processes, some of the obstacles that may get in the way and how to make it easier for the people who do the work to get these fixes into the hands of as many people as possible.

Speakers

Thadeu Lima de Souza Cascardo

Kernel developer, Igalia

Cascardo has contributed to the Linux kernel for more than 15 years, initially as a volunteer and as a consultant, and later as part of teams at companies like IBM, Red Hat, Canonical, and now at Igalia. Mostly contributing bug fixes, Cascardo has been one of the top 4.19.x backporters... Read More →

Tuesday June 24, 2025 4:20pm - 5:00pm MDT
Bluebird Ballroom 2D

Linux

Audience Experience Level Intermediate

4:20pm MDT

Gotta Cache 'em All: Scaling AI Workloads With Model Caching in a Hybrid Cloud - Rituraj Singh & Jin Dong, Bloomberg

Tuesday June 24, 2025 4:20pm - 5:00pm MDT

Bluebird Ballroom 3E

AI models are evolving rapidly, while also growing exponentially in size and complexity. As AI workloads become larger, it is crucial to address the challenges of rapidly scaling inference services during peak hours and how to ensure optimal GPU utilization for fine-tuning workloads. To tackle this, Bloomberg’s Data Science Platform team has implemented a “Model Cache” feature in the open source KServe project for caching large models on GPUs in a multi-cloud and multi-cluster cloud-native environment.

This talk discusses the challenges faced with hosting large models for inference and fine-tuning purposes, and how model caching can help mitigate some of these challenges by reducing load times during auto-scaling of services, improving resource utilization, and boosting data scientists’ productivity. The talk dives into how Bloomberg integrated KServe’s Model Cache into its AI workloads and built an API on top of Karmada to manage cache federation. AI infrastructure engineers will learn about the profound impact of enabling model caching and how teams can adopt this feature in their own AI infrastructure environment.

Speakers

Rituraj Singh

Software Engineer, Bloomberg LP

Rituraj Singh is a software engineer on Bloomberg’s Data Science Platform engineering team, which is focused on enabling large-scale AI model training on GPUs. Rituraj graduated from Carnegie Mellon University with a master's degree in computer engineering.

Jin Dong

Software Engineer, Bloomberg

Jin Dong is a software engineer at Bloomberg. He works on building an inference platform for machine learning with KServe.

Tuesday June 24, 2025 4:20pm - 5:00pm MDT
Bluebird Ballroom 3E

Open AI + Data

Audience Experience Level Intermediate