Open Source Summit North America 2025

Mutation testing is a powerful technique used to assess the effectiveness of software tests by introducing small, deliberate changes (mutations) to the codebase. These mutations simulate common coding errors, offering a robust way to evaluate how well existing test suites can detect potential faults. This talk will explore the principles behind mutation testing, its applications in real-world development cycles, and its potential to uncover gaps in test coverage that traditional testing methods may miss. Attendees will learn about the core concepts, tools, and strategies for integrating mutation testing into CI/CD workflow, as well as the challenges and best practices for maximizing its benefits. Whether you’re looking to improve the robustness of your tests or dive deeper into software quality assurance, this session will provide valuable insights into how mutation testing can take your software’s reliability to the next level.

Functional tests are not just an idealist luxury – at JPMorgan, they’re compulsory. Since designating Spinnaker as the strategic deployment tool for all public cloud deployments, users who were able to easily run tests using closures in our firm’s Jenkins offering were now finding themselves without a run-context. Where are your tests supposed to run when your deployment tool is now a distributed system?
From “bring your own environment” to “we will run all the firm’s tests on our infrastructure” - this talk will walk through some of the challenges, design decisions, tradeoffs, and general wrangling of complexity that comes from operating a distributed system like Spinnaker, in a highly regulated environment to support continuous testing on the cloud.

Software is built for a purpose. The same property applies to build platforms!

We will show you how we are leveraging Tekton and Tekton Chains at Red Hat to create a build platform that meets developers where they are at. Developers start with the pipeline defined in their git repository – free for them to modify and update on their terms, with Tekton tasks ready to scan artifacts for vulnerabilities and Renovate pre-configured to help keep dependencies up to date.

This platform helps make sure that the artifacts are going somewhere. Using the detailed SLSA Provenance generated by Tekton Chains, the build platform enables policy driven development. Developers can see in their PRs whether they are on track to meet the target’s requirements – whether it is pushing to a development or production environment. Gone are the days saying “I didn’t know I had to do that!”

We won’t send the artifacts just anywhere, however, as we can tailor policies to ensure that you are meeting all of the requirements. The platform can inspect the provenance to ensure that artifacts are built using trusted steps and all required checks are good for takeoff!

We all know that observability is a must-have for operating systems in production. But we often neglect our own backyard - our software release process. As a result, we also lack standardization, and each CI/CD tool invent its own way of reporting about pipeline runs, which causes fragmentation, lock-in and difficulty to leverage existing observability tools.

We've been talking about the need for a common "language" for reporting and observing CI/CD pipelines for years, and finally, we see the first "words" of this language entering the "dictionary" of observability - the OpenTelemetry open specification and semantic conventions. On this talk the OTel CI/CD SIG leads will share the need, and the work of the SIG.

Join us to learn about this new SIG, its role, the milestones achieved and roadmap ahead. The talk will also discuss the alignment with adjacent open source communities such as the CDF's Jenkins and CDEvents and the Eiffel community.

Is your CI/CD pipeline giving you a green light when, in reality, something's lurking in the shadows? Traditional monitoring tools often miss the subtle failures that could silently impact your users. While your pipeline may say all systems go, AI sees the truth behind the curtain.
In this talk, we’ll unveil how AI can catch those hidden deployment issues that your traditional monitoring tools overlook, providing real-time, actionable insights into your Kubernetes environments.

Here’s what we’ll cover:
1. Identify deployment issues missed by traditional monitoring tools with insights from AI
2. Leverage AI to analyze logs, metrics, and traces for early problem detection.
3. Watch how AI automatically correlates data to resolve issues in real time.
By the end of this talk, you’ll gain the knowledge to integrate AI-powered observability into your CI/CD pipelines, enabling you to catch hidden problems early and deploy with confidence.

Modern CI/CD Pipelines generate vast amounts of build, test, and deployment data- making it challenging to detect issues before they impact production. In this session, we explore how AI and ML can transform your CI/CD process by predicting failures before they occur. You'll learn how to collect and process pipeline data(logs, test outcomes, resource metrics) to train models that detect subtle patterns indicative of future failures. This talk covers practical strategies for feature engineering, model integration using popular open source tools, and real-world case studies that demonstrate reduced downtime and optimised testing. Attendees will leave with a clear, actionable roadmap for embedding predictive analytics into their pipelines to drive proactive, resilient software delivery

In today's digital landscape, rapid and reliable software delivery is crucial. Join us to explore how eBay has integrated AI and ML into its Continuous Integration and Continuous Deployment (CI/CD) processes, revolutionizing software development at scale.

We will share insights from eBay's "Engineering Velocity" initiative, detailing how our AI and ML powered CI/CD platform helped our engineers in achieving a 23% increase in software releases and a 10% reduction in production bugs.

This session will cover:

* The strategic implementation of AI and ML in CI/CD to enhance efficiency and quality.
* Real-world examples of how AI-driven insights and automation have streamlined our software development, review, testing, debugging and delivery process.
* Key challenges and lessons learned in integrating AI and ML technologies into the CI/CD platform.
* Future trends and opportunities in AI and ML for CI/CD.

Whether you're an engineering leader, developer, or DevOps practitioner, gain insights and strategies to leverage AI and ML for faster, more reliable software delivery.

Internal developer platforms can make or break developer productivity. Many organizations struggle to balance scalability, flexibility, and usability when building these internal platforms, especially in multi-tenant environments. Yet, designing streamlined workflows that balance governance with developer autonomy often feels like navigating pothole-filled roads. In this talk, I will explore real-world lessons and open source tools from building GitOps-driven paved paths that simplify complex multi-environment workflows.

Learn how declarative principles, automated pipelines, and GitOps practices can transform developer frustration into delight. Whether you're improving namespace management, scaling day 2 operations, or accelerating platform adoption, this talk should leave you with usable tools and fresh ideas for your platform engineering journey.

In the fast-paced world of CI/CD, traditional code reviews can become a bottleneck, slowing down development and introducing risks due to human errors or inconsistencies. What if you could have an AI-powered assistant that reviews your code in real-time, providing actionable insights, detecting security vulnerabilities, and ensuring compliance—all while integrating seamlessly into your DevOps pipeline?

This session explores how Generative AI is transforming code reviews in CI/CD environments. We will dive into how AI-driven assistants can enhance developer productivity, improve code quality, and automate security and compliance checks.

We will cover:
The challenges of traditional code reviews in modern CI/CD workflows
How Generative AI enhances automated code reviews for speed and accuracy
Real-world use cases and best practices for integrating AI-powered code review assistants into your pipelines
The impact of AI on security, compliance, and developer experience
By the end of this session, you’ll understand how to leverage AI to make your CI/CD pipelines smarter, faster, and more secure—reducing friction in your development lifecycle while ensuring high-quality code.