AGENDA

The Annual DevOps, DevSecOps, MLOps User Conference

Plan your schedule for swampUP 2025 and reserve your spot before sessions reach capacity!

September 8-10, 2025

Day 1
September 9th
Day 2
September 10th

0

7:30 AM
7:30 AM
Registration
Vintner's Dining Room

1

8:30 AM
Add to calendar
speaker image
8:30 AM
Ronny Belenitsky Director of Product Ronny is a Product Director at JFrog, where he leads strategic initiatives across DevSecOps and SDLC innovation. With a strong background in cloud-native technologies and application lifecycle management, Ronny plays a key role in shaping products that empower enterprise engineering teams to build and release software more quickly and securely. Prior to JFrog, Ronny was the VP of Product at Titan, where he scaled product organizations, launched market-leading solutions, and drove enterprise adoption globally. He brings over 15 years of experience in building impactful software products, combining technical depth with strategic vision. Secure & Streamline Your Software Supply Chain with JFrog, Strengthening SDLC Integrity, Step by Step
Secure & Streamline Your Software Supply Chain with JFrog
Salon A
Effective Release Lifecycle Management is key to ensuring secure, traceable, and efficient software delivery. Join us for this workshop with hand-on practice to learn how JFrog’s platform can help you automate workflows, improve collaboration, and ensure security and compliance throughout your software supply chain. Key Skills you can Expect to Learn: • Tracking and managing software artifacts throughout the lifecycle • Automating release processes with CI/CD pipeline integration • Implementing immutable releases and ensuring security compliance • Enhancing team collaboration for smoother software delivery • Exclusive Preview of JFrog’s upcoming product features Who Should Attend? • DevOps & Software Engineers • Release Managers & QA Professionals • Security Engineers & CISOs • Technology Leaders (CTOs, CIOs) Don’t miss out on transforming your software delivery process. Sign up today!
Effective Release Lifecycle Management is key to ensuring secure, traceable, and efficient software delivery. Join us for this workshop with hand-on practice to learn how JFrog’s platform can help you automate workflows, improve collaboration, and ensure security and compliance throughout your software supply chain. Key Skills you can Expect to Learn: • Tracking and managing software artifacts throughout the lifecycle • Automating release processes with CI/CD pipeline integration • Implementing immutable releases and ensuring security compliance • Enhancing team collaboration for smoother software delivery • Exclusive Preview of JFrog’s upcoming product features Who Should Attend? • DevOps & Software Engineers • Release Managers & QA Professionals • Security Engineers & CISOs • Technology Leaders (CTOs, CIOs) Don’t miss out on transforming your software delivery process. Sign up today!

2

8:30 AM
Add to calendar
8:30 AM
From Code to Runtime: Protecting Your Software Supply Chain
Salon B
Managing your software supply chain from code inception to runtime deployment is crucial for security, compliance, and efficiency. This workshop will guide you through best practices to serve as the gatekeeper of your supply chain, embedding security, automating processes, and ensuring compliance throughout the SDLC. Key Skills Learned: • Understand the essentials of securing your software supply chain. • Identify and mitigate common risks and vulnerabilities in the supply chain. • Integrate security practices throughout your SDLC (e.g., code review, dependency management, artifact scanning). • Leverage JFrog tools like Xray and JFrog Advanced Security for secure artifact management. • Automate security and compliance checks, and streamline deployment. • Implement real-time monitoring and incident response strategies. Who Should Attend? • Software Developers and Engineers • DevOps Professionals • Security Engineers • Project Managers & Team Leaders Take control of your software supply chain - secure, streamline, and safeguard the journey from code to runtime.
Managing your software supply chain from code inception to runtime deployment is crucial for security, compliance, and efficiency. This workshop will guide you through best practices to serve as the gatekeeper of your supply chain, embedding security, automating processes, and ensuring compliance throughout the SDLC. Key Skills Learned: • Understand the essentials of securing your software supply chain. • Identify and mitigate common risks and vulnerabilities in the supply chain. • Integrate security practices throughout your SDLC (e.g., code review, dependency management, artifact scanning). • Leverage JFrog tools like Xray and JFrog Advanced Security for secure artifact management. • Automate security and compliance checks, and streamline deployment. • Implement real-time monitoring and incident response strategies. Who Should Attend? • Software Developers and Engineers • DevOps Professionals • Security Engineers • Project Managers & Team Leaders Take control of your software supply chain - secure, streamline, and safeguard the journey from code to runtime.

3

8:30 AM
Add to calendar
8:30 AM
JFrog Artifactory Foundations: Optimize & Secure Your Software Pipeline
Salon K
Development teams struggle with securing artifacts, automating complex workflows, and maintaining compliance across various stages of the software development lifecycle (SDLC). This workshop addresses those challenges by showing you how to effectively use JFrog tools - Artifactory and Xray - to streamline and secure your SSC, making it easier to automate processes, identify vulnerabilities, and integrate security from start to finish. Key Skills Learned: • Use JFrog tools to manage, secure, and automate your software supply chain. • Set up and manage repositories and automate CI/CD pipelines efficiently. • Implement security best practices across your software lifecycle. Who Should Attend? • DevOps Engineers looking to integrate security into their workflows. • Security Engineers focused on strengthening their software supply chain. • Software Engineers interested in automating and securing their delivery pipelines. Join us to improve your DevSecOps practices and secure your software supply chain from start to finish.
Development teams struggle with securing artifacts, automating complex workflows, and maintaining compliance across various stages of the software development lifecycle (SDLC). This workshop addresses those challenges by showing you how to effectively use JFrog tools - Artifactory and Xray - to streamline and secure your SSC, making it easier to automate processes, identify vulnerabilities, and integrate security from start to finish. Key Skills Learned: • Use JFrog tools to manage, secure, and automate your software supply chain. • Set up and manage repositories and automate CI/CD pipelines efficiently. • Implement security best practices across your software lifecycle. Who Should Attend? • DevOps Engineers looking to integrate security into their workflows. • Security Engineers focused on strengthening their software supply chain. • Software Engineers interested in automating and securing their delivery pipelines. Join us to improve your DevSecOps practices and secure your software supply chain from start to finish.

4

8:30 AM
Add to calendar
8:30 AM
Mastering Scalable Architectures for Global Enterprises with JFrog
Salon J
As enterprises scale their operations globally, creating architectures that are resilient, available, and adaptable to hybrid and multi-cloud environments becomes critical. This workshop dives into designing scalable, enterprise-level SDLC architectures, leveraging JFrog tools to meet the complex needs of modern digital ecosystems. You’ll gain hands-on experience in addressing performance, redundancy, and global collaboration challenges while ensuring operational efficiency. Key Skills Learned: • Articulate the key components and benefits of an enterprise-scale architecture for your organization. • Implement scalable solutions that enhance reliability and resilience across multi-cloud environments. • Select and design deployment topologies that meet enterprise-specific requirements. • Anticipate and address potential operational, security, and compliance challenges. • Create a blueprint that supports operational continuity and global collaboration. Who Should Attend: • DevOps and IT Architects. • Principal and Senior Engineers. • Systems Administrators. • Network Engineers. • IT Decision-Makers. Start architecting for the future of enterprise-scale success!
As enterprises scale their operations globally, creating architectures that are resilient, available, and adaptable to hybrid and multi-cloud environments becomes critical. This workshop dives into designing scalable, enterprise-level SDLC architectures, leveraging JFrog tools to meet the complex needs of modern digital ecosystems. You’ll gain hands-on experience in addressing performance, redundancy, and global collaboration challenges while ensuring operational efficiency. Key Skills Learned: • Articulate the key components and benefits of an enterprise-scale architecture for your organization. • Implement scalable solutions that enhance reliability and resilience across multi-cloud environments. • Select and design deployment topologies that meet enterprise-specific requirements. • Anticipate and address potential operational, security, and compliance challenges. • Create a blueprint that supports operational continuity and global collaboration. Who Should Attend: • DevOps and IT Architects. • Principal and Senior Engineers. • Systems Administrators. • Network Engineers. • IT Decision-Makers. Start architecting for the future of enterprise-scale success!

5

8:30 AM
Add to calendar
8:30 AM
GitHub Actions for JFrog: Streamlining Workflows and Enhancing Security
Salon H
This workshop provides a comprehensive exploration of integrating the Jfrog Platform with GitHub to optimize your software development lifecycle. Through hands-on exercises, participants will learn how to leverage GitHub Actions to automate workflows and connect them seamlessly with JFrog for efficient artifact management, CI/CD, and security. The session will cover essential practices for secure authentication, build information management, and vulnerability scanning, demonstrating how these integrations streamline development processes and enhance collaboration. Key Skills Learned: - OIDC Authentication: understand and implement OpenID Connect (OIDC) for secure authentication between GitHub and JFrog. - GitHub Actions Automation: learn to automate CI/CD workflows using GitHub Actions and integrate them with the JFrog platform. - JFrog Advanced Security Integration: discover how to integrate JFrog Advanced Security with GitHub Advanced Security for comprehensive vulnerability scanning and remediation. - Source Code Scanning: bulk Installation across multiple repositories. Who Should Attend: - Software Developers & Engineers - DevOps Professionals - Security Engineers - Team Leaders & Project Managers Enhance your software development process by integrating JFrog and GitHub to automate workflows, improve security, and streamline artifact management.
This workshop provides a comprehensive exploration of integrating the Jfrog Platform with GitHub to optimize your software development lifecycle. Through hands-on exercises, participants will learn how to leverage GitHub Actions to automate workflows and connect them seamlessly with JFrog for efficient artifact management, CI/CD, and security. The session will cover essential practices for secure authentication, build information management, and vulnerability scanning, demonstrating how these integrations streamline development processes and enhance collaboration. Key Skills Learned: - OIDC Authentication: understand and implement OpenID Connect (OIDC) for secure authentication between GitHub and JFrog. - GitHub Actions Automation: learn to automate CI/CD workflows using GitHub Actions and integrate them with the JFrog platform. - JFrog Advanced Security Integration: discover how to integrate JFrog Advanced Security with GitHub Advanced Security for comprehensive vulnerability scanning and remediation. - Source Code Scanning: bulk Installation across multiple repositories. Who Should Attend: - Software Developers & Engineers - DevOps Professionals - Security Engineers - Team Leaders & Project Managers Enhance your software development process by integrating JFrog and GitHub to automate workflows, improve security, and streamline artifact management.

6

12:00 PM
12:00 PM
Training Day Lunch
Vintner's Dining Room

7

1:00 PM
Add to calendar
1:00 PM
Foundations of DevSecOps: Avoiding Software Supply Chain Attacks
Salon K
With software supply chain attacks on the rise, security risks have never been more critical. This hands-on workshop focuses on JFrog’s security tools - from shift left to shift right - and how to integrate them into your DevSecOps strategy. We’ll explore how to secure your software supply chain, reduce vulnerabilities, and automate key workflows, ensuring your artifacts and dependencies are safe throughout the development lifecycle. Key Skills Learned: • Understand how JFrog tools from Curation to Xray and Advanced security can accelerate your DevSecOps goals. • Use JFrog security scan capabilities and Developer-Focused Security. • Gain hands-on experience in configuring repositories, scanning for vulnerabilities, and automating delivery pipelines. • Implement best practices to secure your software supply chain, reducing the risk of vulnerabilities and improving compliance. • How to shift security left by embedding security measures early in your SDLC. Who Should Attend: • Engineers working across SDLC phases - Development, Automation, DevOps, and SRE. • Security Engineers focused on securing the software supply chain with the JFrog platform. Join us to deepen your DevSecOps knowledge and enhance your organization’s security posture with JFrog’s trusted tools. Sign Up Today!
With software supply chain attacks on the rise, security risks have never been more critical. This hands-on workshop focuses on JFrog’s security tools - from shift left to shift right - and how to integrate them into your DevSecOps strategy. We’ll explore how to secure your software supply chain, reduce vulnerabilities, and automate key workflows, ensuring your artifacts and dependencies are safe throughout the development lifecycle. Key Skills Learned: • Understand how JFrog tools from Curation to Xray and Advanced security can accelerate your DevSecOps goals. • Use JFrog security scan capabilities and Developer-Focused Security. • Gain hands-on experience in configuring repositories, scanning for vulnerabilities, and automating delivery pipelines. • Implement best practices to secure your software supply chain, reducing the risk of vulnerabilities and improving compliance. • How to shift security left by embedding security measures early in your SDLC. Who Should Attend: • Engineers working across SDLC phases - Development, Automation, DevOps, and SRE. • Security Engineers focused on securing the software supply chain with the JFrog platform. Join us to deepen your DevSecOps knowledge and enhance your organization’s security posture with JFrog’s trusted tools. Sign Up Today!

8

1:00 PM
Add to calendar
speaker image
1:00 PM
Pavel Klushin Senior Manager, Solution Engineering Pavel Klushin is an ML expert with over ten years of expertise in cloud engineering. His work focuses on integrating AI with cloud infrastructures, enhancing performance and driving innovation across various industries. MLOps in Action: From Experimentation to Production, Delivering AI You Can Trust
MLOps in Action: From Experimentation to Production
Salon J
Integrating machine learning with DevOps practices is essential for organizations to stay competitive. This hands-on workshop will introduce you to JFrog ML and its capabilities, empowering data scientists and DevOps teams to seamlessly manage the end-to-end machine learning lifecycle. Learn to securely build, deploy, and maintain machine learning models with JFrog’s powerful platform, while enhancing collaboration between data scientists and DevOps teams. Key Skills Learned: • Seamlessly manage the full ML lifecycle, from experimentation to production, on a single platform. • Track, compare, and version model experiments for optimized decision-making. • Leverage JFrog Advanced Security features to scan models for vulnerabilities and ensure compliance. • Automate training, validation, and deployment processes for faster, more reliable ML results. • Collaborate effectively between data science and DevOps teams to accelerate model development and deployment. Who Should Attend: • Data Scientists. • DevOps Engineers. • IT Professionals & Project Managers. Don’t miss the chance to take your machine learning deployments to the next level. JFrog ML can transform your MLOps processes for greater speed, security, and efficiency.
Integrating machine learning with DevOps practices is essential for organizations to stay competitive. This hands-on workshop will introduce you to JFrog ML and its capabilities, empowering data scientists and DevOps teams to seamlessly manage the end-to-end machine learning lifecycle. Learn to securely build, deploy, and maintain machine learning models with JFrog’s powerful platform, while enhancing collaboration between data scientists and DevOps teams. Key Skills Learned: • Seamlessly manage the full ML lifecycle, from experimentation to production, on a single platform. • Track, compare, and version model experiments for optimized decision-making. • Leverage JFrog Advanced Security features to scan models for vulnerabilities and ensure compliance. • Automate training, validation, and deployment processes for faster, more reliable ML results. • Collaborate effectively between data science and DevOps teams to accelerate model development and deployment. Who Should Attend: • Data Scientists. • DevOps Engineers. • IT Professionals & Project Managers. Don’t miss the chance to take your machine learning deployments to the next level. JFrog ML can transform your MLOps processes for greater speed, security, and efficiency.

9

1:00 PM
Add to calendar
1:00 PM
Compliant SDLC Without Compromise: Navigating Regulations & Beyond with JFrog
Salon H
Maintaining compliance is no longer optional — it’s essential. This workshop guides you through the complexities of compliance regulations while ensuring the security and integrity of your software supply chain. Attendees will explore how JFrog tools, including JFrog Artifactory and JFrog Xray, enable organizations to not only meet regulatory requirements but also establish a culture of compliance excellence. Through hands-on experience, you’ll learn best practices for implementing compliance frameworks within your DevSecOps processes, automate compliance checks, and ensure rigorous security standards are met across the SDLC. Key Skills Learned: • Understand the key compliance requirements relevant to software development and deployment, including: NIST, SLSA, DORA, SOX and more • Use JFrog Artifactory and JFrog Xray to manage open-source and proprietary artifacts while ensuring compliance. • Automate compliance processes with JFrog CLI, REST APIs, and AQL to streamline workflows and reduce human errors. • Implement proactive compliance strategies and integrate security measures early in the SDLC. • Foster a culture of compliance excellence and improve collaboration across security, compliance, and development teams. • Monitor and report compliance status using JFrog tools for ongoing compliance verification. Don’t miss out on learning how JFrog can elevate your compliance strategy.
Maintaining compliance is no longer optional — it’s essential. This workshop guides you through the complexities of compliance regulations while ensuring the security and integrity of your software supply chain. Attendees will explore how JFrog tools, including JFrog Artifactory and JFrog Xray, enable organizations to not only meet regulatory requirements but also establish a culture of compliance excellence. Through hands-on experience, you’ll learn best practices for implementing compliance frameworks within your DevSecOps processes, automate compliance checks, and ensure rigorous security standards are met across the SDLC. Key Skills Learned: • Understand the key compliance requirements relevant to software development and deployment, including: NIST, SLSA, DORA, SOX and more • Use JFrog Artifactory and JFrog Xray to manage open-source and proprietary artifacts while ensuring compliance. • Automate compliance processes with JFrog CLI, REST APIs, and AQL to streamline workflows and reduce human errors. • Implement proactive compliance strategies and integrate security measures early in the SDLC. • Foster a culture of compliance excellence and improve collaboration across security, compliance, and development teams. • Monitor and report compliance status using JFrog tools for ongoing compliance verification. Don’t miss out on learning how JFrog can elevate your compliance strategy.

10

4:30 PM
4:30 PM
Welcome Reception
Vintner's Dining Room

11

7:30 AM
7:30 AM
Registration
Meritage Building - Lobby

12

7:45 AM
7:45 AM
Breakfast
Vintner's Dining Room

13

9:00 AM
Add to calendar
9:00 AM
Shlomi Ben Haim Co-Founder and CEO Shlomi is Co-Founder and CEO of JFrog, creators of the universal DevOps platform. He brings over 20 years of experience in building profitable, high-growth information technology companies. Prior to JFrog, Shlomi was the CEO of AlphaCSP (acquired in 2005 by MalamTeam) and a Major in the Israeli Air Force. Shlomi holds an MS from Clark University (Massachusetts, USA) and a BA from Ben-Gurion University (Israel). The Quantum Shift - Rethink Software Supply Chain
The Quantum Shift - Rethink Software Supply Chain
Meritage Ballroom

14

9:20 AM
Add to calendar
9:20 AM
Yoav Landman Co-Founder and CTO Co-Founder and CTO of JFrog, Yoav is the visionary behind Artifactory, the universal artifact repository manager. Prior to founding JFrog, he spent over a decade as a senior consultant specializing in Distributed Computing and Enterprise Build Systems and held several senior technical roles in global organizations. Yoav holds a master’s degree in computing from RMIT University and a Bachelor of Laws (LL.B) from the University of Haifa. AI-Driven DevOps Unleashed: The Future Starts Here
AI-Driven DevOps Unleashed: The Future Starts Here
Meritage Ballroom

15

10:10 AM
Add to calendar
10:10 AM
Eyal Dyment VP, Security Eyal Dyment leads Security at JFrog, where he is responsible for driving the company’s security product strategy and innovation across the software supply chain. With a deep background in AI, machine learning, and data-driven product development, Eyal brings a unique blend of technical expertise and business acumen to the evolving DevSecOps landscape. Beyond Packages: DevOps & Governance Delivered with Trust
Yossi Shaul SVP, DevOps Yossi Shaul is the Senior Vice President of DevOps Core at JFrog, where he leads the development of the company's core DevOps platform. With a career spanning over two decades in software engineering and leadership, Yossi has been instrumental in shaping JFrog's comprehensive solutions that integrate DevOps, DevSecOps, and MLOps practices. Beyond Packages: DevOps & Governance Delivered with Trust
Beyond Packages: DevOps & Governance Delivered with Trust
Meritage Ballroom

16

10:45 AM
10:45 AM
Coffee Break
Meritage Ballroom

17

11:00 AM
Add to calendar
11:00 AM
Yuval Fernbach VP, MLOps Yuval Fernbach is VP and CTO of MLOps at JFrog, where he leads the integration of a fully managed ML platform following JFrog’s acquisition of Qwak, which he co-founded. With deep expertise in AI and infrastructure, Yuval helps teams streamline the entire ML lifecycle, from data prep to deployment, bridging the worlds of MLOps and DevOps for secure, scalable AI delivery. AI Demands LLMs at DevOps Speed
AI Demands LLMs at DevOps Speed
Meritage Ballroom

18

12:00 PM
12:00 PM
Lunch
Vintner's Dining Room

23

2:00 PM
2:00 PM
Break
The swamp

28

3:00 PM
3:00 PM
Break
The swamp

33

3:55 PM
3:55 PM
Break
The swamp

38

5:00 PM
5:00 PM
Booth Crawl | Happy Hour
Meritage Building - Terrace

39

6:30 PM
6:30 PM
Gala Dinner: Featuring Celebrity Cellist Tina Guo
Meritage Lawn

40

10:00 PM
10:00 PM
Post Gala Open Bar
Crush lounge

41

7:30 AM
7:30 AM
Registration
Meritage Building - Lobby

42

7:45 AM
7:45 AM
Breakfast
Vintner's Dining Room

43

9:00 AM
Add to calendar
9:00 AM
Jens Eckels VP of Product Marketing Keynote Kickoff
Keynote Kickoff
Meritage Ballroom
Day 2 of swampUP drives practical application of EveryOps’ quantum shift across our industry. Join us, as we sharpen our minds for a day of learning and collaboration.
Day 2 of swampUP drives practical application of EveryOps’ quantum shift across our industry. Join us, as we sharpen our minds for a day of learning and collaboration.

44

9:20 AM
Add to calendar
9:20 AM
Maciej Mazur AI CTO Maciej Mazur is a CTO of Artificial Intelligence in EMEA at Dell Technologies. Based in Wrocław, Poland, Maciej works with enterprise and public sector customers to help them successfully integrate and leverage AI solutions for strategic growth as part of their digital transformation. As a lead architect on more than one hundred AI projects, Maciej is a recognized AI expert and industry blogger/podcaster. With his security clearance, Maciej is also able to discuss strategic projects with customers in governmental space. With cross sector experience, and deep telco and defense knowledge, Maciej works with the C-Suite and IT leaders to leverage AI across their organizations, breaking down silos and optimizing data investments. Customer inquiries often center on sovereign AI cloud strategies and hybrid cloud optimization, and Maciej works with them to provide expert guidance on architecture, implementation, and maximizing GPU utilization in these environments. He also works on the Dell AI Factory program that provides organizations with the building blocks for seamless integration of AI models and frameworks into their operations, enabling them to turn their ideas into practical applications. Maciej joined Dell Technologies in 2024 from Ubuntu, where he was a Principal Machine Learning Engineer, and has experience as Chief Data Scientist and lead solution architect with top IT companies. Large scale inference for the enterprise – architecture, security, and best practices
Large scale inference for the enterprise – architecture, security, and best practices
Meritage Ballroom
This keynote presentation will explore large-scale inference infrastructure for enterprises, focusing on architecture, security, and best practices. As an AI CTO at Dell, I had a privilege to be involved in our largest projects and I will share insights into both hardware and software solutions, highlighting deployed architectures and key learnings from customer implementations. I will show you how to build a SW stack that is able to deliver 30 billion recommendations daily across 4 billion web pages (which is live with one of our customers). Learnings will cover GPU utilization optimization, K8s scheduling mechanisms, monitoring distributed systems using open telemetry approaches balancing security best practices with innovation coming from open source world.
This keynote presentation will explore large-scale inference infrastructure for enterprises, focusing on architecture, security, and best practices. As an AI CTO at Dell, I had a privilege to be involved in our largest projects and I will share insights into both hardware and software solutions, highlighting deployed architectures and key learnings from customer implementations. I will show you how to build a SW stack that is able to deliver 30 billion recommendations daily across 4 billion web pages (which is live with one of our customers). Learnings will cover GPU utilization optimization, K8s scheduling mechanisms, monitoring distributed systems using open telemetry approaches balancing security best practices with innovation coming from open source world.

45

10:00 AM
10:00 AM
Coffee Break
Meritage Building - Terrace

46

10:20 AM
Add to calendar
10:20 AM
Demetrios Brinkmann Founder of MLOps Community Demetrios founded the largest community dealing with productionizing AI and ML models. In April 2020 he fell into leading the MLOps community (more than 75k ML practitioners come together to learn and share experiences) which aims to bring clarity around the operational side of Machine Learning. Since diving into the nitty gritty of Machine Learning he has felt a strong calling to explore the ethical issues surrounding the new tech he covers. In his free time he can be found building stone stackings in the woods with his daughters Evals are your Moat
Ensuring Reliable Evaluation Systems for Your ML
Meritage Ballroom
Standard benchmarks often fall short and can be misleading. Leaderboards can erode trust in model claims, as they rarely address specific, real-world needs. In this talk, Demetrios Brinkmann will detail how MLOps engineers and developers can build and continuously update their own evaluation systems to create a strong competitive advantage. He’ll cover how to build a reliable “golden dataset,” optimize data collection, labeling, and utilize the right tools to ensure evaluations truly reflect their intended use case.
Standard benchmarks often fall short and can be misleading. Leaderboards can erode trust in model claims, as they rarely address specific, real-world needs. In this talk, Demetrios Brinkmann will detail how MLOps engineers and developers can build and continuously update their own evaluation systems to create a strong competitive advantage. He’ll cover how to build a reliable “golden dataset,” optimize data collection, labeling, and utilize the right tools to ensure evaluations truly reflect their intended use case.

47

11:00 AM
11:00 AM
Coffee Break
Meritage Building - Terrace

48

11:15 AM
11:15 AM
Stealth Mode Session
Meritage Ballroom
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!

49

12:00 PM
12:00 PM
Lunch
Vintner's Dining Room

54

2:00 PM
2:00 PM
Break
The swamp

56

2:20 PM
2:20 PM
Stealth Mode Session
Salon K
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!

59

3:00 PM
3:00 PM
Break
The swamp

61

3:20 PM
3:20 PM
Stealth Mode Session
Salon K
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!

62

3:20 PM
3:20 PM
Stealth Mode Session
Salon J
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!
Some conference talks are simply too impactful, too important, too forward-looking to expose all the details far in advance. Stay tuned for more info on this exciting session that everyone will be buzzing about - just not yet!

64

4:00 PM
4:00 PM
Show Closing at Expo
Meritage Building - Terrace
Best Speaker Award & Raffle Winner Announcements
Best Speaker Award & Raffle Winner Announcements
No matching sessions were found

Thank You!

Thank you for inquiring about sponsoring swampUP 2024. We’ll be in touch shortly!