Nov 18, 2024 8 min read kubecon

🇺🇸 KubeCon NA 2024 recap

Ok, but what's the fuzz? For me, there were three topics that I was interested to see how they develop: - AppDev & Dapr Graduation - Platforms - Extending Kubernetes (Multi-cluster, multi-tenant, LLMs, Multi cluster Batch Jobs)

After thousands of exciting conversations, I survived KubeCon NA 2024. Personally, it was the most impactful and enriching KubeCon so far. I made many new friends and got to catch up with the usual cloud native suspects.

Ok, but what's the fuzz? For me, there were three topics that I was interested to see how they develop:

Application Development Working Group, AppDeveloperCon Co-lo event and the Dapr Graduation
Platform Working Group and Platform Engineering Day
Extending Kubernetes to support a wide range of workloads (Multi-cluster, multi-tenant, AI, LLMs, Multi cluster Batch Jobs)

Let's cover these topics briefly. All slides, videos, and pictures can be found at the end of the blog post.

AppDevs

With the last edition of AppDeveloperCon, and the topic graduating to a full track at KubeCon EU 2025 in London, we saw a large number of submissions about tools focused on improving developer's day to day operations including testing, observability and abstractions to facilitate the creation, operation and maintenance of cloud native applications.

As part of the Application Development Working Group for the CNCF we have been working hard to get the following survey out. I would appreciate it a lot if you can fill it in. This will help the AppDev WG to define the next steps and start preparing for 2025 with hard data coming from the cloud native communities interested in application developers.

I had the pleasure of hanging out with Collin Lacy from Cisco, Jonas Kunz from Elastic, and my friend and co-chair of the WG Daniel Oh from Red Hat. All these conversations, including the most dense and compact chat with Ryan Nowak from Microsoft made me think about the gaps we currently have in unifying application portability across environments (blog post coming soon).

On completely different news, the new messaging around WASM was quite a shock to hear during the keynote on Friday, so I "ranted" a bit on X.

At the end of the day, this is great as the new messaging about decoupling application code from the runtime/environment has traction in all cloud native communities, not only WASM and mature tools like Dapr are already providing a solution for such concerns.

With Dapr graduating from the CNCF incubation process, I can feel the momentum building up and I can't wait to see how this evolves until KubeCon London 2025.

Now that there is a whole dedicated track to Application Development, I am sure that tools like Dapr will shine. It was a real pleasure to have Hugo Smitter from FICO present their platform use case at both Platform Engineering Day and AppDeveloperCon.

We also saw a sneak peak of the new Dapr Conversation API, from Yaron Schneider Dapr co-creator. This new API brings caching and PII scrubbing to make it easy to interact with a wide range of LLMs and save money.

I did two presentations at AppDeveloperConWith:

Intro to the App Dev WG with Daniel Oh
Why does continuous profiling matter to developers? With Jonas Kunz from Elastic

I look forward to seeing how the first Application Development Track shapes up for 2025. If you haven't submitted your presentation yet, please do so here: https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/program/cfp/#submit-your-talk

Platforms

There was a lot of movement in the platform space last week. With the new announcement around official CNCF trainings and certifications coming next year.

I was lucky to meet the platform working group co-chairs and members and discuss what topics these training and certifications should cover in person. If you are interested in helping to shape the future of these certifications and trainings, please fill out the form here: https://training.linuxfoundation.org/platform-engineering-programs/

My presentation "Taming your application's environments" at the SLCD track with Marcos from the Dagger team aimed to show how important it is for platform teams to craft experiences that can work across environments and smooth out the way of working, no matter which environment we are targeting.

I also had the pleasure of doing a quick presentation at the OpenShift Commons Gathering, a parallel event that is hosted by Red Hat to their OpenShift customers. Thanks a lot Valentina for organizing!

I also did a book signing session of my book titled Platform Engineering on Kubernetes with Loft Labs that went extremely well. I had the pleasure to say hi to so many people, unfortunately I haven't got all the pictures yet, but if you stopped by the booth, thank you so much!

Kudos to my friend Abby from Syntasso and the Platform WG for organizing the CoffeeOps / Platform Coffee rounds at Cupla Coffee where they met every morning at 7:30 🕢 to move the working group discussions forward and catch up in person. I had the pleasure to have a quick but very enriching chat with Erica from Tetrate and do a quick book signing thanks to Synstasso for the books too!

Extending Kube

On the first day of the keynote, Ricardo Rocha did a live demo on scheduling batch jobs across multiple clusters in different cloud providers with an instant feedback mechanism using the Kueue project. While this approach follows projects like Cluster API of solving one problem across multiple providers, I liked the showcase of the project applied to a real-life use case at CERN.

I realized that most of the sessions that I wanted to attend were around tools that will focus on managing tasks across multiple Kubernetes clusters, multi-tenant solutions (including solutions that work on a single cluster), and how these tools relate to each other. I was interested to see which vendors are getting into this space and how new tools are created to solve core challenges that most companies will face when adopting Kubernetes at scale.

It was always good to catch up with Stefan from Upbound/Crossplane/KCP as I still believe that we should be investing more time on grow the capabilities in the management layer that is distributed across multiple Kubernetes Cluster (and other cloud resources). I was happy to see that the KCP is extremely vibrant and moving forward.

I enjoyed the presentation from James (creator of the Cert Manager project, now working at Apple), who discussed the idea of introducing the concept of WorkingSpaces (a logical group of Namespaces) to the Kubernetes APIs server. It is interesting how large companies like Apple need to build these mechanisms outside the Kubernetes project (right now it is a proxy in front of the Kube API Server) to prove value before going through the hassle of proposing the changes officially to the project.

Finally, with the recent announcement of KRO (Kubernetes Resource Operator) from Amazon makes me think we will have an exciting 2025 in this space. (👀 waiting for the Google announcement in the same space).

Sum up

I am sure that I am forgetting tons of important conversations, topics and people, but I wanted to close this blog post with two things that I hope to see in London.

First, let's make sure we help new people join these communities. It can be really challenging for newcomers to understand how these very large events works. Going one step further and making sure that they know how to contribute or move forward with the project that they are interested in is key to not only being more inclusive but also making sure that the cloud native space remains vibrant. Meeting Zoey, a GSoC student and Knative contributor, was a pleasure and a reminder of how important it is to make first-time comers feel welcome and connected.

Finally, have FUN, make sure to connect with other people and have FUN! I think this picture summarizes it for me. Beating the classic The Simpsons video game with Jared from Upbound at the Dapr + Crossplane Graduation party was one of the highlights.