DevOps & SRE notes

This commentary from Mercari Engineering outlines their strategy for a zero-downtime database migration. It is the first part in a series, focusing on the initial design for achieving strong data consistency.
https://engineering.mercari.com/en/blog/entry/20241113-designing-a-zero-downtime-migration-solution-with-strong-data-consistency-part-i/

The concept of observability in Kubernetes is more nuanced than it might first appear. This essay argues for a deeper understanding of the unique challenges and requirements for observing applications on the platform.
https://itnext.io/observability-is-not-equal-observability-in-kubernetes-1b79c4b8dc4c

Kubernetes-like control planes for form-factors and use-cases beyond Kubernetes and container workloads.

https://github.com/kcp-dev/kcp

A Kubernetes web UI that is fully-featured, user-friendly and extensible

https://github.com/kubernetes-sigs/headlamp

Ensuring messages are delivered in the correct sequence is a critical aspect of any chat application. This tutorial from Ably explores the architectural patterns required to achieve reliable message ordering at scale.
https://ably.com/blog/chat-architecture-reliable-message-ordering

In his recent post, Peter Szasz addresses the topic of imposter syndrome for new engineering managers. He offers personal insights and practical advice for navigating this common hurdle when transitioning into a leadership role.
https://peterszasz.com/managing-impostor-syndrome-as-a-new-engineering-manager/

🧹 Cleaning up images from Kubernetes nodes

https://github.com/eraser-dev/eraser

🧵 CLI tool for directly patching container images!

https://github.com/project-copacetic/copacetic

This guide provides a structured methodology for managing Terraform on AWS using the concept of "stacks." It demonstrates how to organize code for better reusability and maintainability across different environments.
https://mattias.engineer/blog/2024/terraform-stacks-aws/

Marcin Cuber's piece tackles the common challenge of managing etcd database size in Amazon EKS. The author provides actionable advice and commands for diagnosing and fixing issues related to database bloat.
https://marcincuber.medium.com/amazon-eks-managing-and-fixing-etcd-database-size-b6fb875888cb

Managing your Kubernetes clusters (including public, private, edge, etc.) as easily as visiting the Internet

https://github.com/clusternet/clusternet

Your 24/7 On-Call AI Agent - Solve Alerts Faster with Automatic Correlations, Investigations, and More

https://github.com/robusta-dev/holmesgpt

Understanding how state is managed is a fundamental aspect of using Infrastructure-as-Code tools effectively. This write-up offers a deep dive into the concept of state and its importance in the lifecycle of your infrastructure.
https://itnext.io/state-in-infrastructure-as-code-tools-40515f7b4840

This blogpost from the Zip Engineering team explains how they implemented security guardrails for Infrastructure-as-Code. The team shares their approach to ensuring secure and compliant infrastructure provisioning using CDK for Terraform.
https://engineering.ziphq.com/enabling-security-guardrails-infra-as-code-with-cdk-for-terraform/

Instant Kubernetes-Native Application Observability

https://github.com/pixie-io/pixie

An intuitive Terminal User Interface (TUI) tool for real-time monitoring and exploration of Kubernetes resources

https://github.com/sarub0b0/kubetui

This article details how to build a production-ready Kubernetes cluster on a shoestring budget using an old laptop. It provides a practical guide for turning dated hardware into a reliable and functional environment.
https://blog.devgenius.io/k8s-on-a-shoestring-building-a-production-ready-cluster-from-a-rusty-laptop-1ae8b963d557

Get insights into the challenges and best practices for building and operating a large-scale storage system, drawing from real-world experiences and architectural considerations for managing vast amounts of data. This article offers a deep dive into storage system design and operations.
https://www.allthingsdistributed.com/2023/07/building-and-operating-a-pretty-big-storage-system.html

A simple API client (postman like) in your terminal

https://github.com/Julien-cpsn/ATAC

Uncover valuable lessons learned from a real-world production incident, gaining insights into preventing similar issues and improving your incident response processes. This article shares practical advice for enhancing system reliability.
https://lucvandonkersgoed.com/2024/10/17/five-lessons-from-a-minor-production-incident-copy/