Software engineering blogs

[Docker Engineering]
Docker Hub Incident Reviews – April 3rd and 15th 2021
In line with our promise last year to continue publishing incident reviews for Docker Hub, we have two to discuss from April. While many users were unaffected, it is important for us to be transparent with our community, and we hope it is both informative and instructive. April 3rd 2021 Starting

[Airbnb]
Airbnb’s Promotions and Communications Platform
OMNI is an intuitive, homegrown platform that supports message creation, processing, and distribution to engage our guests and hosts at the right time and on the right channels.By Paritosh Aggarwal and Henry WuIntroductionAirbnb is a busy marketplace with millions of active users across the

[Uber]
pprof++: A Go Profiler with Hardware Performance Monitoring
Motivation for a Better Go Profiler Golang is the lifeblood of thousands of Uber’s back-end services, running on millions of CPU cores. Understanding our CPU bottlenecks is critical, both for reducing service latencies and also for making our compute fleet

[GitHub]
Security keys are now supported for SSH Git operations
GitHub has been at the forefront of security key adoption for many years. We were an early adopter of Universal 2nd Factor “U2F” and were also one of the first sites to transition to Webauthn.

[Rust]
Announcing Rust 1.52.1
The Rust team has prepared a new release, 1.52.1, working around a bug in incremental compilation which was made into a compiler error in 1.52.0. We recommend all Rust users, including those currently using stable versions prior to 1.52.0, upgrade to 1.52.1 or disable incremental compilation

[Medium]
Breaking up Big Fred
or, the trouble with the monolith🐧 What is Fred?One of Medium’s most well-used and beloved internal services is Fred Penguin, our unofficial mascot and homegrown Slack bot.Every day, Medians use Slack commands like fred helpdesk my laptop is broken! to file support tickets with IT or fred hi5

[Uber]
Optimal Feature Discovery: Better, Leaner Machine Learning Models Through Information Theory
Introduction Suppose you own a production ML model that already works reasonably welTheory know that adding relevant and diverse sources of signal to your model is a sure way to boost performance, but finding new features that actually improve performance

[Soundcloud]
High-Tier Content in the SoundCloud API
You can now retrieve metadata for our full SoundCloud catalog through our API by providing the new filter in your request. Until recently

[Docker Engineering]
Video: How to Dockerize a Python App with FastAPI
Join host Peter McKee and Python wizard Michael Kennedy for a warts-and-all demo of how to Dockerize a Python app using FastAPI, a popular Python framework. Kennedy is a developer and entrepreneur, and the founder and host of two successful Python podcasts — Talk Python To Me and Python Bytes

[Lyft]
Getting to Know Engineers in Data at Lyft
Meet Allison and Temo, two Software Engineers on the Data Platform team. We asked them to share about their work and experience at Lyft.Allison SuarezAllison is a full-time software engineer for the Data Platform team at Lyft and is also a former intern. She primarily works on Amundsen, an open-

[Netflix]
Netflix Drive
A file and folder interface for Netflix Cloud ServicesWritten by Vikram Krishnamurthy, Kishore Kasi, Abhishek Kapatkar, Tejas Chopra, Prudhviraj Karumanchi, Kelsey FrancisIn this post, we are introducing Netflix Drive, a Cloud drive for media assets and providing a high level overview of some of

[GitHub]
GitHub Availability Report: April 2021
In April, we experienced two incidents resulting in significant impact and degraded state of availability for API requests and the GitHub Packages service, specifically the GitHub Packages Container registry service. April 1 21:30 UTC lasting

[Airbnb]
How does Airbnb track and measure growth marketing?
By: Jing Guo, Henry Wu, Abhrajit Mukherjee, Shike MeiIntroductionAirbnb’s mission is to “Create a world where anyone can belong anywhere.” This message is delivered to people all around the world through marketing, e.g., See What’s Possible When It’s Made Possible by Hosts. It helps Airbnb

[GitHub]
How we use Web Components at GitHub
At GitHub, we pride ourselves on delivering a first-class developer experience. A considerable part of our work is on our front end, which we strive to keep as lightweight, fast, and accessible as possible. For

[Airbnb]
How Airbnb Achieved Metric Consistency at Scale
Data is the voice of our users at scale. In the midst of the COVID-19 pandemic, we saw that travel with Airbnb has become hyper-local.Part-I: Introducing Minerva — Airbnb’s Metric PlatformAuthors: Robert Chang, Amit Pahwa, Shao XieIntroductionAt Airbnb, we lean on data to inform our critical

[Skyscanner]
Turbolift — a tool for refactoring at scale
Turbolift — a tool for refactoring at scaleSkyscanner’s systems are anything but small-scale. With millions of travellers using our site and app every month, we handle dizzying volumes of requests across a microservice architecture that, itself, is pretty huge. All-in, there are several hundred

[GitHub]
Scaling monorepo maintenance
At GitHub, we serve some of the largest Git repositories on the planet. We also serve some of the fastest-growing repositories. Each day, the largest repositories we host become even larger. About a year ago,

[Rust]
Announcing Rustup 1.24.1
The rustup working group is happy to announce the release of rustup version 1.24.1. Rustup is the recommended tool to install Rust, a programming language that is empowering everyone to build reliable and efficient software. If you have a previous version of rustup installed, getting rustup

[Uber]
Automating Merchant Live Monitoring with Real-Time Analytics: Charon
At Uber, live monitoring and automation of Ops is critical to preserve marketplace health, maintain reliability, and gain efficiency in markets. By the virtue of the word “live”, this monitoring needs to show what is happening now, with prompt access