TGViewer
CatOps CatOps @catops · 5.08K subscribers
Post #2862 1.62K
A story from OpenAI on how they scale Postgres.

While this is an interesting read, and you can definitely borrow some ideas from there; I got an impression that OpenAI is moving towards Azure’s CosmosDB from Postgres.
If a new feature requires additional tables, they must be in alternative sharded systems such as Azure CosmosDB rather than PostgreSQL.
—-
While we’re happy with how far PostgreSQL has taken us, we continue to push its limits to ensure we have sufficient runway for future growth. We’ve already migrated the shardable write-heavy workloads to our sharded systems like CosmosDB. The remaining write-heavy workloads are more challenging to shard—we’re actively migrating those as well to further offload writes from the PostgreSQL primary.

Cosmos DB, from my understanding, is a document-oriented DB from Microsoft, similar to MongoDB.

#databases
OpenAI Scaling PostgreSQL to power 800 million ChatGPT users An inside look at how OpenAI scaled PostgreSQL to millions of queries per second using replicas, caching, rate limiting, and workload isolation.
  • ❤ 6
  • 👍 4
More from @catops
  1. Oct 1, 2026​​I traded my personal information for this report, so you don’t have to! DataDog presents…
  2. Sep 29, 2026A Cybersecurity books bundle by O’Reilly on Humble Bundle. The bundle is fresh and is stil…
  3. Sep 28, 2026​​For today’s Donations Monday, I’d like to remind you about a fundraiser for a pickup tru…
  4. Sep 26, 2026Here’s Datadog’s take on the increased load on CI. In this article they explain how their…
  5. Sep 25, 2026A new chapter of the CatOps Digest is here! https://newsletter.catops.dev/p/catops-digest-…
  6. Sep 24, 2026Shopify wrote an article on them moving from React Native to the native code for their mob…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →