TGViewer
Software engineering blogs Software engineering blogs @software_engineering_blogs · 190 subscribers
Post #2152 49
[Spotify]
How Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020
In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, Wrapped 2019, for Wrapped 2020 using a technique called Sort Merge Bucket SMB join. We’ll present the design and implementation of SMB and how we incorporated it into our data pipelines
Spotify Engineering How Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020 - Spotify Engineering
Open in Telegram All posts from @software_engineering_blogs
More from @software_engineering_blogs
  1. May 24, 2021[Slack] Role Management at Slack Controlling which users are able to take which actions is…
  2. May 21, 2021[Uber] Fraud Detection: Using Relational Graph Learning to Detect Collusion As Uber grew i…
  3. May 21, 2021[Airbnb] Building a faster web experience with the postTask scheduler Building a Faster We…
  4. May 21, 2021[Dropbox] How we managed our global supply chain through a year of lockdown
  5. May 20, 2021[Facebook] Peering automation at Facebook Traffic on the internet travels across many diff…
  6. May 20, 2021[Skyscanner] Maker to Manager — How We Support New Leaders Maker to Manager — How We Suppo…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →