TGViewer
sysadmin.su sysadmin.su @sysadminsu · 329 subscribers
Post #2547 190

Forwarded from Технологический Болт Генона

FlowExporter is a sidecar that runs alongside all Netflix workloads in the AWS Cloud. It uses eBPF and TCP tracepoints to monitor TCP socket state changes. When a TCP socket closes, FlowExporter generates a flow log record that includes the IP addresses, ports, timestamps, and additional socket statistics. On average, 5 million records are produced per second.
. . .

FlowCollector, a backend service, collects flow logs from FlowExporter instances across the fleet, attributes the IP addresses, and sends these attributed flows to Netflix’s Data Mesh for subsequent stream and batch processing.
. . .
As noted in our previous blog post, our initial attribution approach relied on Sonar, an internal IP address tracking service that emits an event whenever an IP address in Netflix’s AWS VPCs is assigned or unassigned to a workload.
. . .
Attributing local IP addresses for container workloads running on Netflix’s container platform, Titus, is more challenging. FlowExporter runs at the container host level, where each host manages multiple container workloads with different identities. When FlowExporter’s eBPF programs receive a socket event from TCP tracepoints in the kernel, the socket may have been created by one of the container workloads or by the host itself. Therefore, FlowExporter must determine which workload to attribute the socket’s local IP address to. To solve this problem, we leveraged IPMan, Netflix’s container IP address assignment service.

How Netflix Accurately Attributes eBPF Flow Logs
https://netflixtechblog.com/how-netflix-accurately-attributes-ebpf-flow-logs-afe6d644a3bc

Предыдущий пост из этой серии
How Netflix uses eBPF flow logs at scale for network insight
https://netflixtechblog.com/how-netflix-uses-ebpf-flow-logs-at-scale-for-network-insight-e3ea997dca96

Спасибо подписчику за наводку
More from @sysadminsu
  1. Sep 24, 2026Speedtest Tracker — свой мониторинг качества интернет-канала Когда интернет периодически т…
  2. Sep 15, 2026💿 Cracking the Linux Boot Code - занятное чтиво от инженеров Oracle о диагностике запуска…
  3. Sep 4, 2026Post #2599
  4. Aug 5, 2026Python и DevOps: Ключ к автоматизации Linux (2022) Это практическое руководство научит вас…
  5. Aug 4, 2026Kubesplaining — CLI-инструмент для анализа безопасности Kubernetes, написанный на Go. Он п…
  6. Jul 11, 2026Проектирование POSTGRES: как задумывалась популярная СУБД Чтиво на выходные. 8 июля у Post…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →