GopherCon 2015: Go GC: Solving the Latency Problem - Rick Hudson

If you liked this you might also find Rick Hudson's talk on GC improvements in Go 1.5 interesting: [VIDEO] [LINK]

Go's TLS support should be greatly improved in Go 1.6 thanks to the performance work you referenced by Cloudflare. The licensing issue was resolved and the work was merged 11/10/2016[1] While GC will always carry a cost, great improvements have been made over the last year and continues to be an area of focus for each Go release. Rick Hudson gave a nice update on Go's GC improves at GopherCon 2015 [2][3] [1] [LINK] [2] [LINK] . [3] [VIDEO]

It looks like a few things in there could further reduce typical and peak pause times, by backgrounding more phases of the work and rescanning stacks late so it's less likely much marking has to happen in the pause. I'm less clear on this, but "embrace write barrier during scan" and the other pacing changes might also better spread out work during the concurrent phases. The pause improvements in 1.5 are no joke -- here's a benchmark from the GopherCon talk on it: [LINK] (1.5 is the yellow dots along the bottom) (That talk is [VIDEO] and the slides are [LINK] ) And here's a graph from a real-world memory hungry app on a beta--300ms pause down to 4ms: [LINK] (Presentation on that app here: [LINK] ) Another app's pauses went from ~12ms to ~2ms: [LINK] And this doc means Go isn't moving to a generational GC now, which the pre-1.4 proposal speculated they might do in 1.6. That would mostly be a throughput win (discard short-lived garbage cheaply and early, so full GCs can be rarer), not a pause win (it could add new short pauses for young-gen GCs). Seems sane for now, since the polish they're talking about seems difficult, directly useful, and important as a basis for future work, and the pauses seem like the larger headache for the working Gopher anyway.

Oki, got it. Can't decide if that sounds like horrible conditions or a fun challenge =) For reference, the Go 1.5 GC propaganda: > Go 1.5, the first glimpse of this future, achieves GC latencies well below the 10 millisecond goal we set a year ago. Blog post: [LINK] Slide: [LINK] Talk: [VIDEO] Edit: Meanwhile, over in Java land they measure stop the world pauses in seconds , not milliseconds: [LINK] [LINK]

Wait, isn't Go devs said they solved GC latency problems [1]? (from 2015): "Go is building a garbage collector (GC) not only for 2015 but for 2025 and beyond: A GC that supports today’s software development and scales along with new software and hardware throughout the next decade. Such a future has no place for stop-the-world GC pauses, which have been an impediment to broader uses of safe and secure languages such as Go." [2] [1] [VIDEO] [2] [LINK]