Serverless can save you money, but the tradeoff is that it is weird. Your CPU gets frozen between requests. Your code runs in a tiny, isolated sandbox with extremely limited resources. And every millisecond of initialization time costs money.
In this episode of Datadog Illuminated, AJ Stuyvenberg, Staff Engineer on Datadog’s Serverless team, explains how his team rewrote Datadog’s serverless agent from scratch, in a language none of them had ever used in production.
The rewrite cut the binary from 55 megabytes to 7 and dropped cold start time from around 400 milliseconds to 50-60.
Give it a watch! www.youtube.com/watch