SQS Lambda ESM Scaling Behaviour - Experiment Batch Size vs Processing Time
#Test
Important
This page only contains the experiments that have been done for the: SQS Lambda ESM Scaling Behaviour blog post.
We varied the processing time of the Lambda function (100ms, 200ms, 400ms, 600ms) and observed the total runtime. An SQS generator Lambda function is used to send messages to the queue at a constant rate.
#Batch Size 1
#100 ms vs 200 ms vs 400 ms vs 600 ms — at a glance
| Processing time | Total cold starts | Avg cold starts during ramp-up (per min) | Invocation ramp-up rate (per min) | Total invocations during ramp-up | Ramp-up time | Total run time |
|---|---|---|---|---|---|---|
| 100 ms | 195 | 157 | 10,843 | 50,871 | 1m 10s (28%) | 4m 10s |
| 200 ms | 358 | 265 | 9,237 | 55,734 | 1m 20s (31%) | 4m 20s |
| 400 ms | 795 | 281 | 5,265 | 128,758 | 2m 50s (65%) | 4m 20s |
| 600 ms | 1060 | 297 | 4,269 | 163,997 | 3m 30s (84%) | 4m 10s |
📈 CLICK TO SEE 100MS, 200MS, 400MS AND 600MS DETAILED RESULTS
#Processing Time 100 ms
#Processing Time 200 ms
#Processing Time 400 ms
#Processing Time 600 ms
Warning
The results below are invalid. The 400ms and 600ms tests hit the account concurrency limit and are thus invalid. I thought I would leave them here anyway.
📈 CLICK TO SEE INCORRECT RESULTS
#Batch Size 1
#100 ms vs 200 ms vs 400 ms vs 600 ms — at a glance
| Processing time | Total cold starts | Avg cold starts per minute of Rampup | Invocation ramp rate (per min) | Total invocations during ramp up | Ramp up time | Total run time |
|---|---|---|---|---|---|---|
| 100 ms | 243 | 155 | 11,309 | 84,567 | 1m 30s (47%) | 3m 10s |
| 200 ms | 456 | 248 | 8,990 | 90,231 | 1m 50s (46%) | 4m |
| 400 ms | 697 | 182 | 3,327 | 194,808 | 3m 50s (100%) | 3m 50s |
| 600 ms | 696 | 190 | 2,787 | 153,661 | 3m 40s (79%) | 4m 40s |
📈 CLICK TO SEE 100MS, 200MS, 400MS AND 600MS DETAILED RESULTS
#Processing Time 100 ms
#Processing Time 200 ms
#Processing Time 400 ms
#Processing Time 600 ms
#Batch Size 2
#200 ms vs 400 ms vs 600 ms — at a glance
| Processing time | Total cold starts | Avg cold starts per minute of Rampup | Invocation ramp rate (per min) | Total invocations during ramp up | Ramp up time | Total run time |
|---|---|---|---|---|---|---|
| 200 ms | 263 | 245 | 7,459 | 23,411 | 1m (27%) | 3m 40s |
| 400 ms | 436 | 238 | 4,534 | 50,584 | 1m 50s (48%) | 3m 50s |
| 600 ms | 571 | 286 | 3,699 | 50,776 | 2m (46%) | 4m 20s |