Open-source Deep Dive is a series I started this year where I analyse an open-source project and share my findings about it. In this installment, Broadway - an Elixir library for building data processing pipelines for data sources like message queues - takes center stage!

The article is split into two parts. Part one talks about the general concepts in Broadway like message queues and the architecture of a pipeline. Part two dives into the implementation of various features like rate limiting.

Thank you and happy reading!