Streaming millions of rows with Repo.stream/2 can cause your database to crash. As an alternative, consider using cursor-based pagination.

To make such streaming operations easier to write, we’ve just published a ecto_cursor_based_stream library that exports a Repo.cursor_based_stream/2 function, which has almost the same interface.

Come check it out!

Read here why it’s useful | Check out the source code