The datasets can be too large to handle entirely in-memory, but we should do the processing. With Ecto.Repo.stream/1 we can process it in batches.

Check more on: https://bartoszgorka.com/ecto-repo-stream-in-large-data-processing