mix test.interactive allows you to re-run your tests every time something changes while interactively controlling the arguments passed to mix test. See the recent blog post or check out the library on hex.pm.