When i rinse out the milk jugs I add a little bit of bleach to the bottles with degreaser dish soap.
Then let air dry out in the sun, before I refill them. Seem to help.