Ginger is pretty wildI had a similar issue after taking a break from raw milk (to do a dairy free experiment) for a while and reintroducing it. I suspect, my gut health decline from all the heavy fibrous plant food matter I was consuming, from plant carbohydrates. So I did a heavy binge of eating extra carrot salads and bamboo shoots and taking some other anti-biotic substances. After a few weeks of doing that and cutting starch out and replacing it only with whole fruits, I was able to start adding in my raw milk again. But this time, I brought the milk to a boiled and cooled it before drinking. I then was able to go from doing that to slowly having the raw milk uncooked again. But I do notice, that, even with the raw milk, digestion is best if it is at least warm, as is more natural anyway (babies drink their milk warm).
Even if I have to continue to boil the milk for best digestion, I still find it superior to store-bought pasteurized milk because it is fresher and has no vitamins added to it, or off-label ingredients like gums, as is reportedly the case with a number of normal milk brands and even organic milk brands. If one has a milk-centric diet like I currently do, then its no option for me to use store-bought milk because of not just off-label ingredients, but because the amount of Vitamin A and D added would add up to being way too high for me, which isn't very natural because the added Vitamin A and D content of store bought milk is much higher than the Vitamin A and D that is naturally in the raw milk. So that way I am getting a better balance of Vitamin A and D naturally, and not potentially 'overdosing' on them. And of course there is the homogenization of store bought milk, which I see as the next main concern next to the added vitamins and off-label ingredients. Homogenization concerns me more than pasteurization (which isn't a huge issue for me). I also agree, it is nice to support local farmers as well.
I also found that boiling ginger with milk greatly helps with my digestion, and tastes great --- and potentially has some strong anti-serotonin effects from the ginger.