I have been drinking coffee now since November 2015, and it has definitely been rocky. I experienced some of the anxiety you talk about. At first it made me feel very terrible, the caffeine, then I got used to it. At times I have backed off a bit on how much coffee I drink, which has felt right. Then inevitably this feeling right will instigate an increase in the amount I drink and it feels right at a higher dose where before it did not. Strange experience.
Sometimes you have to go Def Con 1 on low blood sugars with coffee. Sick people, or people with liver problems, especially. Like do not F**k around with low blood sugar. No half measures. You think you're above drinking maple syrup straight?! Where is your Peat dedication?! Get your head right.