You can manage very nicely without dairy. Why are humans drinking another mammal's lactations after they are supposed to have been weened?
Getting calcium isn't usually the problem, it's in lots of foods, especially green leafy stuff, tahini (sesame), oranges, figs etc. The problem with most people on a Western diet is keeping it in their system. Eating too much protein, especially animal protein, acidifies the blood, and the body uses calcium to try to balance the pH. This means that most people leach calcium out of their bones and excrete it. Osteoporosis is highest, ironically, in countries where dairy consumption is highest (e.g. Scandanavia). It's almost unknown where diary is never, or hardly ever, used (e.g. rural China).
Give up dairy and enjoy improved health.