Horse hockey. The albino herd of Boulder Junction and white deer herd in Seneca (on the former Seneca Army Depot, the largest white deer herd in the world) show no health problems, or any unusual problems of any kind as a result of albinism. The Seneca herd has a lot of inbreeding deformities, but that's due to them being fenced in and inbreeding, not due to their white coats. The brown deer have the same exact issues, and other captive herds of brown deer that have inbred have the same issues, as well. Other white deer (including albinos) do just fine, and don't cause any problems within their herds. We have a rather small number of rare white Fallow deer in the LBL with no problems, with about half of those being true albino, and there is a relatively significant number of white-tail albinos throughout central TN that are strong and healthy. In Williamson County, TN alone (Nolensville, Brentwood, Franklin - just south of Nashville), there are between 40 and 50 albino deer, which is more than there should be in the entire state, according to the 1-in-20,000 occurrence rate.
Even the notion that white deer stand out like a sore thumb and thus are more susceptible to predators is a pure myth. I read that crap everywhere, in news stories, Wikipedia pages, even in the pages of Outdoor Life. It's one of those "absolutely true" conclusions that certainly make sense, but those who study these things have busted the myth. In the 37 states where they are not protected, white deer are taken by predators (man and others) at a slightly lower rate than brown and gray deer. One reason is, unless the animal predators (wolves, coyotes, bobcats, and what not) are already familiar with white deer, they don't even see them as food in the first place. (would you think of a bright white ribeye as food?). If white deer where truly as "Dave's Hot n Juicy" as the myth asserts, none of them would ever make it to adulthood to reproduce.
The notion that albinos are genetically more prone to disease and thus should be culled is also pure myth. If they were a problem in the herd, the herd itself would show distinct signs of ostracism or aggressiveness, but that doesn't happen. White deer, including albinos, mingle amongst the herd without any signs of ostracism or abnormal submissive or dominant behavior. The only exception is white deer, including albinos, tend to be a little more aggressive when it comes to food, but not so much that it's a problem.