I think maybe just watch them? I've seen it on the "ok to eat" and "will kill them" list as well, but if there are no ill effects, then I wouldn't worry about it.
for example, we have avocado trees around our property (we live in the tropics), and most lists I've seen say avocados are poisonous...like deadly poisonous. well....my goats thing otherwise. they love the stuff, and nothing happens to them. I don't let them eat too much, but sometimes when we're walking by, they dive in for them. I have one doe who sniffs out avocados on the ground and devours them.
just have to watch and see if they're getting sick or not. if not, then it should be ok.