Getting rid of black walnut trees

I have many black walnut trees in the tree lines bordering my pastures. I was told that they pose minimal risk and that cutting the trees down would be more dangerous because of possible contamination.

I wanted to add that I DO pick up the walnuts every fall when they all hit the ground. They are a real tripping hazard for humans (ask me how I know :o) and can become massive projectiles when mowing or bushhogging.