Dave, I don't have the problem myself, but I recall more than a few guys getting a similar reaction when working walnut. I seem to recall they mainly had problems when sanding. Don't know what can be done, other than wearing a mask, but I don't think your alone.
Ed