I remember one time at Dixon's, Keith Casteel answered this question. If the inlay is missing on an old rifle, it was silver. If it was still there it wasn't. According to Keith they were pulled out during the depression to make ends meet (or something along those lines).
Rgds,
John