Ben,
Using the tang bolt to drive the floor plate out is a useful trick. Go slow! If the trigger floor plate has been browned then it might not be wood swelling but rust formation. Remember that even kiln dried wood has a moisture content of about 8%. That moisture is in contact with the browned components. Often some continued rusting will occur where the stell/iron components are in contact with the wood. Rust occupies about 3 times the space that the iron needed to make the rust does. Net result - rusted parts are bigger than unrusted parts. This is why fasteners can rust in place to the point where they are un-removable. A little vegetable oil around the trigger set might make things move easier and it wou't mar the finish.
Best Regards,
JMC