I use both..... but after initial shaping, I scrape most of the surface. I use the non sharpened edge of a utility blade. This is a blade being used to scrape brass. I use the same tool for brass, wood, and steel.
I do most of the wood and brass surface removal by scraping with a utility knife blade, but not with the edge - I stone the two 45 degree edges to a sharp 90 and use both sides of those. Scraping a large butt plate takes about 30 minutes. Scraping a whole stock to get out file, rasp, or carving tool marks takes about an hour...more if there is a lot of intricate carving to scrape around. Then I use sandpaper where ever necessary or useful.
Here I am scraping a butt plate with the angled edge of a box cutter blade. It takes off brass more rapidly and more smoothly than a file and leaves a finish that does not take too much more work with the abrasive paper or sticks. Wood comes of really fast and I have to be careful not to take too much.
By the way, I scrape steel parts as well. You just have to refresh the edge of the scraper much more often.