Both – with and across.
I was taught that rubbing with the grain has a tendency to pull finish out of the pores and will take longer to fill and create a smooth finish. Over time, I have found that for field guns I like texture on the stock; for finer guns, preference runs toward smoother satin finishes. The technique, more that the product, can give the desired finish.