The grave and rfp areas are community property that can be viewed by either player whenever they desire. The only times I can think of when your opponent cannot view those areas is when the effect of "Question" is in play, or when a card is face-down, like for the effect of Different Dimension Capsule, your opponent cannot view that particular card even though it is in remove from play section.