It's as you've said. You cannot simply put a card into the grave for no reason.
The only cards that are sent to the grave after activation are Normal Spells, Quick Play Spells, Ritual Spells, Normal Traps and Counter Traps.
Nothing else can be sent to the graveyard (from anywhere) unless it's by a card effect or game mechanic.