To delete a song, click the overflow or long press and click the delete. The song should then be removed from Rocket Player.