I've always thought as death as being (obviously) a skeleton who speaks in a thick thrummy humm that you can't understand, and there would be subtitles in CAPS, so there would be no actor for Death, just a sound design team. The subtitles would also help translate a lot of death's humor to the screen.