Welcome to home theatre receivers. Unfortunately, that's an almost universal issue. There are a few that let you set the volume by input, but I don't think the Denon is one of them.

I am the Doctor, and THIS... is my SPOON!