He's doing you a favour. Benzos are harder to get off of than potent opiates, and certainly more difficult than any of the other medications you listed. They make you feel... nothing, which is lovely, but then you have to take more and more and more to feel that nothing. You never feel like you have a problem, everything is going just fine and you're in control. The problem is they make you a fucking zombie and everyone can see the problem except for you. You'll eventually get cut off by your doctor and go through hell, only to realize you don't even remember much of the time you spent taking them, and your anxiety, which you didn't even mention, will likely be worse than it was before. I have a fantastic memory, but the times I was on benzos are like static with random faint outlines of memories. And mind you, this is all just with regular use, as perscribed, with an increase in dosage over time by your doctor. They have to do that as soon the low doses will do nothing for you in a few weeks. There's no safe self management of benzos, unless you get a very small amount filled for a plane ride or very infrequent panic attacks, something like that.
If you are suffering from anxiety, panic attacks, or agoraphobia (which you didn't even mention...), see a psychologist/psychotherapist/shrink/counselor
Someone who will talk to you and help you work through your problems and give you the real tools to fix yourself. Your psychiatrist should be forcing you to see one anyways if you have so many mental issues.
This