I feel that as wives, it's up to us to say something when our husband's are doing things that would make them unworthy to hold the priesthood. Not in a derogatory or angry way of course, but lovingly. There have been times that my husband has come to me and told me that I'm not being the best wife and mother. It made me mad at first, but I thought about it and he was right. I think we need to do the same for them. In fact, just yesterday I told my husband for the first time in almost 7 years of marriage that he needed to shape up because he's not doing what he should be as a worthy priesthood holder. He argued with me and said that he wasn't doing anything bad, which he's not. But he's also not doing all the good that he should be, none of the basics. We talked about it for awhile and he promised me that he would start trying harder.
To me it's kind of like checks and balances. Husbands and wives should balance each other out, and when one of them is out of line or slacking in some way, the other needs to point it out and help them fix it. I feel like it's part of my responsilibity as a mother to do everything possible to help my husband out so that we have the priesthood in our home.
So obviously I don't think there's anything wrong with you having a conversation with your husband about this, just try to make it non-judgmental. I'm sorry that you're having to deal with this, I hope things get better for you.
