My Advice: I wouldn't move. I'd just got to the ward you want.
I still feel that the boundaries are set by well meaning individuals who strive to be inspired and moved to make the right decision. The boundries are set to create a strong ward with enough active members to support the ward. When people go to other wards it affects the ward. If people just go where they want then it would cause allot of chaos and many members would be affected. I'm aware of this.
I used to look down on members who attended other wards outside their boundaries as flawed somehow.
Not anymore. I've repented. I think you do all you can but if it comes between not going at all or having to move, I would just stay where you are and go to another ward.
My former Bishop who I love and greatly respect held that belief. He held the same belief for church classes. As a Sunday school teacher my class was full with older kids from other classes who otherwise just wouldn't attend sunday school. The Bishop was just happy the kids were in class.
I think maybe it's time to circle the wagons and go where you feel more comfortable till you feel you have the strength to return and contribute to your home ward.