A question about the latest Prop. 8 issue

If Judge Walker should be disqualified from ruling on Prop. 8 due to conflict of interest because he's gay, shouldn't 95% of the Congress be disqualified from voting for tax cuts for millionaires?