How does condo association remove bad board member?

Short of committing a crime, what constitutes cause to remove a board member...one of our members continually tries to undermine the board and when confronted about it he denies it..He continually makes disparaging comments about the board to homeowners and no one on the board trusts him. It is impossible for the other board members to speak candidly in his presence.