I've begun to think that, fundamentally, "animals can't consent" is more of an anti-animal argument than an anti-zoo argument. It's a rejection of animals' intelligence, agency, maturity, capacity, and communication.
Much anti-zoo bigotry has roots in anti-animal bigotry.