Defense wants judge removed from Allen trial