Should We Type or Talk to LLM Agents? A Comprehensive Study of Voice and Keyboard Input Perturbations