Install the microsoft  Intellipoint driver and it will auto switch it for you when you connect to the terminal server.