Do baby mice carry disease?

my house has had a vermin problem for about a 3 months now and while i was sitting on my couch today a baby mouse crawled behind my back over my shirt. i am not super paranoid or anything but what are the chances that mouse could be infectious? i live in canada by the way and it is winter here if that is relevant or not.