Depending on the severity of the mismatch, yes it can affect daily driving too.
Add in inclement weather and multiply the effect by two, for good measure.
Think of it this way- tires are the only part of the car that touch the ground- how important do you think that makes them?
