It really depends on your eyes' shape, contact brand, and solution used.
I wear Acuvue Oasys contacts, specifically for my astigmatism. Unless you rub your eyes or are working with or around a lot of airborne particles, you should be fine. Even then, I'd just keep a spare container and solution in my truck.