How do you decide when to switch from regular ward to sweeper?

I have a hard time deciding when to switch or even switching at all from regular wards to sweepers. I do a good job of placing deep wards in the enemy jungle especially before objectives to make sure I can see where the enemy is coming from. Sometimes I am getting spotted without knowing and have a failed gank.