There is some confusion here. The shift-control-alt-escape does not switch to the VESA driver. It just switches to a safe video mode (probably 1024x768 or 800x600 with 16bit or 256 colors? I could not find where this is implemented in the code...).
The "failsafe graphics driver" option in the boot menu does switch to the VESA driver, which is a completely different thing.
If you're having graphics glitches to start with, and both of the drivers fail in some way, it sounds a bit worrying. Are you sure the hardware is ok? Does it work with other OS?
For further investigation, please provide syslogs for the following situations (make sure to delete the syslog from /system/var/log/syslog between each test to have results for just oen boot in each):
- Booting with the failsafe graphics driver enabled
- Booting normally, then changing the video mode