Note to self for future reference when setting up a new installation that will be running X11: don't forget to either enable the keyboard shortcut (ctl+alt+backspace) in Preferences->Keyboard->Options->Key sequence to kill the X server or by running a SSH server so that it's possible to execute /etc/init.d/gdm restart.