The hardest thing for the night driver to adjust to, is resisting getting up to join co-driver for meals etc. Even with that done circadian rhythm demands you get very sleepy.
I have always said, if those sleep sensors were ever hooked up to the resting driver, new rules would be sure to come...