It depends on how severe that anxiety is. Does it have major impact on your job and your home life? Only you can determine if this type of job is right for you.
When I'm on the road I miss being home. After awhile at home, I miss the road. But that's just me. You have to find a balance...