All in all, loads are taken into account on a load by load basis. This probably would not have been considered to be a load refusal against you with our company. However, if you were sitting for a length of time and the load may have brought you to a better freight lane, you may reconsider load offers like that, especially if the company pays you some deadhead pay.
Good question,
ABC