I think that everyone is too tired or off at some time.

Regretted? Not if you've made it good for your partner.

I haven't refused sex because I was too tired since I've never been put in that situation, however some days are so long and stressfull that I can see myself refusing sex.

I have refused sex a couple of times, but at the end of the day you are only denying yourself the satisfaction