I agree with both Dr Danny and SC.
Yup, you do have a problem. You also recognize it as such and you can even see the consequences thereof.
This works for some people, and does not work for the others.
Assign the time for your sex life, boards, hook-ups and whatever and stick with it. Do not allow the creep in and you'll be just fine.
Take your regular time off and do whatever pleases you, but draw clear lines. This is work and that is fun.
Don't mix the two. They do not mix too well usually and you know that this applies to your situation. So, show us some guts and do the right thing.
KD