He's the Hokage which is basically the President of his village. He has a lot of work to do, and unfortunately his family life suffers because of it. His son thinks he's just a deadbeat who hates his family. In truth, Naruto is actually super paranoid about another threat like Kaguya happening, so he's always on edge and working hard. He genuinely cares about his family, and wishes that he could be two places at once. To him, he's showing his love for his family by working all the time to make sure another ninja war doesn't happen. He doesn't want his son and daughter to have to fight in a war at 16 like he did. 

He isn't a super present character for a lot of this series, but he does appear quite a bit in certain arcs.