You are certainly the mistress of your own time and life, but I think there may be something to what he's saying (what I imagine he's saying, in any case).

I have the greatest respect for your drive to help our students, but if nothing else, becoming Head of House taught me that you can only do so much if there's nothing left for you.

Don't be afraid to be a little selfish.