He wasn't much, mind you

In the dialogue below, I don’t understand the bold part. Can someone explain it to me, please? Thanks.

“I don’t do that anymore.”
“Neither does my brother, now that he’s dead.”
“I’m sorry.”
He wasn’t much, mind you - just family.”

Here’s my thoughts:

He wasn’t much = he wasn’t important, we didn’t think much of him.
Mind you = keep in mind.
Just family = part of my family (brother, sister, etc.)

So he says that “don’t feel sorry for me, he didn’t mean much to me anyway, so I’m not grieving over this demise”.

Thank you very much, Our Tort System (too long a name:)). One more question: Is it common to say, for example, “he isn’t much” instead of “he isn’t much to me”?[/img]

I can only speak from my limited experience as a non-native speaker. :slight_smile:
Bearing that in mind, yes, “he sin’t much” is a frequently used expression.

Ok, thanks for your replies.