you,neither!

Just out of curiosity!

Can I say " You, neither!" in a situation below.

A: Ok, I’ve got to go.
B: Alright. Don’ work so hard!
A: You, neither!

Dose it make sense?

I think this is something that might be said informally, almost accidentally. It doesn’t seem like standard English though. I’m not sure that I would put a comma after “You”.

(Other points: Don’ should be Don’t. “Don’t work too hard” seems more likely to me in this context. I greatly dislike “alright”, but opinions vary. I would write “OK” not “Ok”. You have a lingering spacing issue around quotes:

Can I say " You, neither!" – INCORRECT SPACING
Can I say “You, neither!” – CORRECT SPACING)