'you shake them with the hand' vs 'you shake them by the hand'

Hello! Please help me to choose the right preposition and please explain why is so.

When you first meet someone, you usually shake them … the hand.
a)with b)by

Thanks in advance.

“By” is right. Even more common is “shake someone’s hand”.