You must play your game really. If that's being completely silent that's fine. If you want to talk to others and table allows that, that is also fine. Other players might have noticed that you're intimidated by talking to you. Being intimidated affects how a person plays, so it's completely natural that they would abuse that behind the table.
Some people also love to talk and pay really close attention to their opponents how they respond, as it might give them a tell on what kind of hand their opponent has.
So if you're more of a silent person behind the table in general I would just focus on that. Try to ignore the conversation. Focus completely on the game. They might think you're being a bit of a weird guy, but if they do not get even a flinch out of you, they will give up sooner than later.
If you're a talkative guy generally, but you just feel that language barrier is to big there I would try to embrace it and talk with them. There is really nothing wrong you can say. It might give them a chuckle and if they are generally nice people, they will try to help you explain yourself better.
If you run into idiots however, it doesn't matter if they talk or not. They will remain idiots and you really shouldn't play them any attention.