This doesn't work for some reason, maybe it's because I'm on Mac?
It might be my machine's fault because
lsp-ui's childframe doesn't have border when they clain to do, either.
Anyway, the internal-border-width parameter works fine,
and internal-border face looks good, too.
So I guess the code is ok.