As a non-american I was unsure if I should use «midget», «dwarf», «little people» or even «vertically challenged». For me «vertically challenged» sound the most offensive because sound like I'm subtly mocking them.

Decided to pick dwarf because it's the shorter term and I'm sure I'll offend anyone anyway. This said I always think of the fantasy race when I say «dwarf».