Rubber bumpers go in those holes on the frame but the steering stem does not come anywhere near hitting them.
Right. You can mount a bracket that will raise the bumpers to the level of the tie rod mount. That's seems to be the easiest solution short of going to a stock zilla stem.