This shouldn't hurt the stem. 34 years ago I drilled a small hole throu gh the stem for my Ken Rogers trike for a brake cable and it is still sound . Keep in mind that with a trike the handlebars are subjected to twisting forces that a bike never experiences. If a stem were to fail because of a small hole through the stem mine should have failed long ago.
Paul Patzkowsky
Longmont, Colorado