There is an improvement on the schedule that will allow you to add or remove icons to external links. The progress of this feature can be followed in the roadmap, named "Visual indication external link in navigation structure / icon for external websites (Brand Policy)"

In the meantime, you can add icons to external links via this document.