On your MSWORD menu, choose INSERT, then SYMBOL.

This menu will appear. From here (selecting normal text) you can insert umlauts, (ü ö ä, Capital umlauts Ü Ä Ö, ß, €)

If you regularly type in these symbols, the recently used symbols filed will appear with these items.