Refreshing the Windows icon cache
I just updated to the latest and greatest version of Visual Studio Code, but alas my taskbar was still showing the old icon:
From this GitHub comment, here's a quick way to force the shell to refresh its icon cache, [Win]-[R] > ie4uinit.exe -show and there it is: