RemoteApp and Desktop Connections update returns Error code: 0x80070003

We were having this issue on a machine and discovered that the Start Menu folder with all of the RemoteApp Shortcuts had not been deleted when they removed the connections. We manually deleted these folders and we were able to restore the connections.

The RemoteApp shortcuts will be in a folder under:

C:\Users\%username%\AppData\Roaming\Microsoft\Windows\Start Menu\Programs