Issue With Remote Access Connecting To Remote Desktop Via Browser

I setup remote access and VPN through the wizard on Windows Essentials Server 2012 but I am having issues.

So, what works:

• I can connect both from my LAN and external networks to the server via the remote access URL
• From there I can connect to shares, upload and download files etc...

The issue starts when I try and connect to the server for remote desktop via the Computers link. It says the server is available, but I get this error: Your computer can't connect to the remote computer because an error occurred on the remote computer that you want to connect to. Contact your network administrator for assistance.

I try and connect with an administrator account. The same problem happens if I try and connect to another machine that shows active. Just a note, standard RDP from within my local LAN works fine to all these boxes...

Since access to the remote access portal is working, I think that indicates my router port forwarding is OK. Since I can remote connect via the remote client on the LAN I would assume rights for my account is setup right...

Any thoughts?