OpenVPN and NoIP not playing nice

I've got OpenVPN running, and the NoIP DUC running, if I setup OpenVPN to use my current IP everything works well, can connect, and more importantly can access the Internet. If I configure it to use my DynDNS through NoIP then it allows my to connect, but I then have no access outside my local network. If I was just trying to access a server that would be fine, but obviously this is supposed to be a VPN.....