I hit the internet! I was also able to use the RDP Client to get into work and update packages.
Looking back again, I probably should've just used the Browser Appliance from VMware. It's built on Ubuntu 5.10 and it's a lot smaller than a full install of Ubuntu from the install CD.
I could've then just added the tools I want to that Browser Appliance install. Oh well. It's easy enough to have both running or just blow away the Ubuntu VM and just use the Browser Appliance.
