I can't think of a reason you would be having trouble... maybe you have a firewall that kills the connection? Toggle your virus scanner or firewall off for a moment before connecting and see what happens when you turn it back on.
Unfortunately, we do not have access to the log files for the mumble server so we can't really see what's wrong, if anything, on the server's end.