Can you get HPV from a guy who hasn't had with anyone else?

If you have never had with anyone but him, and he has never had with anyone but you, can you still get HPV? I'm not sure where it starts...is it only ually transmitted, or can it be transmitted in other ways? Can it be hereditary?