igvm: audit panics to make sure none of them can be hit when parsing unsantized data

[chris-oo]

While we have some panics for internal data where it should have already been sanitized, we need to make sure we don't panic instead of returning an error with context for invalid data (such as converting sizes to u32s, etc).