Although MuPDF handles multiple different file formats, it offers a unified API for dealing with them. The fz_document API allows all the common operations to be performed on a document, hiding the implementation specifics away from the caller.
Not all functions are available on all document types (for instance, JPEG files do not support annotations), but the API returns sane values.