Is the pretrained mae encoder weights available ? about i-code HOT 2 OPEN

In the transformer weights, for mae, there are only weights for patch_embed and special_vis_token (and pos_embed), but not the blocks. And in the forward method, you indeed only use patch_embed to encode the patches.

Do you not use the full mae like in udop_dual? This simple projection carries all the information for font, line spacing, color etc etc?

from i-code.

The MAE checkpoint is together with the transformer weights included in the checkpoint.
if you want the original MAE weights you can download it from the original MAE codebase.

from i-code.