External predictions with `mapanything` model not working

[omaralvarez]

I'm getting weird results when usin external model inference with the mapanything model name. I think it is due to using:

model = init_model_from_config(args.model_name, device=device)

And the function not initializing the model weights to the model checkpoint, since normal inference with MapAnything class are working fine:

model = MapAnything.from_pretrained("facebook/map-anything").to(device)

The rest of the external models work fine.

Am I making any mistakes?

By the way, great work. Much appreciated!!

[Nik-V9]

Hi, Thanks for trying out the codebase!

You are right, the init_model_from_config function doesn't initialize MapAnything with pretrained weights. For this to work, you would need to provide a pretrained checkpoint path either through this way:

map-anything/mapanything/utils/hf_utils/hf_helpers.py

Line 172 in f065d13

def initialize_mapanything_local(local_config, device):

Or

map-anything/configs/model/default.yaml

Line 12 in f065d13

pretrained: null

To generate the format checkpoint, please see: https://github.com/facebookresearch/map-anything/tree/main?tab=readme-ov-file#optional-checkpoint-conversion