o i@sddlmZddlmZddlZddlmZmZGdddeZdd d d d ddd ddej d de de de de de de de de de de deee ffddZdej dde deee ffdd Zdej dde deee ffd!d"Zdej dde deee ffd#d$Zdej dde deee ffd%d&Zdej dde deee ffd'd(Zdej dde deee ffd)d*Zdej dde deee ffd+d,Zdej dde deee ffd-d.ZdS)/)Enum)UnionN)_DINOV2_BASE_URL_make_dinov2_model_namec@seZdZdZdS)WeightsLVD142MN)__name__ __module__ __qualname__rr r :/data/cameron/moge_repo/moge/model/dinov2/hub/backbones.pyrsr vit_largeig?mlpFg?T) arch_nameimg_size patch_size init_values ffn_layer block_chunksnum_register_tokensinterpolate_antialiasinterpolate_offset pretrainedweightsrrrrrrrrrrrc  Ksddlm} t| tr zt| } Wntytd| wt||} t||||||||d}|j d i| | j |d i|}| ret|||}t d| d|d}t j j|dd}|j|d d |S) N)vision_transformerzUnsupported weights: )rrrrrrrr/z _pretrain.pthZcpu)Z map_locationT)strictr )Zmodelsr isinstancestrrKeyErrorAssertionErrorrdictupdate__dict__rtorchhubZload_state_dict_from_urlZload_state_dict)rrrrrrrrrrrkwargsZvitsZmodel_base_nameZ vit_kwargsmodelZmodel_full_nameurlZ state_dictr r r _make_dinov2_models4       r,)rrcKtdd||d|S)zP DINOv2 ViT-S/14 model (optionally) pretrained on the LVD-142M dataset. vit_smallrrrNr r,rrr)r r r dinov2_vits14@r2cKr-)zP DINOv2 ViT-B/14 model (optionally) pretrained on the LVD-142M dataset. vit_baser/Nr r0r1r r r dinov2_vitb14Gr3r5cKr-)zP DINOv2 ViT-L/14 model (optionally) pretrained on the LVD-142M dataset. rr/Nr r0r1r r r dinov2_vitl14Nr3r6cKstddd||d|S)zP DINOv2 ViT-g/14 model (optionally) pretrained on the LVD-142M dataset. vit_giant2 swiglufused)rrrrNr r0r1r r r dinov2_vitg14Usr9c Ktdd||dddd|S)z_ DINOv2 ViT-S/14 model with registers (optionally) pretrained on the LVD-142M dataset. r.TrrrrrrNr r0r1r r r dinov2_vits14_regbr>c Kr:)z_ DINOv2 ViT-B/14 model with registers (optionally) pretrained on the LVD-142M dataset. r4r;Tr<r=Nr r0r1r r r dinov2_vitb14_regqr?r@c Kr:)z_ DINOv2 ViT-L/14 model with registers (optionally) pretrained on the LVD-142M dataset. rr;Tr<r=Nr r0r1r r r dinov2_vitl14_regr?rAc Kstddd||dddd|S) z_ DINOv2 ViT-g/14 model with registers (optionally) pretrained on the LVD-142M dataset. r7r8r;Tr<)rrrrrrrNr r0r1r r r dinov2_vitg14_regsrB)enumrtypingrr'Zutilsrrrrr!intfloatboolr,r2r5r6r9r>r@rArBr r r r s^      $.$$$$ $$(