qiddlZddlZddlZddlmZmZddlZddlZ ddl m cm Z ddlmcmZddlmcmZejeZeGddeZejdGddeZejdGd d eZejdGd d eZd ejdejdedejfdZdS)N)Protocolruntime_checkablec2eZdZdejdejfdZdS) WeightLoaderparamsreturncdS)aLoads the model weights. Args: params: Parameters of the model. This is a nested structure of array-like objects that represent the model's parameters. Returns: Loaded parameters. The structure must be identical to `params`. If returning a subset of the parameters the loader must merge the loaded parameters with `params`. Nselfrs ?/home/robot-lab/Pi0.5_yam/src/openpi/training/weight_loaders.pyloadzWeightLoader.loadsN__name__ __module__ __qualname__atParamsrr rr rrs:  29         rrT)frozenc2eZdZdejdejfdZdS)NoOpWeightLoaderrrc|S)Nr r s r rzNoOpWeightLoader.load!s rNrr rr rrs:29rrcBeZdZUdZeed<dejdejfdZdS)CheckpointWeightLoaderaLoads an entire set of weights from a checkpoint. Compatible with: trained checkpoints: example: "./checkpoints////params" released checkpoints: example: "gs://openpi-assets/checkpoints//params" params_pathrrctjtj|jt j}t||dS)N) restore_typez.*lora.* missing_regex)_modelrestore_paramsdownloadmaybe_downloadrnpndarray _merge_params)r r loaded_paramss r rzCheckpointWeightLoader.load2s>-h.EdFV.W.Wfhfpqqq ]F*MMMMrN) rrr__doc__str__annotations__rrrr rr rr%s\N29NNNNNNNrrc6eZdZdZdejdejfdZdS)PaliGemmaWeightLoaderzLoads weights from the official PaliGemma checkpoint. This will overwrite existing weights with similar names while keeping all extra weights intact. This allows us to support the action expert which is used by the Pi0 model. rrcHtjdddi}|d5}tt j|d}dddn #1swxYwYdt j|d d i}t||d S)Nz:gs://vertex-model-garden-paligemma-us/paligemma/pt_224.npztokenanon)gsrbF) allow_pickle PaliGemma/seprz.*r) r#r$opendictr%rflax traverse_utilunflatten_dictr')r rpathf flat_paramsr(s r rzPaliGemmaWeightLoader.loadAs& HgW]M^   YYt__ ?rwqu===>>K ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?$d&8&G&G Y\&G&]&]^f&gh ]F$GGGGs$AA"%A"N)rrrr)rrrr rr r-r-9sL H29HHHHHHHrr-r(rr rctj|d}tj|d}i}|D]D\}}||vr;|j||jkr |||jn|||<E|tj|fd|DD]}||vr ||||<tj |dS)aYMerges the loaded parameters with the reference parameters. Args: loaded_params: The parameters to merge. params: The reference parameters. missing_regex: A regex pattern for all missing keys that should be merged from the reference parameters. Returns: A new dictionary with the merged parameters. r5r6c>h|]}||Sr ) fullmatch).0kpatterns r z _merge_params..ds, : : :AW%6%6q%9%9 :a : : :r) r:r; flatten_dictitemsdtypeastypeclearrecompiler<) r(rr flat_ref flat_loadedresultrDvrEs @r r'r'Ls!..v3.??H$11-S1IIKF!!##[[1 ==78w(1+BS7S7S!!2333YZF1Ij''G : : : : : : :$$ F??  F1I   , ,V , = ==r) dataclassesloggingrLtypingrrflax.traverse_utilr:numpyr%openpi.models.modelmodelsmodelr!openpi.shared.array_typingshared array_typingropenpi.shared.downloadr# getLoggerrloggerr dataclassrrr-rr*r'r rr ras ........$$$$$$$$$''''''''')))))))))  8 $ $      8     d###|$# d###NNNNN\NN$#N&d###HHHHHLHH$#H$>>BI>QT>Y[Yb>>>>>>r