o ݱi@s6ddlZddlmZddlmZGdddejZdS)N) CLIPModelcs8eZdZdeffdd ZdejdejfddZZS)CLIPTextEncoder embed_dimcs>ttd|_|jD]}d|_qtd||_ dS)Nzopenai/clip-vit-base-patch32Fi) super__init__rfrom_pretrainedlanguage_model parameters requires_gradnnLinearhead)selfrp __class__B/data/cameron/vidgen/unified-world-model/models/common/language.pyrs  zCLIPTextEncoder.__init__ input_idsattention_maskcCs|jj||d}||}|S)N)rr)rZget_text_featuresr )rrrZfeatsrrrforwards  zCLIPTextEncoder.forward) __name__ __module__ __qualname__intrtorchTensorr __classcell__rrrrrsr)rtorch.nnr transformersrModulerrrrrs