o vi @s@ddlZddlmZddlmZddlmZGdddeZdS)N)log)Callback)DiffusionModelc sTeZdZddededeffdd Z dd ed eee j fd ed d fddZ Z S)CompileTokenizerFenabledcompile_after_iterationsdynamiccs,t||_d|_||_d|_||_dS)NFr)super__init__rcompiledr skip_counterr )selfrrr  __class__]/data/cameron/vidgen/cosmos-policy/cosmos_policy/_src/predict2/callbacks/compile_tokenizer.pyr s zCompileTokenizer.__init__rmodel data_batch iterationreturnNc Cs|jr|jrdSt|jtjjrtdt |jd|j |j kr]zdtj j _Wn$tyMzdtj j _WntyJtdd|_YYdSwYnwtj|jj|jd|j_d|_|j d7_ dS) NzThe Tokenizer model zM is a JIT model, which is not compilable. The Tokenizer will not be compiled. uZTokenizer compilation requested, but Torch Dynamo is unavailable – skipping compilation.F)r T)rr isinstance tokenizertorchjit ScriptModulercriticaltyper r_dynamoconfigZrecompile_limitAttributeErrorcache_size_limitwarningcompileencoder )rrrrrrron_training_step_start"s0     z'CompileTokenizer.on_training_step_start)FrF)r) __name__ __module__ __qualname__boolintr rdictstrrTensorr' __classcell__rrrrrs  r)r#cosmos_policy._src.imaginaire.utilsr,cosmos_policy._src.imaginaire.utils.callbackr3cosmos_policy._src.predict2.models.text2world_modelrrrrrrs