o ?߱i< @sddlmZmZddlmZddlZddlmZededfddZededfd d Z edd e dedfd dZ ededfddZ dS)) ExitStackcontextmanager) GeneratorN)timerreturn)NNNccstjjjj}z6dtjjj_tjjjddddd dVWdn1s'wYW|tjjj_dSW|tjjj_dS|tjjj_w)ahContext manager to temporarily disable TF32 for CUDA matrix multiplications. This is useful for ensuring full FP32 precision in numerical computations, particularly when debugging or comparing results between different implementations. Example: with disable_tf32(): result = torch.matmul(a, b) # Uses full FP32 precision FN)enabled benchmark deterministic allow_tf32)torchbackendscudamatmulr cudnnflags)Zold_allow_tf32_matmulr`/data/cameron/vidgen/cosmos-predict2.5/cosmos_predict2/_src/imaginaire/utils/context_managers.py disable_tf32s  rc#Ltdg}tfdd|DVWddS1swYdS)zo Wrap the data loader initialization with multiple context managers used for telemetry and one logger. Zinit_data_loadercg|]}|qSr enter_context.0cmstackrr 5z$data_loader_init..Nrrcontextsrrrdata_loader_init, "r"F set_barrierc#sLtdg}tfdd|DVWddS1swYdS)zo Wrap the instantiation of the model with multiple context managers used for telemetry and one logger. Z init_modelcrrrrrrrrArzmodel_init..Nr)r$r!rrr model_init8r#r%c#r)zL Wrap the distributed initialization, used for telemetry and timers init_distributedcrrrrrrrrMrz$distributed_init..Nrr rrrdistributed_initDr#r')F) contextlibrrtypingrr *cosmos_predict2._src.imaginaire.utils.miscrrr"boolr%r'rrrrs