H hFDddlZGddejjZdZdS)Nc:eZdZedZedZdS)CheckpointFunctionc||_t|d||_t||d|_t j5|j|j}dddn #1swxYwY|S)N) run_functionlist input_tensors input_paramstorchno_grad)ctxrlengthargsoutput_tensorss \/data/cameron/tmprepos/clean_dreammesh/UniRig/src/model/pointcept/models/utils/checkpoint.pyforwardzCheckpointFunction.forwards' gvg//VWW .. ]__ B B-S-s/@AN B B B B B B B B B B B B B B BsA//A36A3c.d|jD|_tj5d|jD}|j|}dddn #1swxYwYtj||j|jz|d}|`|`~d|zS)Nc\g|])}|d*S)T)detachrequires_grad_.0xs r z/CheckpointFunction.backward..s.XXXQXXZZ66t<<XXXc8g|]}||S)view_asrs rrz/CheckpointFunction.backward..s"FFFqaiillFFFrT) allow_unused)NN)rr enable_gradrautogradgradr )r output_gradsshallow_copiesr input_gradss rbackwardzCheckpointFunction.backwardsXXcFWXXX    ? ?GFC4EFFFN-S-~>N  ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? n))    0 0  *      k))sAAAN)__name__ __module__ __qualname__ staticmethodrr%rrrrrsH\**\***rrc|r?t|t|z}tj|t|g|RS||S)a Evaluate a function without caching intermediate activations, allowing for reduced memory at the expense of extra compute in the backward pass. :param func: the function to evaluate. :param inputs: the argument sequence to pass to `func`. :param params: a sequence of parameters `func` depends on but does not explicitly take as arguments. :param flag: if False, disable gradient checkpointing. )tuplerapplylen)funcinputsparamsflagrs r checkpointr2$sO V}}uV}},!'c&kkADAAAAtV}r)r r Functionrr2rrrr4sW *****0***@r