o 9i @sJddlZddlZGdddZGdddeZGdddeZdd ZdS) Nc@seZdZddZddZdS)AbstractDistributioncCtNNotImplementedErrorselfr Q/data/cameron/vidgen/generative-models/sgm/modules/distributions/distributions.pysamplezAbstractDistribution.samplecCrrrrr r r mode r zAbstractDistribution.modeN)__name__ __module__ __qualname__r r r r r r rs rc@s$eZdZddZddZddZdS)DiracDistributioncCs ||_dSrvalue)rrr r r __init__s zDiracDistribution.__init__cC|jSrrrr r r r r zDiracDistribution.samplecCrrrrr r r r r zDiracDistribution.modeN)rrrrr r r r r r r s rc@s@eZdZdddZddZdddZgd fd d Zd d ZdS)DiagonalGaussianDistributionFcCs||_tj|ddd\|_|_t|jdd|_||_td|j|_t|j|_ |jr@t |jj |jj d|_ |_dSdS)Ndimg>g4@?device) parameterstorchchunkmeanlogvarclamp deterministicexpstdvar zeros_liketor)rrr$r r r rs z%DiagonalGaussianDistribution.__init__cCs*|j|jt|jjj|jjd}|S)Nr)r!r&rrandnshaper)rr)rxr r r r %s z#DiagonalGaussianDistribution.sampleNcCs|jr tdgS|dur%dtjt|jd|jd|jgddSdtjt|j|jd|j|j|jd|j|jgddS)Nrrg?rrr)r$rTensorsumpowr!r'r")rotherr r r kl+s&  zDiagonalGaussianDistribution.klr.cCsR|jr tdgStdtj}dtj||jt||j d|j |dS)Nr-g@rrr) r$rr0nplogpir1r"r2r!r')rr dimslogtwopir r r nll>s  z DiagonalGaussianDistribution.nllcCrr)r!rr r r r Gr z!DiagonalGaussianDistribution.mode)Fr)rrrrr r4r:r r r r r rs    rcsd||||fD] }t|tjr|nqdusJdfdd||fD\}}dd||t||||dt| S)a* source: https://github.com/openai/guided-diffusion/blob/27c20a8fab9cb472df5d6bdd6c8d11c8f430b924/guided_diffusion/losses.py#L12 Compute the KL divergence between two gaussians. Shapes are automatically broadcasted, so batches can be compared to scalars, among other use cases. Nz&at least one argument must be a Tensorcs,g|]}t|tjr |nt|qSr ) isinstancerr0tensorr)).0r,r<r r [sznormal_kl..rgr)r;rr0r%)mean1logvar1mean2logvar2objr r>r normal_klKs*    rE)numpyr5rrrobjectrrEr r r r s  3