o vij@sLdZddlZddlmZdedeejfddZdedeejfdd Z dS) z Imaginaire4 Attention Subpackage: Unified implementation for all Attention implementations. cuDNN Backend: metadata Always safe to import (as long as torch is available.) N)safe_logarch_tagreturncCs4|dkr tdgStd|dtjtjgS)aM Returns data type choices for forward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. PzWcuDNN Attention is not supported because compute capability is below the minimum (8.0).z9cuDNN Attention only supports FP16 and BF16 for arch_tag=.)logdebugtorchfloat16bfloat16rr X/data/cameron/vidgen/cosmos-policy/cosmos_policy/_src/imaginaire/attention/cudnn/meta.pyget_fwd_dtypess   rcCsgS)aN Returns data type choices for backward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. r r r r rget_bwd_dtypes3s r) __doc__r -cosmos_policy._src.imaginaire.attention.utilsrrintlistdtyperrr r r rs