o ?ß±ióã@sLdZddlZddlmZdedeejfdd„Zdedeejfdd „Z dS) z® Imaginaire4 Attention Subpackage: Unified implementation for all Attention implementations. NATTEN Backend: metadata Always safe to import (as long as torch is available.) éN)Úsafe_logÚarch_tagÚreturncCsF|dkr t d¡gS|dvrtjtjtjtjtjgStjtjtjgS)aM Returns data type choices for forward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. éKúNNATTEN is not supported because compute capability is below the minimum (7.5).)édég)ÚlogÚdebugÚtorchÚfloat32Úfloat16Úbfloat16Ú float8_e5m2Ú float8_e4m3fn©r©rú_/data/cameron/vidgen/cosmos-predict2.5/cosmos_predict2/_src/imaginaire/attention/natten/meta.pyÚget_fwd_dtypess  rcCs&|dkr t d¡gStjtjtjgS)aN Returns data type choices for backward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. rr)r r r r r rrrrrÚget_bwd_dtypes3s r) Ú__doc__r Ú/cosmos_predict2._src.imaginaire.attention.utilsrr ÚintÚlistÚdtyperrrrrrÚs