o ?ß±iŽã@sLdZddlZddlmZdedeejfdd„Zdedeejfdd „Z dS) zà Imaginaire4 Attention Subpackage: Unified implementation for all Attention implementations. Flash Attention v2 (flash2) Backend: metadata Always safe to import (as long as torch is available.) éN)Úsafe_logÚarch_tagÚreturncCó"|dkr t d¡gStjtjgS)aM Returns data type choices for forward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. éPúcFlash Attention v2 (flash2) is not supported because compute capability is below the minimum (8.0).©ÚlogÚdebugÚtorchÚfloat16Úbfloat16©r©rú_/data/cameron/vidgen/cosmos-predict2.5/cosmos_predict2/_src/imaginaire/attention/flash2/meta.pyÚget_fwd_dtypesó  rcCr)aN Returns data type choices for backward pass according to arch tag (attention.utils.get_arch_tag). Parameters: arch_tag (int): Arch tag for the current CUDA device. Example: 80 for A100, 90 for H100. Returns: data_type_choices (list): a list of PyTorch data types. Empty if device is not supported. rrrrrrrÚget_bwd_dtypes0rr) Ú__doc__r Ú/cosmos_predict2._src.imaginaire.attention.utilsrr ÚintÚlistÚdtyperrrrrrÚs