o vi.@sdZddlmZddlmZddlmZmZddlm Z ddl m Z m Z ddl mZddlmZmZ dd ed ed ed ededededefddZdS)z Imaginaire4 Attention Subpackage: Unified implementation for all Attention implementations. Flash Attention v2 (flash2) backend checks )partial)Tensor)attention_param_checksattention_tensor_checks)FLASH2_SUPPORTED)get_bwd_dtypesget_fwd_dtypes) CausalType) get_arch_taglog_or_raise_errorFquerykeyvalue is_causal causal_type is_varlen raise_errorreturnc Cstt|d}ts|dtddSt|j}t|} t|} t|||| | dd|dd s2|dtddSt |||||d |rM|t j t j fvrM|d tddSdS) a Input validation function for the flash2 backend. Parameters: query (Tensor): 4-D query tensor, with the heads-last contiguous layout (`[batch, seqlen, heads, head_dim]`). key (Tensor): 4-D key tensor, with the heads-last contiguous layout (`[batch, seqlen_kv, heads_kv, head_dim]`). value (Tensor): 4-D value tensor, with heads-last contiguous layout (`[batch, seqlen_kv, heads_kv, head_dim_v]`). is_causal (bool): whether or not causal masking is enabled. causal_type (CausalType): causal masking mode. Choices: `CausalType.TopLeft`, `CausalType.BottomRight`. Required when `is_causal = True`. is_varlen (bool): whether or not a variable length (varlen) use case. Must be inferred beforehand based on arguments such as seqlens_{Q,KV} or cumulative_seqlen_{Q,KV} being passed. raise_error (bool): whether to raise an error if any checks fail or no backend is selected, instead of just returning False. Default is False. Returns: success (bool): whether use case is compatible with flash2 backend. )rzFlash Attention v2 (flash2) is not supported in this environment. Run with debug logs to find out why, or choose another backend.) exceptionFTzFlash Attention v2 (flash2)) r r rsupported_dtypes_forwardsupported_dtypes_backward supports_mlasupports_gqa_mqar backend_namez>Flash Attention v2 (flash2) does not support the given inputs.)r r rrrz:Flash Attention only supports bottom-right causal masking.) rr r RuntimeErrorr devicerrrrr BottomRightDontCare) r r rrrrr target_fnarch_tag fwd_dtypes bwd_dtypesr"[/data/cameron/vidgen/cosmos-policy/cosmos_policy/_src/imaginaire/attention/flash2/checks.pyflash2_attention_check"sD &   r$N)F)__doc__ functoolsrtorchr.cosmos_policy._src.imaginaire.attention.checksrr.cosmos_policy._src.imaginaire.attention.flash2rZ3cosmos_policy._src.imaginaire.attention.flash2.metarr-cosmos_policy._src.imaginaire.attention.masksr -cosmos_policy._src.imaginaire.attention.utilsr r boolr$r"r"r"r#s4