o ?ß±i2 ã@sJdZddlmZddlmZ         ddededed ed edBd edBd edBd edBdedBdedBdededBdee eefBfdd„Z       d dededede eBde eBde eBd e eBd edBdededBdee eefBfdd„Z   d!dedededed edBdededBdee eefBfdd„Z dS)"z¼ Imaginaire4 Attention Subpackage: Unified implementation for all Attention implementations. NATTEN Backend: intermediate API stubs Always safe to import (as long as torch is available.) é)ÚTensor)Ú CausalTypeFNÚqueryÚkeyÚvalueÚ is_causalÚ causal_typeÚscaleÚcumulative_seqlen_QÚcumulative_seqlen_KVÚ max_seqlen_QÚ max_seqlen_KVÚ return_lseÚbackend_kwargsÚreturnc Cótdƒ‚)NzsTried to run NATTEN attention, but it is not supported / available. Try running with debug logs enabled to see why.©Ú RuntimeError) rrrrrr r r r r rr©rú`/data/cameron/vidgen/cosmos-predict2.5/cosmos_predict2/_src/imaginaire/attention/natten/stubs.pyÚnatten_attentionsÿréÿÿÿÿéÚ window_sizeÚstrideÚdilationc Cr)Nz‡Tried to run NATTEN's Multi-Dimensional attention, but it is not supported / available. Try running with debug logs enabled to see why.r) rrrrrrrr rrrrrÚnatten_multi_dim_attention1s ÿrÚmetadatacCr)NzœTried to run NATTEN's variable-length/size Multi-Dimensional attention, but it is not supported / available. Try running with debug logs enabled to see why.r)rrrrr rrrrrÚ!natten_multi_dim_attention_varlenCs ÿr) FNNNNNNFN)rrrFNFN)NFN) Ú__doc__ÚtorchrÚ/cosmos_predict2._src.imaginaire.attention.masksrÚboolÚfloatÚintÚdictÚtuplerrrrrrrÚs²  ôÿþýüûúùø ÷ ö õ ô óöÿþýüûúùø ÷ ö õùÿþýüûúùø