Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
FluxAttn (FA-TA) (Llama-3.1-8B-Instruct)
#242
Accuracy: 46.9
Rank counts only results with a code link.