Zhangzhe's Blog

10-22

用 transformers 推理 Qwen2-0.5B-Instruct

08-05

ALiBi: Train short, test long: Attention with linear biases enables input length extrapolation

07-30

KV Cache Transformer

07-18

FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

07-17

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

07-12

GQA: Grouped-Query Attention

07-11

MQA: Multi-Query Attention

08-16

BEVFormer: Learning Bird’s-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers

07-29

MOTR: End-to-End Multiple-Object Tracking with Transformer

07-29

Deformable DETR: Deformable Transformers for End-to-end Object Detection