AI Region-aware pre-training for open-vocabulary object detection with vision transformers – Google Research Blog
AI Researchers from UC Berkeley Propose RingAttention: A Memory-Efficient Artificial Intelligence Approach to Reduce the Memory Requirements of Transformers