AI Parameter-Efficient Sparsity Crafting (PESC): A Novel AI Approach to Transition Dense Models to Sparse Models Using a Mixture-of-Experts (Moe) Architecture
AI Region-aware pre-training for open-vocabulary object detection with vision transformers – Google Research Blog
