Presentation
VITA: ViT Acceleration for Efficient 3D Human Mesh Recovery via Hardware-Algorithm Co-Design
DescriptionVision Transformers (ViTs) have emerged as a promising solution to enable efficient 3D Human Mesh Recovery (HMR) in augmented and virtual reality (AR/VR) applications. However, it remains a challenge to efficiently accelerate ViT-based HMR due to high computational complexity and memory access footprint. In this paper, we propose VITA, a hardware and algorithm co-design framework for ViT-based HMR with much-improved performance and energy efficiency. To be specific, on the algorithm side, we proposed a pooling attention model optimized with regular memory access and reduced computation complexity. On the hardware side, we proposed an accelerator architecture capable of adapting various data movement caused by various pooling operations.
Event Type
Research Manuscript
TimeTuesday, June 2511:30am - 11:45am PDT
Location3002, 3rd Floor
Design
AI/ML System and Platform Design