Tao Huang Ph.D. Student The University of Sydney Email: huntocn [at] gmail.com

Biography

My major research interests lie within efficient machine learning algorithms, such as

• Efficient architectures: NAS, pruning, Rep, handcraft
• Knowledge distillation (KD)
• Efficient training
• Efficient large models

News

• [2024/07] I gave a talk about "Efficient Large Models" at Peking University. Many thanks to Prof. Shanghang Zhang for the invitation.
• [2024/07] Two papers were accepted to ECCV 2024.
• [2024/06] I co-organized TNNLS 2024 Tutorial "Efficient and Secure Foundation Models" and gave a talk.
• [2024/06] One paper was accepted to journal Knowledge-Based Systems.
• [2024/03] Our PU-MLC was accepted to ICME 2024 as oral.
• [2024/03] We released ActGen & LocalMamba & EfficientVMamba at arXiv.
• [2024/02] One paper (FreeKD) was accepted to CVPR 2024.
• [2024/02] We released DIST+.
• [2023/09] One paper (DiffKD) was accepted to NeurIPS 2023.

Publications

2024

• ECCVActive Generation for Image Classification
  
  Tao Huang, Jiaqi Liu, Shan You, Chang Xu
  European Conference on Computer Vision (ECCV), 2024.

  ArXiv

• ECCVTraining-free Composite Scene Generation for Layout-to-Image Synthesis
  
  Jiaqi Liu, Tao Huang, Chang Xu
  European Conference on Computer Vision (ECCV), 2024.
• KBSDiverse and Tailored Image Generation for Zero-Shot Multi-Label Classification
  
  Kaixin Zhang, Zhixiang Yuan, Tao Huang
  Knowledge-Based Systems (KBS), Volume 299, 5 September 2024, 112077.

  ArXiv KBS Bib Code

• ICMEPositive Label Is All You Need for Multi-Label Classification🚩 Oral
  
  Zhixiang Yuan, Kaixin Zhang, Tao Huang
  IEEE International Conference on Multimedia and Expo (ICME), 2024.

  ArXiv Bib Code

• CVPRFreeKD: Knowledge Distillation via Semantic Frequency Prompt
  
  Yuan Zhang, Tao Huang, Jiaming Liu, Tao Jiang, Kuan Cheng, Shanghang Zhang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

  ArXiv Bib

2023

• NeurIPSKnowledge Diffusion for Distillation
  
  Tao Huang, Yuan Zhang, Mingkai Zheng, Shan You, Fei Wang, Chen Qian, Chang Xu
  Advances in Neural Information Processing Systems (NeurIPS), 2023.

  ArXiv Bib Poster Code

• ACM MMAvatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty
  
  Yuan Zhang, Weihua Chen, Yichen Lu, Tao Huang, Xiuyu Sun, Jian Cao
  Proceedings of the 31th ACM International Conference on Multimedia (ACM MM), 2023.

  ArXiv Bib Code

• ICLRMasked Distillation with Receptive Tokens
  
  Tao Huang*, Yuan Zhang*, Shan You, Fei Wang, Chen Qian, Jian Cao, Chang Xu
  International Conference on Learning Representations (ICLR), 2023.

  ArXiv Bib Code

2022

• NeurIPSKnowledge Distillation from A Stronger Teacher
  
  Tao Huang, Shan You, Fei Wang, Chen Qian, Chang Xu
  Advances in Neural Information Processing Systems (NeurIPS), 2022.

  ArXiv Bib Slides Poster 解读 Code

• NPJ QIQuantum circuit architecture search for variational quantum algorithms
  
  Yuxuan Du, Tao Huang, Shan You, Min-Hsiu Hsieh, Dacheng Tao
  Nature Partner Journals Quantum Information (NPJ QI), 2022.
  

  ArXiv Bib Code

• CVPRGreedyNASv2: Greedier Search with a Greedy Path Filter
  
  Tao Huang, Shan You, Fei Wang, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  

  ArXiv Bib Poster

• CVPRDyRep: Bootstrapping Training with Dynamic Re-parameterization
  
  Tao Huang, Shan You, Bohan Zhang, Yuxuan Du, Fei Wang, Chen Qian, Chang Xu
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  

  ArXiv Bib Poster Code

• ICLRRelational Surrogate Loss Learning
  
  Tao Huang, Zekang Li, Hua Lu, Yong Shan, Shusheng Yang, Yang Feng, Fei Wang, Shan You, Chang Xu
  International Conference on Learning Representations (ICLR), 2022.
  

  ArXiv Bib Poster Slides Code

• ICASSPData Agnostic Filter Gating for Efficient Deep Networks
  
  Hongyan Xu, Xiu Su, Shan You, Tao Huang, Fei Wang, Chen Qian, Changshui Zhang, Chang Xu, Dadong Wang, Arcot Sowmya
  IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.

  ArXiv Bib

2021

• CVPRPrioritized Architecture Sampling with Monto-Carlo Tree Search
  
  Xiu Su*, Tao Huang*, Yanxi Li, Shan You, Fei Wang, Chen Qian, Changshui Zhang, Chang Xu
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  

  ArXiv Poster Bib NAS-Bench-Macro

• ICLRLocally Free Weight Sharing for Network Width Search🚩 Spotlight
  
  Xiu Su, Shan You, Tao Huang, Fei Wang, Chen Qian, Changshui Zhang, Chang Xu
  International Conference on Learning Representations (ICLR), 2021.
  

  ArXiv Bib OpenReview

• CVPRGreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet
  
  Shan You*, Tao Huang*, Mingmin Yang*, Fei Wang, Chen Qian, Changshui Zhang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  

  ArXiv Bib Poster Video Slides Code

Manuscripts

• arXivUnveiling the Tapestry of Consistency in Large Vision-Language Models
  
  Yuan Zhang, Fei Xiao, Tao Huang, Chun-Kai Fan, Hongyuan Dong, Jiawen Li, Jiacong Wang, Kuan Cheng, Shanghang Zhang, Haoyuan Guo
  arXiv preprint arXiv:2405.14156 (2024).

  ArXiv Code

• arXivEfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba
  
  Xiaohuan Pei*, Tao Huang*, Chang Xu
  arXiv preprint arXiv:2403.09977 (2024).

  ArXiv Code

• arXivLocalMamba: Visual State Space Model with Windowed Selective Scan
  
  Tao Huang, Xiaohuan Pei, Shan You, Fei Wang, Chen Qian, Chang Xu
  arXiv preprint arXiv:2403.09338 (2024).

  ArXiv Code

• arXivNot All Steps are Equal: Efficient Generation with Progressive Diffusion Models
  
  Wenhao Li, Xiu Su, Shan You, Tao Huang, Fei Wang, Chen Qian, Chang Xu
  arXiv preprint arXiv:2312.13307 (2023).

  ArXiv

• DIST+: Knowledge Distillation from A Stronger Teacher
  
  Tao Huang, Shan You, Fei Wang, Chen Qian, Chang Xu
  

  PDF

• arXivLightViT: Towards Light-Weight Convolution-Free Vision Transformers
  
  Tao Huang, Lang Huang, Shan You, Fei Wang, Chen Qian, Chang Xu
  arXiv preprint arXiv:2207.05557 (2022).

  ArXiv Bib Code

• arXivExplicitly Learning Topology for Differentiable Neural Architecture Search
  
  Tao Huang, Shan You, Yibo Yang, Zhuozhuo Tu, Fei Wang, Chen Qian, Changshui Zhang
  arXiv preprint arXiv:2011.09300 (2020).

  ArXiv

Grants

• 2023-2024, Efficient Language-and-Vision Models, 1000 USD, Google Cloud Research Credits Award

Talks

• Peking University: "Efficient Large Models", Jul. 2024.
• TNNLS 2024 Tutorial: "Efficient and Secure Foundation Models", Jun. 2024.
• TMLR Young Scientist Seminar@HKBU: "Knowledge Distillation from A Stronger Teacher", Jul. 2022. [Slides]
• SenseTime Titan Open Course: "Automated Machine Learning", May 2020. [Recording]

Teaching

• 2024-2025, Guest Lecturer for COMP5329 Deep Learning, The University of Sydney
• 2024-2025, Tutor for COMP5329 Deep Learning, The University of Sydney

Academic Services

Education

• The University of Sydney, Sydney, Australia

  Jul. 2022 – Jun. 2025 (expected)
  Ph.D. student at School of Computer Science
  Advisor: Prof. Chang Xu
  
• Huazhong University of Science and Technology, Wuhan, China

  Sep. 2016 – Jun. 2020
  B.E. in Computer Science and Technology
  

Selected Experiences

• SenseTime, Beijing, China
  
  Research Intern

  Jul. 2022 - Present
  Researcher

  Jul. 2020 – Jun. 2022
  Research Intern

  Aug. 2019 – Jul. 2020
  • Research on model compression algorithms (NAS, KD, pruning, etc.).
  • Research and development on auto-driving (smart carbin) scenes such as face verification and drowsiness detection.
  • Applied NAS to face verification task on large­scale industrial datasets, which significantly improves the performance.
• Horizon Robotics, Beijing, China
  Computer Vision Research Intern

  May 2019 – Aug. 2019
  • Development on object detection framework: anchor-­free detection method, detection in traffic scene.
  • Research on knowledge distillation methods for face alignment, object detection.

Selected Awards

• Outstanding Graduate award, Huazhong University of Science and Technology

  Jun. 2020
• Outstanding Graduate Thesis award, Huazhong University of Science and Technology

  Jun. 2020