I am a Second-Year PhD Student at Department of Computer & Information Science & Engineering, University of Florida under the supervision of Prof. Anand Rangarajan and Prof. Sanjay Ranka at the Modern Artificial intelligence and Learning Technologies Lab (UF MALT Lab).

I received B.E. degree from Department of Software Engineering, Sichuan University in June, 2015. From 2014-2016, I worked as a Research Assistant at the Multimedia Lab, Department of Information Engineering, Chinese University of Hong Kong (MMLab, CUHK) and Multimedia Research Center, Shenzhen Institute of Advanced Technology (MMLab, SIAT) under the supervision of Dr. Weilin Huang and Prof. Chen Change Loy, supported by Prof. Yu Qiao and Prof. Xiaoou Tang. I was a Research Intern at Megvii (Face++) Research USA, working with Dr. Jue Wang.

As an enthusiastic researcher, my goal is to combine state-of-the-art deep learning algorithms with real-life industrial problems. I am currently solving problems of visual object tracking, few shot learning, and scene text understanding.

 

Publications (Google Scholar)

Intelligent Intersection: Two-Stream Convolutional Networks for Real-time Near Accident Detection in Traffic Video
Xiaohui Huang, Pan He, Anand Rangarajan, Sanjay Ranka
Submitted to ACM Transactions on Spatial Algorithms and Systems (TSAS)
Special issue on Urban Mobility: Algorithms and Systems
[pdf]
Boosting up Scene Text Detectors with Guided CNN
Xiaoyu Yue, Zhanghui Kuang, Zhaoyang Zhang, Zhenfang Chen, Pan He, Yu Qiao, Wei Zhang
British Machine Vision Conference (BMVC), 2018 (Oral)
(Accepted for oral presentation, 4.29% acceptance rate)
[pdf]
Adaptive Adversarial Attack on Scene Text Recognition
Xiaoyong Yuan, Pan He, Xiaolin Li
Technical Report on arXiv 1807.03326, 2018
[pdf]
Adverarial Examples: Attacks and Defenses for Deep Learning
Xiaoyong Yuan, Pan He, Qile Zhu, Rajendra Rana Bhat, Xiaolin Li
Technical Report on arXiv 1712.07107, 2017
Accepted to IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
[pdf] [code]
Learning Fast and Slow: PROPEDEUTICA for Real-time Malware Detection
Ruimin Sun*, Xiaoyong Yuan*, Pan He, Qile Zhu, Aokun Chen, Andre Gregio, Daniela Oliveira, Xiaolin Li
Technical Report on arXiv 1712.01145, 2017
Submitted to Annual Computer Security Applications Conference, 2018 (ACSAC)
[pdf]
Single Shot Text Detector with Regional Attention
Pan He, Weilin Huang, Tong He, Qile Zhu, Yu Qiao, Xiaolin Li
IEEE International Conference on Computer Vision (ICCV), 2017 (Spotlight)
(Accepted for spotlight presentation, 2.61% acceptance rate)
[pdf] [demo] [poster] [code]
Detecting Text in Natural Image with Connectionist Text Proposal Network
Zhi Tian, Weilin Huang, Tong He, Pan He, Yu Qiao
European Conference on Computer Vision (ECCV), 2016
[pdf] [demo] [code]
Reading Scene Text in Deep Convolutional Sequences
Pan He*, Weilin Huang*, Yu Qiao, Chen Change Loy, Xiaoou Tang
The 30th AAAI Conference on Artificial Intelligence (AAAI), 2016 (Oral)
[pdf]

Experiences

May. 2017 - Aug. 2017: Research Intern, Megvii Research US

Oct. 2015 - Jul. 2016: Research Assistant, Multimedia Laboratory, Chinese University of Hong Kong

Sept. 2014 - Jul. 2016: Research Assistant, Multimedia Research Center, Shenzhen Institues of Advanced Technology

Jul. 2014 - Sept. 2014: Summer Intern, National University of Singapore

Sept. 2013 - May. 2014: Project Developer, Facebook Open Academy

Patents

METHODS AND APPARATUS FOR RECOGNIZING TEXT IN AN IMAGE

International Patent: PCT/CN2015/081308. with Xiaoou Tang, Yu Qiao, Chen Change Loy and Weilin Huang

APPARATUS AND METHOD FOR DETECTING SCENE TEXT

US Patent: App. 62/579,324 with Xiaolin Li

METHODS AND APPARATUS FOR SCENE TEXT DETECTION

Chinese Patent: 201610878795.5. with Yu Qiao, Tong He, Weilin Huang and Zhi Tian

Professional Activities

Reviewer of British Machine Vision Conference (BMVC), 2019

Reviewer of International Conference on Computer Vision and Pattern Recognition (ICCV), 2019

Reviewer of The Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Reviewer of The Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Reviewer of Asian Conference on Computer Vision (ACCV), 2018

Reviewer of International Conference on Pattern Recognition (ICPR), 2018

Reviewer of IEEE Transactions on Neural Networks and Learning Systems (TNNLS)

Reviewer of Knowledge and Information Systems (KIS)

TPC Member&Reviewer of International Conference on Machine Learning and Data Science (MLDS), 2018

TPC Member&Reviewer of International Conference on Machine Learning and Data Science (MLDS), 2017

Lead Organizer of UF ML Club

Instructor of Student Science Training Program (SSTP)

Teaching and Courses

CDA 5155, Computer Architecture Principles (Fall 2018)

CAP 6617, Advanced Machine Learning (Fall 2018)

COT 5405, Analysis of Algorithms (Spring 2018)

CIS 6930, Introduction to Computational Neuroscience (Spring 2018)

COP 5536, Advanced Data Structures (Fall 2017)

COP 5615, Distributed Operating Systems Principles (Fall 2017)

EEL 6935, Big Data Ecosystems (Spring 2017) - Teaching Assistant

EEL 6935, Deep Learning (Spring 2017)

EEL 6825, Pattern Recognition (Spring 2017)

EEE 6512, Image Processing and Computer Vision (Fall 2016)

CNT 6805, Network Science and Applications (Fall 2016)

Awards and Honor

SIAT Direct Scholarship for Innovation and Creativity

Graduation Thesis Awarded First Prize

Outstanding Graduate of Sichuan University

Student Mentoring

Christopher Moffitt (Undergraduate student at UFL)

Caleb Bryant (Undergraduate student at UFL)

Friends and Collaborators

Weilin Huang (Oxford), Tong He (Adelaide), Zhe Wang (UCI), Sheng Guo (SIAT), Yandong Wen (CMU), Limin Wang (ETHz), Bowen Zhang (USC), Kaipeng Zhang (NTU), Yu Qiao (SIAT), Yuanjiang Ni (UCSC), Xing Liu (IU), Xiaoyong Yuan (UFL), Xiaohui Huang (UFL)