Education
Johns Hopkins University, Baltimore, Maryland
Post-doc. in Psychology & Brain Sciences (From 2013 to 2014)
Advisor: Dr. Jonathan Flombaum
Project: Multiple object tracking, Information pursuit modeling in visual search, Cerebellar ataxia diagnosis (in collaboration with Dr. Jerry L. Prince in The Ataxia Center at Johns Hopkins).
Lab: Visual Thinking Lab
Hong Kong Polytechnic University, Hong Kong
Phd. in Computing (From 2009 to 2013)
Advisor: Dr. Fiona Yan Liu and Dr. Fu-lai Chung
Thesis: Multimedia Content Analysis via Computational Human Visual Model.
Lab: Cognitive Computing Lab
Sheng Zhen University, Shen Zhen
M.Eng. in Signal and Information Processing (From 2005 to 2008)
Advisor: Dr. Weixin Xie
Nanjing University of Posts & Telecommunications, Nanjing
B.Sc. in Optical Information Science & Technology (From 2001 to 2005)
Post-doc. in Psychology & Brain Sciences (From 2013 to 2014)
Advisor: Dr. Jonathan Flombaum
Project: Multiple object tracking, Information pursuit modeling in visual search, Cerebellar ataxia diagnosis (in collaboration with Dr. Jerry L. Prince in The Ataxia Center at Johns Hopkins).
Lab: Visual Thinking Lab
Hong Kong Polytechnic University, Hong Kong
Phd. in Computing (From 2009 to 2013)
Advisor: Dr. Fiona Yan Liu and Dr. Fu-lai Chung
Thesis: Multimedia Content Analysis via Computational Human Visual Model.
Lab: Cognitive Computing Lab
Sheng Zhen University, Shen Zhen
M.Eng. in Signal and Information Processing (From 2005 to 2008)
Advisor: Dr. Weixin Xie
Nanjing University of Posts & Telecommunications, Nanjing
B.Sc. in Optical Information Science & Technology (From 2001 to 2005)
Awards and Honors
Qualcomm Award, ACM Intl. Conference of Multimedia (2011).
Women Research Award, ACM Intl. Conference on Multimedia Computing and Service (2011).
Best Paper Award, ACM Intl. Conference on Multimedia Computing and Service (2010).
Women Research Award, ACM Intl. Conference on Multimedia Computing and Service (2011).
Best Paper Award, ACM Intl. Conference on Multimedia Computing and Service (2010).
Research Grants (Project Leader)
Visual attention research based on contextual cueing using deep learning framework, The National Natural Science Foundation of China, No. 61502311, 240,000 RMB, 2016-2018.
Shenzhen high-level overseas talents program, 2,700,000 RMB, 2017-2019.
Large scale computational visual attention based on deep learning, The National Science Foundation of Guangdong Province, No. 2016A030310053, 100,000 RMB, 2016-2019.
Visual attention modeling based on contextual cueing, The Science and Technology Innovation Commission of Shenzhen, No. JCYJ20150324141711640, 100,000 RMB, 2015-2017.
NSFC-Guangdong Joint Fund for supercomputing application (Stage II), the National Supercomputing Center in GuangZhou (No. NSFC2015_275).
Tencent “Rhinoceros Birds” - Scientific Research Foundation, 50,000 RMB, 2017-2019.
Shenzhen high-level overseas talents program, 2,700,000 RMB, 2017-2019.
Large scale computational visual attention based on deep learning, The National Science Foundation of Guangdong Province, No. 2016A030310053, 100,000 RMB, 2016-2019.
Visual attention modeling based on contextual cueing, The Science and Technology Innovation Commission of Shenzhen, No. JCYJ20150324141711640, 100,000 RMB, 2015-2017.
NSFC-Guangdong Joint Fund for supercomputing application (Stage II), the National Supercomputing Center in GuangZhou (No. NSFC2015_275).
Tencent “Rhinoceros Birds” - Scientific Research Foundation, 50,000 RMB, 2017-2019.
Research interests
Psychological & Brain science, cognitive science, visual cortex modeling, deep learning, attention, memory and learning,
Computational modeling, artificial intelligence, machine learning, multimedia content analysis, EEG analysis, Steganography and Steganographer Detection.
Computational modeling, artificial intelligence, machine learning, multimedia content analysis, EEG analysis, Steganography and Steganographer Detection.
Teaching experiences
Introduction to Multimedia Content Analysis, Shen Zhen University, Spring 2018.
Introduction to Multimedia Systems, Shen Zhen University, Fall 2017.
Foundation of Computer Science, Shen Zhen University, Fall 2017.
Introduction to Multimedia Content Analysis, Shen Zhen University, Spring 2016.
Foundation of Computer Science, Shen Zhen University, Fall 2015.
Introduction to Multimedia Computing, for graduate students, Shen Zhen University, Fall 2015.
Introduction to Multimedia Computing, Shen Zhen University, Spring 2015.
Foundation of Computer Science, Shen Zhen University, Fall 2014.
TA, Introduction to Multimedia Computing, Department of Computing, The Hong Kong Polytechnic University (2009-2011).
TA, Enterprise Information Technology, Department of Computing, The Hong Kong Polytechnic University (2012).
Lecturer, Principle of Communication, College of Extended Studies, Shen Zhen University (2006).
Introduction to Multimedia Systems, Shen Zhen University, Fall 2017.
Foundation of Computer Science, Shen Zhen University, Fall 2017.
Introduction to Multimedia Content Analysis, Shen Zhen University, Spring 2016.
Foundation of Computer Science, Shen Zhen University, Fall 2015.
Introduction to Multimedia Computing, for graduate students, Shen Zhen University, Fall 2015.
Introduction to Multimedia Computing, Shen Zhen University, Spring 2015.
Foundation of Computer Science, Shen Zhen University, Fall 2014.
TA, Introduction to Multimedia Computing, Department of Computing, The Hong Kong Polytechnic University (2009-2011).
TA, Enterprise Information Technology, Department of Computing, The Hong Kong Polytechnic University (2012).
Lecturer, Principle of Communication, College of Extended Studies, Shen Zhen University (2006).
Invited talks
Research methodology in brain science
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (05/2015).
Computational modeling for vision science
School of Computer Science and Engineering, South China University of Technology
Guang Zhou, China (04/2014).
Video saliency detection via spatio-temporal attention modeling analysis
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (05/2013).
Multimedia content analysis via computational human visual model
Department of Psychological & Brain Sciences, Johns Hopkins University
Baltimore, Marland, USA (06/2012).
Multimedia content analysis via computational human visual cognition
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (11/2011).
Bilinear deep learning for image classification
Department of Computer Science, City University of Hong Kong
Hong Kong (08/2011).
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (05/2015).
Computational modeling for vision science
School of Computer Science and Engineering, South China University of Technology
Guang Zhou, China (04/2014).
Video saliency detection via spatio-temporal attention modeling analysis
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (05/2013).
Multimedia content analysis via computational human visual model
Department of Psychological & Brain Sciences, Johns Hopkins University
Baltimore, Marland, USA (06/2012).
Multimedia content analysis via computational human visual cognition
Department of Computer Science, Shen Zhen Graduate School, Harbin Institute of Technology
Shen Zhen, China (11/2011).
Bilinear deep learning for image classification
Department of Computer Science, City University of Hong Kong
Hong Kong (08/2011).
Professional services
Journal reviewer
IEEE Transactions on Image Processing
IEEE Transactions on Neural Networks and Learning Systems
IEEE Transactions on Multimedia
IEEE Transactions on Sustainable Computing
Multimedia Tools and Applications
Expert System with Applications
Journal of the International Measurement Confederation
Neurocomputing
Conference Technical Program Committee
ACM Multimedia (MM) 2016, 2018
China Multimedia (China MM) 2018
IEEE International Conference on High Performance Computing and Communications (HPCC) 2018
IEEE International Symposium on Multimedia (ISM) 2016
IEEE Transactions on Image Processing
IEEE Transactions on Neural Networks and Learning Systems
IEEE Transactions on Multimedia
IEEE Transactions on Sustainable Computing
Multimedia Tools and Applications
Expert System with Applications
Journal of the International Measurement Confederation
Neurocomputing
Conference Technical Program Committee
ACM Multimedia (MM) 2016, 2018
China Multimedia (China MM) 2018
IEEE International Conference on High Performance Computing and Communications (HPCC) 2018
IEEE International Symposium on Multimedia (ISM) 2016
Publications
Journal paper
Jiaxin Wu#, Sheng-hua Zhong#, Zheng Ma, Stephen J. Heinen, Jianmin Jiang*. Foveated convolutional neural networks for video summarization. Multimedia Tools and Applications (MTAP). Accept. 2018. (# is equally contribution)
Sheng-hua Zhong, Yanhong Li, Yan Liu, Zhiqiang Wang*. A computational investigation of learning behaviors in MOOCs. Computer Applications in Engineering Education (CAE), vol. 25(5), Sep. 2017, pp. 693-705.
Songtao Wu, Sheng-hua Zhong*, Yan Liu. Deep residual learning for image steganalysis. Multimedia Tools and Applications (MTAP), 77(9), 2018, pp. 10437-10453.
Sheng-hua Zhong, Yan Liu*, Kien A. Hua. Field effect deep networks for image recognition with incomplete data. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 12(4), 2016.
Sheng-hua Zhong, Yan Liu*, To-Yee Ng, Yang Liu. Perception-oriented video saliency detection via spatio-temporal attention analysis. Neurocomputing, vol. 207, 2016, pp. 178-188.
Jiaxin Wu, Sheng-hua Zhong*, Jianmin Jiang, Yunyun Yang. A novel clustering method for static video summarization. Multimedia Tools and Applications (MTAP). 2016.
Heeyeon Im, Sheng-hua Zhong, Justin Halberda*. Grouping by proximity and the visual impression of approximate number in random dot arrays, Vision Research (VR), 2015, pp. 1-17.
Sheng-hua Zhong, Yan Liu*, Bin Li, Jing Long. Query-oriented unsupervised multi-document summarization via deep learning. Expert Systems with Applications (ESWA). 42(21), 2015.
Sheng-hua Zhong, Yan Liu*, Qing-cai Chen. Visual orientation inhomogeneity based scale-invariant feature transform. Expert Systems with Applications (ESWA). 42(13), 2015.
Sheng-hua Zhong, Zheng Ma, Colin Wilson, Yan Liu, Jonathan I. Flombaum*. Why do people appear not to extrapolate trajectories during multiple object tracking? A computational investigation. Journal of Vision (JOV), vol. 13, article 12, pp. 1-30, 2014.
Sheng-hua Zhong, Yan Liu*, Yang Liu, Fu-lai Chung. Region level annotation by fuzzy based contextual cueing label propagation. In Multimedia Tools and Applications (MTAP). 70(2), 2014.
Sheng-hua Zhong*, Yan Liu, Yang Liu, Changsheng Li. Water reflection recognition based on motion blur invariant moments in Curvelet space. In IEEE Transactions on Image Processing (TIP). 22(11). 2013.
Yu Zhao, Yang Liu*, Yan Liu, Sheng-hua Zhong, , Kien A. Hua. Face recognition from a single registered image for conference socializing. In Expert Systems with Applications (ESWA). 42(3), 2015.
Yang Liu, Yan Liu*, Shenghua Zhong, and Keith C.C. Chan. Tensor distance based multilinear globality preserving embedding: a unified tensor based dimensionality reduction framework for image and video classification, Expert Systems with Applications (ESWA). 39(12), 2012.
Conference paper
Dongdong Gui, Sheng-hua Zhong*, Zhong Ming. Implicit affective video tagging using pupillary response. In Proceedings of the International Conference on Multimedia Modeling (MMM’18), 2018.
Fang Wang, Sheng-hua Zhong*, Jianfeng Peng, Jianmin Jiang, Yan Liu. Data Augmentation for EEG-based Emotion Recognition with Deep Convolutional Neural Networks. In Proceedings of the International Conference on Multimedia Modeling (MMM’18), 2018.
Rong-qin Xu, Sheng-hua Zhong*, Gaoyang Tang, Jiaxin Wu, Yingying Zhu. Adaptive Dehaze Method for Aerial Image Processing. In Proceedings of the Pacific-Rim Symposium on Image and Video Technology (PSIVT’17), 2017.
Xingsheng Huang, Sheng-hua Zhong*, Zhijiao Xiao. Fine-art painting classification via two-channel deep residual network. In Proceedings of the Pacific-Rim Conference on Multimedia (PCM’17), 2017.
Mingjie Zheng, Sheng-hua Zhong*, Songtao Wu, Jianmin Jiang. Steganographer detection via deep residual network. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME’17), pp. 235-240, 2017.
Songtao Wu, Sheng-hua Zhong*, Yan Liu. Residual convolution network based steganalysis with adaptive content suppression. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME’17), pp. 241-246, 2017.
Songtao Wu, Sheng-hua Zhong*, Yan Liu. Steganalysis via deep residual network. In Proceedings of the IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS’16), 2016.
Sheng-hua Zhong, Jianxin Wu, Yingying Zhu*, Peiqi Liu, Jianmin Jiang, Yan Liu. Visual orientation inhomogeneity based convolutional neural networks. In Proceedings of the IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI’16), 2016.
Mei Su, Sheng-hua Zhong*, Jianmin Jiang. Transfer learning based on A+ for image super-resolution. In Proceedings of the 9th International Conference on Knowledge Science, Engineering and Management (KSEM’16), 2016.
Yingying Zhu, Zhengbo Jiang, Sheng-hua Zhong*. Video affective content analysis based on protagonist via convolutional neural network. In Proceedings of the Pacific-Rim Conference on Multimedia (PCM'16), 2016.
Sheng-hua Zhong, Yan Liu*, Kien A. Hua, Songtao Wu. Is noise always harmful? Visual learning from weakly related data. In Proceedings of the 2015 International Conference on Orange Technologies (ICOT'15), 2015.
Yingying Zhu, Chuanhua Jiang, Xiaoyan Huang, Zhijiao Xiao, Sheng-hua Zhong*. A temporal-compress and shorter SIFT research on web videos. In Proceedings of the International Conference on Knowledge Science, Engineering and Management (KSEM'15), 2015.
Song-tao Wu, Yan Liu*, Sheng-hua Zhong, Yang Liu. What makes the stego image undetectable? In Proceedings of 7th ACM International Conference on Internet Multimedia Computing and Service (ACM ICIMCS'15), 2015.
Sheng-hua Zhong, Qun-bo Zhang, Zheng-ping Li, Yan Liu*. Motivations and challenges in MOOCs with eastern insights. In Proceedings of International Conference on Education and Management Technology (ICEMT’15), 2015.
Jonathan I. Flombaum*, Sheng-hua Zhong, Bruno Jedynak, Huaibin Jiang. The microgenesis of information acquisition in visual 'popout'. In Proceeding of the 14th annual meeting of Vision Sciences Society (VSS'15), 2015.
Zheng Ma, Sheng-hua Zhong, Colin Wilson, Jonathan I. Flombaum*. Multiple object tracking explained with neither fixed nor flexible resources. In Proceeding of the 14th annual meeting of Vision Sciences Society (VSS'15), 2015.
Zhen Yang, Sheng-hua Zhong, Aaron Carass, Sarah Ying, Jerry L. Prince*. Deep learning for cerebellar ataxia classification and clinical score regression. In Workshop of The Medical Image Computing and Computer Assisted Intervention (MICCAI'14).
Sheng-hua Zhong, Zheng Ma, Colin Wilson, Jonathan I. Flombaum*. Kalman filter models of multiple-object tracking within an attentional window. In Proceeding of the 14th annual meeting of Vision Sciences Society (VSS'14), 2014.
Hee Yeon Im, Sheng-hua Zhong, Bruno Jedynak, Lisa Feigenson, Jonathan I. Flombaum*. Information pursuit as a model for efficient visual search. In Proceeding of the 14th annual meeting of Vision Sciences Society (VSS'14), 2014.
Sheng-hua Zhong, Yan Liu*, Fei-fei Ren, Jing-huan Zhang, Tong-wei Ren. Video saliency detection via spatio-temporal attention modelling. In Proceedings of 27th AAAI International Conference on Artificial Intelligence (AAAI’13), pp. 1063-1069, 2013.
Jonathan I. Flombaum*, Sheng-hua Zhong, Zheng Ma, Colin Wilson, Yan Liu. What is the marginal advantage of extrapolation during multiple object tracking? Insights from a Kalman filter model. In Proceeding of the 13th annual meeting of Vision Sciences Society (VSS'13), 2013.
Hee Yeon Im, Sheng-hua Zhong, Justin Halberda*. Biases in human number estimation are well-described by clustering algorithms from computer vision. In Proceeding of the 13th annual meeting of Vision Sciences Society (VSS'13), 2013.
Sheng-hua Zhong, Yan Liu*, Gangshan Wu. S-SIFT: A Shorter SIFT without least discriminative visual orientation. In Proceeding of the 2012 IEEE/WIC/ACM International Conference on Web Intelligence (WI’12), 2012.
Sheng-hua Zhong, Yan Liu*, Yao Zhang, Fu-lai Chung. Attention modeling for face recognition via deep learning. In Proceeding of the 34th annual meeting of the Cognitive Science Society (CogSci’12), 2012.
Sheng-hua Zhong, Yan Liu*, Fu-lai Chung, Gangshan Wu. Semiconducting bilinear deep learning for incomplete image recognition. In Proceeding of the 2nd ACM International Conference on Multimedia Retrieval (ICMR’12), 2012.
Yan Liu, Sheng-hua Zhong, Wenjie Li. Query-oriented multi-document summarization via unsupervised deep learning. In Proceedings of 26th AAAI International Conference on Artificial Intelligence (AAAI’ 12), 2012.
Sheng-hua Zhong, Yan Liu*, Yang Liu. Bilinear deep learning for image classification. In Proceedings of 19th ACM International Conference on Multimedia (SIG MM'11), 2011. (Qualcomm Award)
Yang Liu, Yan Liu*, Sheng-hua Zhong, Keith C. C. Chan. Semi-supervised manifold ordinal regression for image ranking. In Proceedings of 19th ACM International Conference on Multimedia (SIG MM'11), 2011.
Sheng-hua Zhong, Yan Liu*, Ling Shao, Gangshan Wu. Unsupervised saliency detection based on 2D Gabor and Curvelets transforms. In Proceedings of 3rd ACM International Conference on Internet Multimedia Computing and Service (ACM ICIMCS'11), 2011.
Sheng-hua Zhong, Yan Liu*, Ling Shao, Fu-lai Chung. Water reflection recognition via minimizing reflection cost based on motion blur invariant moments. In Proceedings of 1st ACM International Conference on Multimedia Retrieval (ICMR'11), 2011.
Sheng-hua Zhong, Yan Liu*, Yang Liu, Fu-lai Chung. Fuzzy-based contextual Cueing for region-level annotation. In Proceedings of 2nd ACM International Conference on Internet Multimedia Computing and Service (ACM ICIMCS'10), 2010. (Best Paper Award).
Sheng-hua Zhong, Yan Liu*, Yang Liu, and Fu-lai Chung. A semantic no-reference image sharpness metric based on top-down and bottom-up saliency map modeling. In Proceedings of 17th IEEE International Conference on Image Processing (ICIP'10), 2010.
Sheng-hua Zhong, Jian-jun Huang, Wei-xin Xie*. A new method of building detection from a single aerial photograph. In Proceedings of International Conference on Signal Processing (ICSP'08), 2008.