Publications

Thesis

Title: Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval

Details: abstract (.txt), summary (.ps, .pdf), full thesis (.ps, .pdf) 

Book Chapter, Journal and Conferences (selected)

Digital / Social Media Analysis

• Shenghua Bao, Shengliang Xu, Li Zhang, Rong Yan, Dingyi Han, Zhong Su and Yong Yu, Mining Social Emotions from Affective Text, To appear in IEEE Transactions on Knowledge and Data Engineering, 2011

Conference version:  Joint Emotion-Topic Modeling for Social Affective Text Mining, Proc. of IEEE International Conference on Data Mining (ICDM), 2009

• Lei Ding, Rong Yan, Alper Yilmaz, Interactive Image Segmentation Using Dirichlet Process Multiple View Learning, To Appear in IEEE Transaction on Image Processing, 2011
• Rong Yan, Marc-Olivier Fleury, Michele Merler, Apostol Natsev, John R. Smith, Large-Scale Multimedia Semantic Concept Modeling using Robust Subspace Bagging and MapReduce, In ACM Multimedia, Workshop LS-MMRM’09
• Winston Hsu, Tao Mei, and Rong Yan, Knowledge Discovery over Community-Sharing Media – from Signal to Intelligence, In ICME 2009.
• Lexing Xie, Rong Yan, Extracting Semantics from Multimedia Content: Challenges and Solutions, In Multimedia Content Analysis: Theory and Applications, A. Divakaran Ed., Springer, 2008
• Lexing Xie, Rong Yan and Jun Yang, Multi-Concept Learning with Large-Scale Multimedia Lexicons, In ACM Intl. Conf. on Image Processing (ICIP), 2008
• Alexander G. Hauptmann, Michael Christel and Rong Yan, Video Retrieval based on Semantic Concepts, In Proceedings of the IEEE 96(4): 602-622, April 2008
• Alexander G. Hauptmann, Rong Yan, Wei-Hao Lin, Michael Christel and Howard Wactlar, Filling the Semantic Gap in Video Retrieval: An Exploration, In Semantic Multimedia and Ontologies (Yiannis Kompatsiaris and Paola Hobson Eds.), Springer, 2008
  
  Conference version: Alexander G. Hauptmann, Rong Yan and Wei-hao Lin, How many high-level concepts will fill the semantic gap in news video retrieval, In International Conference on Image and Video Retrieval (CIVR), 2007. (Best Paper Runner-up)
• Apostol Natsev, Alexander Haubold, Jelena Tesic, Lexing Xie, Rong Yan, Semantic Concept-Based Query Expansion and Re-ranking for Multimedia Retrieval, In ACM Multimedia, 2007. (Oral)
• Jun Yang, Rong Yan, Alexander G. Hauptmann, Cross-Domain Video Concept Detection Using Adaptive SVMs, In ACM Multimedia, 2007. (Oral)
• Rong Yan, Ming-Yu Chen and Alexander G. Hauptman, Mining Relationship between Video Concept using Probabilistic Graphical Models, In IEEE International Conference On Multimedia and Expo (ICME), 2006
• Jun Yang, Rong Yan and Alexander G. Hauptmann, Multiple Instance Learning for Labeling Faces in Broadcasting News Video, In ACM Multimedia’05. (Oral)
• Rong Yan, Milind R. Naphade, Semi-supervised Cross Feature Learning for Semantic Concept Detection in Video, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), 2005. [PDF] [PS]
• Rong Yan, Yan Liu, Rong Jin and Alexander G. Hauptmann, On Predicting Rare Class with SVM Ensemble in Scene Classification, In International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), Hong Kong, China, April 6-10, 2003 (Oral Presentation) [PDF] [PS]

Machine Learning / Data Mining

• Michele Cossalter, Rong Yan, Lu Zheng, Adaptive Kernel Approximation for Large-Scale Non-Linear SVM Prediction. In International Conference on Machine Learning (ICML), 2011
• Wei Fan, Er-Heng Zhong, Jing Peng, Olivier Verscheure, Kun Zhang, Jiangtao Ren, Rong Yan, Qiang Yang, Generalized and Heuristic-Free Feature Construction for Improved Accuracy. In SIAM Conference on Data Mining (SDM), 2010
• Rong Yan, Jian Zhang, Transfer Learning using Task-Level Features with Application to Information Retrieval, In Twenty-first International Joint Conference on Artificial Intelligence (IJCAI), 2009
• Michele Merler, Rong Yan, John R. Smith, Imbalanced RankBoost for Efficiently Ranking Large-Scale Image/Video Collections, In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
• Jun Yang, Rong Yan, Eric P. Xing, and Yan Liu, Harmonium Models for Video Classification, In Statistical Analysis and Data Mining, 2007

• Rong Yan, Jelena Tesic and John R. Smith, Model-Shared Subspace Boosting for Multi-label Classification, In ACM SIGKDD international conference on Knowledge discovery and data mining (KDD), 2007. (Oral)
• Jian Zhang and Rong Yan, On the Value of Pairwise Constraints in Classification and Consistency, In International Conference on Machine Learning (ICML), 2007. (Oral)
• Jun Yang, Rong Yan, Alexander G. Hauptmann, Adapting SVM Classifiers to Data with Shifted Distributions, In International Conference on Data Mining (ICDM), workshop on “Knowledge Discovery from Multimedia Data and Multimedia Applications”, 2007.
• Rong Yan, Jian Zhang, Jie Yang and Alexander G. Hauptmann, A Discriminative Learning Framework with Pairwise Constraints for Video Object Classification, In IEEE Transaction on Pattern Analysis and Machine Intelligence 28, 2006
  
  Conference version: Rong Yan, Jian Zhang, Jie Yang and Alexander G. Hauptmann, A Discriminative Learning Framework with Pairwise Constraints for Video Object Classification, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2004. (Oral Presentation, 4% acceptance rate) [PDF] [PS]
• Eric P. Xing, Rong Yan and Alexander G. Hauptmann, Mining Associated Text and Images with Dual-wing Harmoniums, In Uncertainty in Artificial Intelligence (UAI)’05.  [PDF][PS]
• Rong Yan, Jie Yang, Alexander G. Hauptmann, Automatically Labeling Data Using Multi-class Active Learning, In 9th International Conference on Computer Vision (ICCV2003), Nice, France, 2003. [PDF] [PS]
• Rong Jin, Rong Yan, Jian Zhang, Alexander G. Hauptmann, A Faster Iterative Scaling Algorithm For Conditional Exponential Model, In International Conference on Machine Learning (ICML2003), Washington DC, USA, 2003. (Oral Presentation) [PDF] [PS]

Information Retrieval

• Rong Yan and Alexander G. Hauptmann, A Review of Text and Image Retrieval Approaches for Broadcast News Video, In Information Retrieval Journal, 2007
• Rong Yan, Alexander G. Hauptmann, Query Expansion using Probabilistic Local Feedback with Application to Multimedia Retrieval, In ACM Sixteenth Conference on Information and Knowledge Management (CIKM), 2007. (Oral)
• Rong Yan and Alexander G. Hauptmann, Probabilistic Latent Query Analysis for Combining Multiple Retrieval Sources, In ACM SIGIR, 2006. (Oral) [PDF][PS]  

• Rong Yan and Alexander G. Hauptmann, Efficient Margin-based Rank Learning Algorithms for Information Retrieval,  In International Conference on Image and Video Retrieval (CIVR), 2006. (Oral) [PDF] [PS] 
• Rong Yan, Jun Yang and Alexander G. Hauptmann, Learning Query-Class Dependent Weights for Automatic Video Retrieval, In ACM Multimedia 2004 (MM2004), 2004. (Best Paper Runner-up) [PDF] [PS]
• Rong Yan and Alexander G. Hauptmann, Co-Retrieval: A Boosted Reranking Approach for Multimedia Retrieval, In IEE Vision, Image & Signal Processing, Special Issue on Image and Video Retrieval, 2005.
  
  Conference version: Rong Yan and Alexander G. Hauptmann, Co-Retrieval: A Boosted Reranking Approach for Multimedia Retrieval, In International Conference on Image and Video Retrieval (CIVR2004), 2004. (Oral Presentation) [PDF] [PS]
• Rong Yan, Alex Hauptmann and Rong Jin, Multimedia Search with Pseudo-Relevance Feedback, In Video Mining (A. Rosenfeld et al. Eds), Springer, 2003
  
  Conference version: Rong Yan, Alexander G. Hauptmann and Rong Jin, Multimedia Search with Pseudo-Relevance Feedback, In International Conference on Image and Video Retrieval (CIVR2003), Urbana, IL, USA, 2003. (Oral Presentation) [PDF] [PS]
• Rong Yan and Alexander G. Hauptmann, The Combination Limit of Video Retrieval, In ACM Multimedia (MM2003), Berkeley, CA, USA, 2003. [PDF] [PS]

Human Computer Interaction

• Rong Yan, Apostol Natsev, Murray Campbell, Hybrid Tagging and Browsing Approaches for Efficient Manual Image Annotation, In IEEE Multimedia, Volume 16, Issue 2  (April 2009)
• Rong Yan, Apostol Natsev, Murray Campbell, A Learning-based Hybrid Tagging and Browsing Approach for Efficient Manual Image Annotation, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
• Michael Christel and Rong Yan, Merging Storyboard Strategies and Automatic Retrieval for Improving Interactive Video Search, In International Conference on Image and Video Retrieval (CIVR), 2007.
• Alexander G. Hauptmann, Wei-Hao Lin, Rong Yan, Jun Yang and Robert Chen, Extreme Video Retrieval: Joint Maximization of Human and Computer Performance, In ACM Multimedia, 2006. (Oral)

Privacy / Healthcare

• Datong Chen, Yi Chang, Rong Yan and Jie Yang, Protecting Personal Identification in Video, In Protecting Privacy in Video Surveillance, Springer London, 2009
• Datong Chen, Yi Chang, Rong Yan, and Jie Yang, Tools for Protecting Privacy of Specific Individuals in Video, In EURASIP Journal on Applied Signal Processing, Special Issue on “Signal Processing Technologies for Ambient Intelligence in Home-Care Applications”, 2007
• Alexander G. Hauptmann, Jiang Gao, Rong Yan, Yanjun Qi and Jie Yang, Aiding Geriatric Patients and Caregivers through Automated Analysis of Nursing Home Observations, In IEEE Pervasive Computing, Special Issue on Pervasive Computing for Successful Aging, 2004.

Distributed Systems

• Deepak S. Turaga, Hyunggon Park, Rong Yan, and Olivier Verscheure, Adaptive Multimedia Mining on Distributed Stream Processing Systems, IEEE Intl Conf. on Data Mining (ICDM), 2009
• Deepak S. Turaga, Brian Foo, Olivier Verscheure and Rong Yan, Configuring Topologies of Distributed Semantic Concept Classifiers for Continuous Multimedia Stream Processing, In ACM Multimedia, 2008
• Rong Yan and Seth Goldstein, Mobile Memory: Improving Data Locality in Very Large Reconfigurable Fabric, In IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM'02), April 8 - April 11, 2002 [PDF][PS]

 

Talks (up to year 2008)

• Tutorial, “Content-based and Semantic-based Image/Video Retrieval” in SIGIR’08, with Winston Hsu
• Tutorial, “Recent Developments in Content-based and Concept-based Image/Video Retrieval” in ACM Multimedia’08, with Winston Hsu
• Invited talk, “iMARS: Multimedia Analysis and Retrieval System”, in IBM China Research Lab, Feb. 2008.
• Invited talk, “Efficient methods for learning video concepts from large-scale collections”, in Tsinghua Univ. / Microsoft Research Asia / China Academy of Sciences / Intel Research, China, Feb. 2008.
• Invited talk, “Efficient methods for learning video concepts from large-scale collections”, in City University of Hong Kong, Dec. 2007
• Invited talk, “Probabilistic Models for Combining Diverse Knowledge Sources in Information Retrieval”, in Columbia Univ., Mar. 2007
• Invited talk, “Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval”, in Univ. of California Santa Cruz, Apr. 2006
• Invited talk, “Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval”, in Google, Apr. 2006
• Invited talk, “Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval”, in Microsoft Research, Mar. 2006
• Invited talk, “Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval”, Emerging Leader in Multimedia seminar in IBM T.J. Watson Research Center, Aug. 2005
• Invited talk, “Semi-supervised Cross Feature Learning for Semantic Concept Detection in Video”, in IBM T.J. Watson Research Center, Aug. 2004
• Invited talk, “Learning Query-Class Dependent Weights for Automatic Video Retrieval”, LTI seminar in Carnegie Mellon Univ., Dec. 2004
• Oral Presentation, “Learning Query-Class Dependent Weights for Automatic Video Retrieval”, in ACM Multimedia, New York, Oct. 2004  
• Oral Presentation, “A Discriminative Learning Framework with Pairwise Constraints for Video Object Classification”, in CVPR, Jul. 2004
• Invited talk, “Negative Pseudo-Relevance Feedback in Content-based Video Retrieval”, IR Seminar in Carnegie Mellon Univ., May 2003  

 

Other projects

• Name: TREC02/03 Manual Video Retreival System
  Snapshot:[.jpg], Rank 3rd among 14 submissions in TREC02 Video Track evaluation
  Rank 1st among 35 submissions in TREC03 Video Track evaluation
• Name: A MATLAB Classification Wrapper ( MATLABArsenal )

• Name: Distinguish fake sentences from real sentences [.pdf]
  Accuracy: 90.2%, Rank 1st in course "Language & Statistics"
• Name: A variant of improved iterative scaling algorithm [.pdf]
  Faster convergence rate than standard IIS algorithm
• Name: A modified version of rainbow supporting above IIS algorithm [.zip]
• Name: Software Support Memory Forwarding [.pdf] Slides: [.ppt]
  A Zero-Cost Data Layout Optimization Technique
• Name: A study for sampling rate in video [.xls][readme.txt]
• Name: Integrate the dialogue system, RavenClaw, with the roboceptionist in NSH 3rd floor, Valerie