TPNE: Topology preserving network embedding

Abstract Network embedding aims at mapping nodes into a vectorial feature space while maximally preserving the topological relations of nodes in a network so as to facilitate complex network analysis. The existing works in network embedding are focused on preserving local or global topological information within limited step-sizes, which could be insufficient in many applications, even the underlying network is undirected and unweighted. The complex and rich topological information in networks exerts paramount impacts on the formation of networks and can reveal the high-order relevance among different nodes. In this paper, we propose a novel network embedding framework based on deep neural networks, named Topology Preserving Network Embedding (TPNE), which is suitable for arbitrary types of information networks: directed or undirected, weighted or unweighted. In this framework, we devise a closeness matrix to capture more comprehensive global topology of the network, and combine both global closeness reconstruction and local neighborhood preserving into a single loss function. To justify our model, we conduct extensive experiments on node classification, link prediction and node visualization tasks, employing the learned embedding vectors. It demonstrates that the proposed approach has promising performance and it outperforms the existing state-of-the-art approaches on several networks in such tasks.

[1]  Feiping Nie,et al.  Cauchy Graph Embedding , 2011, ICML.

[2]  Zhiyuan Liu,et al.  Max-Margin DeepWalk: Discriminative Learning of Network Representation , 2016, IJCAI.

[3]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[4]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[5]  Erik Marchi,et al.  Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[6]  Steven Skiena,et al.  Don't Walk, Skip!: Online Learning of Multi-scale Network Embeddings , 2016, ASONAM.

[7]  Tommy W. S. Chow,et al.  Robust non-negative sparse graph for semi-supervised multi-label learning with missing labels , 2018, Inf. Sci..

[8]  Dan Wang,et al.  Adversarial Network Embedding , 2017, AAAI.

[9]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[10]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[11]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[12]  Sang-Wook Kim,et al.  Efficient and effective influence maximization in social networks: A hybrid-approach , 2018, Inf. Sci..

[13]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[14]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[15]  Huan Liu,et al.  Relational learning via latent social dimensions , 2009, KDD.

[16]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[17]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[18]  Yun Chi,et al.  Combining link and content for community detection: a discriminative approach , 2009, KDD.

[19]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[20]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[21]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[22]  Michelangelo Ceci,et al.  Ensemble Learning for Multi-Type Classification in Heterogeneous Networks , 2018, IEEE Transactions on Knowledge and Data Engineering.

[23]  Borut Zalik,et al.  Memetic algorithm using node entropy and partition entropy for community detection in networks , 2018, Inf. Sci..

[24]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[25]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[26]  Michelangelo Ceci,et al.  Multi-type clustering and classification from heterogeneous networks , 2018, Inf. Sci..

[27]  Kun He,et al.  Hidden Community Detection in Social Networks , 2017, Inf. Sci..

[28]  Yu-Jun Zheng,et al.  A Pythagorean-Type Fuzzy Deep Denoising Autoencoder for Industrial Accident Early Warning , 2017, IEEE Transactions on Fuzzy Systems.

[29]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[30]  Charu C. Aggarwal,et al.  Learning Deep Network Representations with Adversarially Regularized Autoencoders , 2018, KDD.

[31]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.