Logo image
ClusTop: A Clustering-based Topic Modelling Algorithm for Twitter using Word Networks
Conference proceeding

ClusTop: A Clustering-based Topic Modelling Algorithm for Twitter using Word Networks

Kwan Hui Lim, Shanika Karunasekera and Aaron Harwood
IEEE International Conference on Big Data, pp.2009-2018
IEEE International Conference on Big Data
01/01/2017

Abstract

Computer Science Computer Science, Artificial Intelligence Computer Science, Information Systems Science & Technology Technology
Twitter is a popular microblogging service, where users frequently engage in discussions about various topics of interest, ranging from popular topics (e.g., music) to niche topics (e.g., politics). With the large amount of tweets, a key challenge is to automatically model and determine the discussion topics without having prior knowledge of the types and number of topics, or requiring the technical expertise to define various algorithmic parameters. For this purpose, we propose the Clustering-based Topic Modelling (ClusTop) algorithm that constructs various types of word network and automatically determines the discussion topics using community detection approaches. Unlike traditional topic models, ClusTop is able to automatically determine the appropriate number of topics and does not require numerous parameters to be set. The ClusTop algorithm is also able to capture the syntactic meaning in tweets via the use of bigrams, trigrams and other word combinations in constructing the word network graph. Using three Twitter datasets with labelled crises and events as topics, ClusTop has been shown to outperform various baselines in terms of topic coherence, pointwise mutual information, precision, recall and F-score.

Metrics

1 Record Views

Details

Logo image