perform bad on classifiction task about etm HOT 3 OPEN

I notice that although top selected words in each topic is clearer than other topic models like NVDM, topics related to some classes is less likely to appear. For example, only few from 100 topics indicate music/movie.

The classes I use are ['car', 'game', 'food', 'movie', 'music', 'news', 'show', 'sports', 'tech', 'travel']

edit:
I notice that we use topic embedding in ETM.
Will topic embedding encourage the topic model to discover those topics similar with each other and ignore those independent topic? For example, in my experiments, about 30% topics extracted are talking about news and very few topics relates to music.

from etm.

@worldchanger6666 I am not associated with ETM paper, but here is my 2 cents on why you see poor classification performance. When performing topic modelling you are throwing away lot of information. I personally wouldn't use LDA representations for downstream tasks. I see it more as a way of finding and visualizing a manageable set of themes/topics. In your case average title length is just 10 words, so probably there are lot of very subtle or rare words that you want to capture as part of classification, but LDA effectively smooths these over. Just from the classes I can see potentially lot of overlap between "movie", "music" and "show". So you're better off using SVM with BoW feature representation, or if you want to use embeddings, then you can try Deep Averaging Networks (DANs).

from etm.

You should never use representation from a generative model like LDA-based to perform a classification task.

from etm.