Giter Club home page Giter Club logo

gptcn's Introduction

GPTCN

The source code for GPTCN is located in the source_code folder.

In the following, some additional remarks are made on areas not mentioned in detail in the icassp article. It includes the topology diagram of each module of the model and the hyperparameter experiment after grid search.

The model topology of the GPTCN

image text

An illustration of user installation behavior

image text In actual application installation behavior data, as we can observe from the Figure above, the occurrence of user behavior is often low-frequency and unevenly distributed over time. After the massive demand for downloads associated with replacing a new phone is largely satisfied, users tend to download and install apps only when necessary. Additionally, due to external influences in real life, users may be impulsive and install or uninstall multiple applications rapidly within a short period of time. The resulting time intervals of such behavior are often non-negligible. The sparsity and unevenness of behavior data can often have a negative impact on the performance of models.

Diagram of the structure of our data scheme

image

TCN autoencoder architecture diagram

image

Gated multi-head attention Architecture

image

Performance of DDHCN with various hyperparameters on age and gender prediction

Performance of DDHCN with various hyperparameters on age and gender prediction

Our model is an improved version of the basic model consisting of Transformer and CNN. The number of layers in the Transformer and the size of the convolutional kernel are hyperparameters known to have an impact on the final performance of the model. Here, we perform a grid search on the number of layers in the Transformer encoder and decoder, ranging from 1 to 5, as shown in Figure (a) and (b). The width of the convolutional kernel is selected as 2, 4, 8, 16, 32 for testing, as shown in Figure (c). After experimentation, we recommend using two layers of Transformer and setting the width of the convolutional kernel to 8 for optimal performance.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.