Giter Club home page Giter Club logo

awesome-lgb's Introduction

awesome-lgb

官方调参指南

官方参数列表

LightGBM的亮点(很多人比较关注两个点儿,自己对系统优化也非常感兴趣):

1.基于Histogram的决策树算法

2.带深度限制的leaf-wise的树生长策略

(ps: 为了简化码字量,统一用lgb指代LightGBM)

问题

1.似乎在xgb和lgb中,都没有提供针对多分类的平衡方案(只有二分类)?

参数理解

  1. lgb的树生长算法是leaf-wise,当需要调节模型(树)复杂度时,以num_leaves为主,max_depth为辅。

  2. 解决二分类问题的不平衡参数:‘is_unbalance’=True。该参数将不平衡问题解决放入模型构建过程中,解放劳动力。不过对lgb如何解决不平衡问题仍然保持好奇?

scale_pos_weight=1.0,weight of positive class in binary classification task.

  1. bagging**的融入。bagging_fraction和bagging_freq同时设置,feature_fraction。从fraction的字面意思来理解,应该是通过sampling增加多样性,避免overfitting。

  2. min_data_in_leaf

  3. min_sum_hessian_in_leaf

awesome-lgb's People

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.