Comments (6)
Sorry for the late reply. I've tested with the latest CRAN version 0.4.8. I find this problem still happens occasionally. Note that the previous example I posted is not a good one, as seed is only set for generate.data()
, but not for sample()
. The following code is more reproducible. set.seed(1)
works fine, but set.seed(2)
still leads to this problem.
R version 4.3.1
abess version: 0.4.8
library(abess)
set.seed(2)
n <- 100
p <- 1000
family <- "poisson"
snr <- Inf
beta <- rep(0, p)
nonzero <- sample(1:p, 10)
beta[nonzero] <- c(5, 5, 5, 5, 5, 5, 5, 5, 5, 5)
k <- 10
data <- generate.data(n, p, beta = beta, snr = snr, family = family, support.size = k)
x <- data$x
y <- data$y
abess(x, y, tune.type = "cv", family = "poisson", support.size = 0:14)
from abess.
Thanks. I can reproduce this on my laptop. It may be caused by the extremely large value of the deviance when setting support.size = 0:14
.
> abess(x, y, tune.type = "gic", family = "poisson", support.size = 0:13)
Call:
abess.default(x = x, y = y, family = "poisson", tune.type = "gic", support.size = 0:13)
support.size dev GIC
1 0 -7.581848e+14 -1.51637e+15
2 1 -2.298525e+34 -4.59705e+34
3 2 -2.298525e+34 -4.59705e+34
4 3 -2.298525e+34 -4.59705e+34
5 4 -2.298525e+34 -4.59705e+34
6 5 -2.298525e+34 -4.59705e+34
7 6 -2.298525e+34 -4.59705e+34
8 7 -2.298525e+34 -4.59705e+34
9 8 -2.298525e+34 -4.59705e+34
10 9 -2.298525e+34 -4.59705e+34
11 10 -2.298525e+34 -4.59705e+34
12 11 -2.298525e+34 -4.59705e+34
13 12 -2.298525e+34 -4.59705e+34
14 13 -2.298525e+34 -4.59705e+34
from abess.
@oooo26 , I have uploaded two files poisson_y.csv
and poisson_x.csv
that corresponds to y
and x
, respectively. Can you test whether this issue happens in python?
poisson_x.csv
poisson_y.csv
from abess.
Hi, sorry for the late response. I have checked in Python, but the problem seems to not happen.
ABESS version: latest, v0.4.6(PyPI)
Python version: 3.9.12
Here is the test code:
import numpy as np
import pandas as pd
import abess
X = pd.read_csv("poisson_x.csv")
y = pd.read_csv("poisson_y.csv").squeeze()
print(X.shape)
print(y.shape)
model = abess.PoissonRegression(
support_size=range(15), # 0:14
cv=5 # both CV and IC are working
)
model.fit(X, y)
print(f"Sparsity: {np.count_nonzero(model.coef_)}")
print(f"Non-zero: {np.nonzero(model.coef_)[0]}")
print(f"Train Loss: {model.train_loss_}")
print(f"Test Loss: {model.eval_loss_}")
######
# Sparsity: 4
# Non-zero: [122 352 573 769]
# Train Loss: -2360540438301305.5
# Test Loss: -729389503380903.0
######
from abess.
@brtang63 , can you check this issue on the latest abess
R package? I believe this problem has been addressed.
from abess.
@brtang63 I guess this is because the estimated coefficients are unbounded because of the natural of poisson distribution. In the new version of abess
library, you can use the beta.max
and beta.min
to control the range of estimated coefficients. You may refer this link: #510 (comment)
from abess.
Related Issues (20)
- Is it possible to combine `group` and `always_select` to always select a whole group? HOT 3
- Incorporation of `fit_intercept` to `LinearRegression`? HOT 9
- Why the data generator funciton `make_glm_data` for gamma will define n shape parameters for a data set HOT 2
- Incorrect optimal support size in a multitask learning problem with nonnegativity constraints HOT 15
- How I can aviod intercept when I do abess in R HOT 1
- Provide any option for inference? HOT 12
- Risk Score Card Develope HOT 3
- How to set test data HOT 1
- [Feature] Release new version of `abess` on PyPI and Conda HOT 2
- Any way to work with preselected sets of variables in abess & with MBIC criterion? HOT 8
- Version 0.4.7 crashing when LinearRegression.fit() invoked HOT 3
- Colname errors HOT 1
- different results on Mac, Linux, Windows HOT 2
- [Feature] add a Wikipedia page about `abess` HOT 1
- Failed to build abess HOT 2
- What do multiple sets of coefficients mean? HOT 2
- Error in x_y_matching.glm(para, data) : Rows of x must be the same as rows of y! HOT 1
- 风险评分优化
- Compilation Fails on AARCH64 / ARM64 Due to x86 Specific Compiler Flags
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from abess.