Comments (4)
aronwc
commented on August 21, 2024
X matrix is currently computed by criterias.py.
- order the columns by id
- may need to use a sparse matrix if this gets too big.
- pickle the result
from ctrosset.
cyril94440
commented on August 21, 2024
After a lot of database manipulations. I finally have the X matrix in a pickle file of 623 Mo.
This is a sparse lil_matrix and it loads from file to memory in 1mn11s.
Now i'll determine how to use the sparse matrix in the linear regression function.
from ctrosset.
aronwc
commented on August 21, 2024
Great - don't forget to also pickle the vocabulary, so we know which company/account pair each matrix cell refers to.
from ctrosset.
aronwc
commented on August 21, 2024
Done. See friendsMatrix.pkl and profileMatrix.pkl (and friendsMatrixFromDB.py and profileMatrixFromDb.py).
X is created by XMatrixFromDB.py
from ctrosset.
Related Issues (20)
- Collect list of followers for the 130 companies HOT 2
- Plot MSE and number of columns as threshold decreases HOT 1
- Linear regression computation issue HOT 3
- Add documentation to README.md HOT 1
- Try different values for alpha HOT 11
- Print out top weights for each label HOT 6
- Try predicting other variables
- Print a scatter plot of truth versus predicted % male HOT 8
- Compare against a baseline HOT 1
- Write research report
- Repeat experiments with Lasso HOT 1
- Collect sample of 1000 followers for each company
- Error analysis HOT 4
- Collect list of people each follower follows HOT 1
- Read over linear regression background HOT 1
- Remove sensitive data from github HOT 1
- Compute cross-validation mean-squared error for gender prediction HOT 22
- Filter X matrix by company frequency HOT 3
- Dedicated server problem HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ctrosset.