alexandres / lexvec Goto Github PK
View Code? Open in Web Editor NEWThis is an implementation of the LexVec word embedding model (similar to word2vec and GloVe) that achieves state of the art results in multiple NLP tasks
License: MIT License
This is an implementation of the LexVec word embedding model (similar to word2vec and GloVe) that achieves state of the art results in multiple NLP tasks
License: MIT License
Sorry if this is a silly question, though can you provide any references to assist in making use of these output vectors in Go?
Hello! Is there a way to convert all the files of embeddings in bin format?
Hi Alexandre,
Is there a way to embed you application as lib in Go for POS Tagger actions within a Go Web Application?
Thanks!
I'm experimenting with building lexvec and running it.
./lexvec -threads 64 -corpus 59m.txt -output lexvectors
.....
cds total: 67097075.384447
calculating ppmi matrix
create vectors
running lexvec
panic: nan
goroutine 102 [running]:
main.learn(0xc420210a20, 0xc447a48b40, 0xc424326d70, 0x5f7720, 0xc42132e570, 0xc424648000, 0x0, 0xc4a465a000, 0x12c, 0x12c, ...)
/var/lib/jenkins/workspace/lexvec/lexvec.go:319 +0x4a0
main.main.func3(0xc4200ce330, 0xc4200ce370, 0xc4200ce310, 0xc4200ce2a0, 0xc6294e9980, 0xc449fb4200, 0x40, 0x40, 0xc449fb4000, 0x40, ...)
/var/lib/jenkins/workspace/lexvec/lexvec.go:1022 +0x1929
created by main.main
/var/lib/jenkins/workspace/lexvec/lexvec.go:1056 +0x2f22
when i install this package,i used make,one error occurred.pls help
CC="clang" CGO_CFLAGS="-Ofast -std=gnu99 -march=native" go build --ldflags '-extldflags "-static"' -o lexvec
# github.com/alexandres/lexvec
/usr/local/Cellar/go/1.11.2/libexec/pkg/tool/darwin_amd64/link: running clang failed: exit status 1
ld: library not found for -lcrt0.o
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [optimal] Error 2
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0x4ca33f]
goroutine 1 [running]:
main.mergeContextVectors()
.../lexvec/model.go:117 +0x15f
main.saveVectors()
.../lexvec/model.go:65 +0x455
main.main()
.../lexvec/main.go:211 +0x13ef
Requesting an updated version of LexVec with Common Crawl 2017,
with 3 million most frequent words to be competitive with GloVe.
Bonus: Common Crawl 2015~2017 to get 100B tokens (like word2vec)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.