phiresky / tantivy-wasm Goto Github PK

I know this is just a demo but I'm wondering if you'd be willing to release it under a permissive license so others can mess around with it.

I built this project with your forks of tantivy and tantify-fst. I couldn't figure out the requirements for the index files so I downloaded them off your hosted demo. Running npx http-server looked like it worked, but it got to the bf92c5e40ac948299bc68912773ab04f.store request and then hung - in Chrome the tab is stuck at max CPU and the request for that file shows up as pending permanently.

Before then it does print a few lines:

Getting info for term "horac"
Fetching document ids and frequencies matching term Term(field=1,text="\u{0}\u{0}\u{0}\u{1}horac")
Getting info for term "horac"
Fetching document ids and frequencies matching term Term(field=2,text="\u{0}\u{0}\u{0}\u{2}horac")
Getting info for term "slughorn"
Fetching document ids and frequencies matching term Term(field=1,text="\u{0}\u{0}\u{0}\u{1}slughorn")
Getting info for term "slughorn"
Fetching document ids and frequencies matching term Term(field=2,text="\u{0}\u{0}\u{0}\u{2}slughorn")

(This happens whether or not I apply the decoder.patch in this directory.)

I tried doing it with my own index following the example in the tantivy-cli docs, but it failed with OpenReadError(IOError { io_error: Error { kind: InvalidData, message: "stream did not contain valid UTF-8" }, filepath: "dd8df16bbcac45078e02b00c027bcff8.term" }); no idea what that indicates. Does the index need to be built in a certain way?

I realize you only intended this as a demo, so if you don't want to spend time helping me debug don't worry about it, but if you happen to know what's wrong I'd appreciate it.

Hi,

very cool project.
I tried to compile it (after I adjusted the tantivy to my local path) and got the following compile error:
"all compressors are deactivated via feature-flags, check Cargo.toml for available decompressors."
for tantivy.
Did you change something in tantivy that I also have to?

Thanks
Andy