Comments (3)
Possibly related to #62
from falcon.
I had a look into the extension's source: It's stored inside web extensions storage.local
area, as [time]: { text }
objects. It also keeps both a time index (timestamp of all existing entries) and a two week "preloaded cache" for quick access, which means all visited sites from the past 14 days are permanently in your browser memory. This could theoretically lead to memory problems, as the websites' texts are never truncated. If you search for text older than that, all entries for the specified time frame (determined using the time index) are retrieved from storage (again, possibly large amount of memory) and then processed.
This is all pretty clever and a reasonable implementation imo. I'm not sure what better way there could be using web extensions (that support FTS) - the only thing I could think of is a WASM SQlite module.
from falcon.
Thanks for figuring it out! I did not know extensions had a separate "inspect" area when debugging them. More here for newbies, though it seems like it still has no easy export/import functionality in the browser.
I'm not sure what better way there could be
There are clever data structures like inverted indices, which grow with vocabulary (which has a limit) and not the amount of text on pages you visit. But the number of URLs still keeps growing.
from falcon.
Related Issues (20)
- Accept donations HOT 2
- Extension breaks go to unread post on ArsTechnica forums
- Credit Min for project inspiration? HOT 2
- Feature Req: Ability to index bookmarks even when history cleared. HOT 1
- Is it possible to export a cached page? HOT 3
- Firefox
- Feature request
- Falcon opens https://github.com/lengstrom/falcon every time it is updated HOT 4
- We added support for existing History, Bookmarks and PDFs. Want to collaborate? HOT 2
- [BUG] 1 Blacklist option not working, rest just Regex
- [BUG] Default Blacklist not working
- Release new version on chrome webstore HOT 5
- Great Addon! hope support Firefox browse as well!!! HOT 2
- Can not work in vivaldi HOT 1
- Show results page with more entries? HOT 2
- Allow customization for the hot key (f)? HOT 1
- Add PDF support
- Chrome Web Store says "press enter", which is wrong HOT 1
- Show all search results
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from falcon.