r888888888 / archives Goto Github PK
View Code? Open in Web Editor NEWservice for storing versioned data
License: MIT License
service for storing versioned data
License: MIT License
I vaguely remember @r888888888 mentioning there's no guarantee that messages will get delivered/processed in order they were pushed. Due to the nature of versioning service this spells disaster, because if two versions for the same post get delivered out of order, the diffs will get calculated and stored incorrectly.
Some thoughts:
Sorry to bother you with newb stuff.
Is there any way I could get instructions for deploying this? iqdb/iqdbs and archives seem less straight-forward than danbooru is.
I don't know if this is a one-off error or something else, but I noticed the following when browsing through the pool versions.
http://danbooru.donmai.us/pool_versions?search%5Bpool_id%5D=12054
It basically created 5 versions for 5 different pool adds done at pool creation.
When no arguments are specified, Process.daemon
redirects all output to /dev/null
; therefore, if the service is run directly via bundle exec ruby services/sqs_processor.rb --logfile=my.log --pidfile=my.pid
, no output is logged. After changing the line to Process.daemon(true, true)
, it executes fine and logs output as expected.
Disclaimer: I have no idea what sets the RUN
environment variable, because googling that turned out quite difficult.
When I create a post or a pool, the operation is successful but Archives' database is not updated due to the "booru_id" column being null.
I should probably specify that I'm using Archives without AWS, after I substituted the cloud service with a local service reading from a UNIX socket (it's just a ruby server with two threads writing to and reading from a shared Queue object.)
Despite that radical, the data is sent correctly to Archives from the main Danbooru and in fact inspecting it I could see that all the expected fields are there with a value, except "booru_id" which is missing from the JSON and thus null.
I solved this by creating a new migration dropping the "booru_id" column, but I don't know if this is the correct solution.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.