Giter Club home page Giter Club logo

Comments (4)

GoogleCodeExporter avatar GoogleCodeExporter commented on August 29, 2024
No problem for me.

I don't know if it is really related, but have you ever considered changing the 
design such that a single CL and/or SL instance can manage multiple buckets? 
For the CL, this probably means watching multiple HDFS directories and managing 
multiple sets of MR jobs. For the SL, it would also mean that the request needs 
to contain information about which bucket you want to query.

Just a thought, don't know if it really make sense, but it could simplify 
deployment scenario's when there are multiple buckets.

Original comment by [email protected] on 13 Feb 2013 at 7:33

from myrrix-recommender.

GoogleCodeExporter avatar GoogleCodeExporter commented on August 29, 2024
As I dig into the scope of making this change, I find it may be easier to keep 
the existing scheme and fix the problem differently -- make sys/ "per 
instance". It turns out it is useful for a few small things. I'll post back 
when I know more.

Yeah I had thought that this was more simply managed by just using separate 
processes. That consumes a little more resource, and means managing several 
processes. But one way or the other it probably means managing several 
configurations. I had thought it simpler to make one instance deal with one 
model and encourage some isolation among instances.

Original comment by [email protected] on 15 Feb 2013 at 3:38

from myrrix-recommender.

GoogleCodeExporter avatar GoogleCodeExporter commented on August 29, 2024
Changed my mind, personally, after reading into the scope of the change 
further. There is some small use to instances after all. The magnitude of the 
change was more significant than I'd imagined too. Solving the issue I alluded 
to initially -- shared state in the "sys/" directory per bucket -- was easier 
than I'd expected. So, that's the outcome for now. Leave instances, fix the 
small existing problem directly.

Original comment by [email protected] on 16 Feb 2013 at 8:26

  • Changed state: WontFix
  • Added labels: Priority-Medium
  • Removed labels: Priority-High

from myrrix-recommender.

GoogleCodeExporter avatar GoogleCodeExporter commented on August 29, 2024
I kind of like having "directories" under a single bucket personally, just from 
the perspective of keeping track of it all it's been pretty easy for me to run 
all instances under one bucket and just have a different naming convention for 
each logical instance (e.g. dev, test, staging, production). But honestly it 
doesn't make much of a difference to me, so whatever works best on the code 
side seems fine.

Original comment by [email protected] on 17 Feb 2013 at 6:47

from myrrix-recommender.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.