BOUNTY: Convert the endpoints to a smart router like litellm does in python about edgechains HOT 27 OPEN

very well. assigned to @rajdip-b best wishes. please feel free to drop in to discord if u want to discuss anything quickly. https://discord.gg/Avsbume2

from edgechains.

@sandys Ah, that's bad. Sure, I'll take this issue op alone. @guhitb You can still connect with me in case you want to collab on any other issue! Hope that's fine by everyone :D

from edgechains.

from edgechains.

/bounty 200

from edgechains.

💎 $200 bounty created by sandys
🙋 If you start working on this, comment /attempt #286 to notify everyone
👉 To claim this bounty, submit a pull request that includes the text /claim #286 somewhere in its body
📝 Before proceeding, please make sure you can receive payouts in your country
💵 Payment arrives in your account 2-5 days after the bounty is rewarded
💯 You keep 100% of the bounty award
🙏 Thank you for contributing to arakoodev/EdgeChains!

from edgechains.

/attempt #286

from edgechains.

@sandys can i be assigned this issue?

from edgechains.

@rajdip-b happy to.
but first want to check if you understand what has to be achieved ? any doubts, etc ?

from edgechains.

@rajdip-b Any interest in collaborating on this?

from edgechains.

@sandys As per my understanding, the main challenge is creating the load balancer in the endpoints of OpenAiEndpoint.ts. I was going through the references you mentioned and have a clarity over what needs to be implemented. I would have to do some further digging about the how's of the implementation, but yes, I feel I can definitely give it a shot!

And not to mention, as and when issues come up, I will ping you about them.

from edgechains.

@rajdip-b there are 4 capabilities needed (as mentioned in my original post). it is important that you look at all four, because the architecture will need to be inclusive.
also, this architecture will REPLACE the current endpoint structure

from edgechains.

@guhitb, are you familiar with the project structure/implementation details? I would be happy to collaborate!

from edgechains.

@rajdip-b there are 4 capabilities needed (as mentioned in my original post). it is important that you look at all four, because the architecture will need to be inclusive. also, this architecture will REPLACE the current endpoint structure

Yeah, of course, I understand that. For me, I feel the challenge would be implementing load balancing, hence mentioned that. As for the rest, I feel they can be done with lesser efforts than the former.

from edgechains.

very well. assigned to @rajdip-b best wishes. please feel free to drop in to discord if u want to discuss anything quickly. https://discord.gg/Avsbume2

Discord is my go-to for discussion! Hopping in right now!

from edgechains.

@rajdip-b Not yet, aside from browsing through the repo today. I don't have much experience with open source, but I'm sure I can help with mocks, logging, tests, etc. The load balancing part feels a little daunting though.

from edgechains.

@rajdip-b Not yet, aside from browsing through the repo today. I don't have much experience with open source, but I'm sure I can help with mocks, logging, tests, etc. The load balancing part feels a little daunting though.

Hey sure thing! We can pair up!

Drop me a text on discord! _the_heisenberg

from edgechains.

/split @guhitb

from edgechains.

from edgechains.

Hey @sandys, I have started with the docs today. I have went through the code base of litellm and how they implement their stuff. I also went though openai docs. I have some questions and suggestions that I would like to share and discuss with you. I couldn't find you in discord in you channel. mind pinging you handle in here? ill open a thread in discord and tag you in it!

from edgechains.

Created! @sandys

from edgechains.

Hello @rajdip-b are you still working on this. Let me know your discord handle. I would like to connect with you there

from edgechains.

Hey @Sajiyah-Salat, there has been a blocker, and hence I have paused my work currently.

from edgechains.

Okay. Thanks for the reply

from edgechains.