This RFC proposes new APIs in Ray for leveraging Large Language Models (LLMs) effectively within the Ray ecosystem, specifically introducing integrations for Ray Serve and Ray Data with vLLM and ...
This mod was developed by me for my modpack, I cannot guarantee that it will work properly in other situations.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback