Cloud func python AI tools
Do python cloud functions support installing chromadb and langchain libraries as dependencies? Is it possible to upload a 15GB LLM into a storage bucket and use it in cloud functions?
Context: I would like to run privateGPT on Appwrite.
I've never used Python for the cloud functions - always node.js. That being said, I've never faced an issue with installing dependencies, because when the function is deployed, the npm install command is run, which installs all the dependencies in the associated package.json.
I understand that Python uses a requirements.txt, and according to https://github.com/open-runtimes/open-runtimes/blob/main/runtimes/python-3.10/build.sh#L13-L14, it installs the deps as well.
As for the 15GB LLM, I'm not 100% certain, but I would think that it's absolutely possible. Looking at this https://appwrite.io/docs/environment-variables#storage, you should be able to tweak the _APP_STORAGE_LIMIT variable to your liking.
I don't think this will work in cloud (as of now considering it's in free public beta), but might be possible depending on their pricing model.
For a self-hosted instance, just make sure you've got the space on the machine, and should be possible.
cc @Christy Jacob
No unfortunately not at the moment.
Our python runtime is based on alpine and is missing some of the supporting libraries required to support most machine learning operations .
We are however working on a new python runtime to make this possible.
Loading a 15 GB runtime may not be possible on the free tier as it is not feasible to support this for all the developers on the free plan.
Hi @Mattias Aabmets shall we close this if no more help is needed here?
Sure why not
please create a new post
