Cloud func python AI tools

Do python cloud functions support installing chromadb and langchain libraries as dependencies? Is it possible to upload a 15GB LLM into a storage bucket and use it in cloud functions?

Context: I would like to run privateGPT on Appwrite.

TL;DR

The user is asking if Python cloud functions support installing certain libraries as dependencies and if it is possible to upload a 15GB LLM into a storage bucket and use it in cloud functions. It is mentioned that the Python runtime on the platform is based on Alpine and currently missing some necessary libraries for machine learning operations. However, they are working on a new Python runtime. The possibility of running privateGPT on Appwrite is not addressed, nor is there a specific solution given for the missing libraries issue.

I've never used Python for the cloud functions - always node.js. That being said, I've never faced an issue with installing dependencies, because when the function is deployed, the npm install command is run, which installs all the dependencies in the associated package.json.

I understand that Python uses a requirements.txt, and according to https://github.com/open-runtimes/open-runtimes/blob/main/runtimes/python-3.10/build.sh#L13-L14, it installs the deps as well.

As for the 15GB LLM, I'm not 100% certain, but I would think that it's absolutely possible. Looking at this https://appwrite.io/docs/environment-variables#storage, you should be able to tweak the _APP_STORAGE_LIMIT variable to your liking.

I don't think this will work in cloud (as of now considering it's in free public beta), but might be possible depending on their pricing model.

For a self-hosted instance, just make sure you've got the space on the machine, and should be possible.