Back

About the new ML runtime

  • 0
  • Functions
Mattias Aabmets
26 Apr, 2023, 06:10

As I just read from Appwrite Twitter account, you're cooking up a new runtime which is designed to perform machine learning tasks. Because Appwrite is scalable with Docker Swarm, does that mean that if a ML task is given to the swarm, then the task is automatically distributed across the swarm nodes to speed up the learning process? Technically, would this mean that we are able to easily scale ML tasks across multiple server machines? Also, would the ML runtime support distributed training of large language models like LLaMA?

TL;DR
The new ML runtime in Appwrite is a Python runtime with system libraries for machine learning tasks. Currently, it does not support distributed training of large language models like LLaMA, but future iterations may add this feature based on community feedback. The ML runtime has access to host machine GPUs, which is important for machine learning. It scales the same way as other Appwrite Functions.
joeyouss
26 Apr, 2023, 08:33

Hi - The runtime will be basically a Python runtime with all system libraries needed to do machine learning things so it becomes easier for ML devs to work with it. Ofcourse it would be open to gather community feedback to see how we want to improve it and make it better. That being said, No, currently in first iteration of release, ML runtime will not support distributed training of large language models like LLaMA, but in next iterations (if community feedbacks suggest) it will be added.

It will scale exactly the same as any other Appwrite Function BUT it will proper access to host machine GPU, which is almost necessary for machine learning.

Mattias Aabmets
26 Apr, 2023, 08:52

Thank you Jyoti! 🙂 I would strongly support the ability to distribute LLM training over multiple Appwrite swarm nodes.

joeyouss
26 Apr, 2023, 08:54

Thanks for the feedback! We will definitely consider it ❤️

Reply

Reply to this thread by joining our Discord

Reply on Discord

Need support?

Join our Discord

Get community support by joining our Discord server.

Join Discord

Get premium support

Join Appwrite Pro and get email support from our team.

Learn more