Petals

Collaborate with others to run large language models like BLOOM-176B seamlessly with our open-source tool. Easily load a portion of the model and work with teammates to fine-tune or conduct inference tasks efficiently. This tool makes it effortless to scale your language models and achieve desired outcomes efficiently.