together-ai

A cloud platform offering tools for building, fine-tuning, and deploying generative AI models with enhanced performance and cost efficiency.

Together AI

In this video I'm going to be showing you Together AI, which is a cloud platform for both building and running both large language models and then generative AI models as a whole. So the platform really has a focus on open-source models and it's really designed to enable developers to create and customize AI models where you can offer scalable compute at largely lower prices than a lot of other vendors offering a similar type of product. 

So once you sign up for an account on Together AI, you should be able to get $25 worth of free credits. At least I did at the time of recording. You'll be able to go in and see this interface like I have on screen here, and then you can just go ahead and get started. So uh

This week they were very quick with implementing the mixl 8X 7B instruct model. You can go ahead and try it here. So if I just say hello world, you can see that it is very quick for inference. 

Now the one thing that I really like about their playground is they do have this nice little code button where you just can just go ahead select this, select your coding language, and then boom you're off to the races. 

So it has the model, it has everything set up. Even if you typed something in as an example, it will have the prompt there and the uh type of uh format that you need for everything. 

So really nice, really easy to get up and running. And the other thing that's nice with this is while there are a ton of

Text models there are also other models. So if you're interested in image generation that's built in here coding models that's built in here as well. 

And the other thing to note is if you actually go ahead and fine-tune a model here and then you turn it on for inference you'll be able to see it at the top here and similarly be able to play around with it grab the code and get up and running really really quickly. 

So it's a really great platform and the thing that really stands out to me on the platform is how easy it is to fine-tune a model. So if you just go over here and click get started under the fine-tuning tab it is incredibly simple. 

So within about five or six steps you'll be able to go ahead.

And get fine-tuning your own model. So essentially you just go through these steps. So you make just make sure Python's up to date and everything. Install the together Library. Get your API key from the platform. Prepare your data. You can go ahead and upload your data. 

Then once it is uploaded, you can go ahead and select the model from this list here. So it's not all the models that they have that you can fine-tune, um, off of at least for now. So you can select the model that you'd like from this list. 

And then you can just create your CLI command from the model that you're going to be using. And then you can also include the weights and biases API key, which is optional. So if you just follow these.

Steps I was able to just run through these five or six steps here and it started to fine-tune a model within a couple minutes. 

In terms of the cost of actually fine-tuning a model, I'll just give you an example. So I used the example data set that they provided here from Hugging Face. So it's just a simple joke data set. I'll just show you it here. So it's the unified joke explanations data set. 

What I did here is I actually copied this whole JSON L file and I put it within a llama token counter, which I'll include in the description of the video as well as all these links that I'm showing you here if you're interested in exploring any of this further. 

So from there it gave me it was this many.

Tokens and I all I did was I put it within the together AI pricing calculator here with the model that I used to F tune and it was accurate and it was exactly $5. So when I went in and fine-tuned it came out and it deducted from my $25 balance it dropped uh exactly to 20 with when I use this as basically one of the first things that I tried on their platform. 

So really simple to get up and running. Now once you have it all uh fine-tuned and your your your job is complete you can just go into this model models tab here and you'll see all your models that you fine-tuned here. So you can just go ahead and select the model and then if you want to turn it on for inference you can just go ahead and click.

This play button you'll see the hardware that is going to be running on. And then you also see the coast the the the cost per hour rather for hosting. So you click that and it will just start uh taking away from your balance right away essentially. So it's really really simple to get up and running uh for deploying models. 

So there's also all the different pricing for all the different models here. There is the option if you are interested in having a dedicated instance that is also available too. But overall a really nice clean polished uh product that you can go around and play around with a ton within the platform. You can get a little bit more comfortable with fine-tuning a model potentially if.

That's it. Hasn't been something that you've done before. A really good jumping off point for all of that type of stuff. 

So that's it for this video. I just wanted to bring this to your attention. I think it's great what they're doing over at Together AI. But otherwise, if you found this video useful, please share AI Agent Store with colleagues. 

And until the next one.

Note, that there may be slight differences in text and video. Watch video for the original content.

Together AI Video