Today, I’m excited to share and discuss some big news from OpenAI! As I mentioned before, I’m a huge fan of GPT-4 because of its ability to write solid code snippets. When I hear the word “turbo” I think of fast. But there’s more to this update than just speed. Let’s explore.
128K context window and knowledge of world events up to April 2023.
What’s this mean in English?
Well, the context window describes the model’s ability to remember what you talked about earlier in the conversation. For comparison, regular GPT-4’s context window is 8,192. So this model offers an astounding 14x as much “memory” which will make interactions much more meaningful.
For example, if I was using the AI to write a “choose your own adventure” style interactive story, then it would be able to remember and refer to something that happened at the very beginning of the story without having to be reminded of those details.
With a smaller context window, the ai will begin to “forget” older details to make room for new ones.
Knowledge of world events is really helpful when your interaction with the AI is based on current events. It can certainly diminish the quality of responses when the AI is operating as if it’s 2021.
This could relate to anything from technology, to geopolitical conflicts, to healthcare. The world moves fast and to keep the AI models relevant, their training needs to keep up.
Reduced pricing
I don’t need to translate this one out of nerd-speak for you. This means more bang for the buck!
Improved function calling
This is one for the software development geeks like me. When I’m developing an app, sometimes I need information to be processed in a predictable way. This helps with that.
Model outputs are more deterministic
Another feature that software devs will care about. Again, this is a way to produce more predictable results. When interacting with AI, we aim to get just the right mix of predictable (aka deterministic) responses and randomness.
In summary
These innovations are going to improve the quality of the ai-powered apps we’re building here at aisweetlife! Greater context, higher quality responses, and reduced cost. What’s not to love!? ❤️