Vercel Can Ask a Second AI When the First Is Unsure

An app can ask AI to make a choice. Sometimes the first AI model gives an answer but is not very sure. Vercel's AI Gateway can now send that decision to a second model. The second model is a backup that makes the decision again. The new feature is available for testing.

The team using the tool decides when to ask the second model. It can set a rule based on how sure the first model is. For example, a choice can have a rule with a limit of 0.6. An answer below that level can make the backup model run. Teams can also use more than one rule together.

Some questions ask the model to choose an option or give a score. Other questions ask it to answer yes or no. For yes or no, the rule checks a range of chances instead. The older backup rules still work when a model fails to answer. The new rules are for answers that come back but need another attempt.

The article gives examples from working with files and text on screens. A tool might decide which columns in a file belong together. It might also mark words on a screen for translation review. When the second model runs, the service charges for both decisions. Teams can leave the new rule out if they want the old behaviour.