AWS Bedrock configuring intelligent prompt router

We want to use bedrock intelligent prompt routing because we can send prompts to different foundational models within a model family, helping you optimize for quality of responses and cost.

To do that,  goto "Prompt routing model". 

Depending on the region, we are limited to AWS Nova and Llama. 

Provide a name for your prompt router and then select relevant models. These are the list of models that your requested gets routed to. In this scenario, we are routing to Llama.

 

We also need to select a default route model, that will handle all responses if it is unable to determine where to route prompts to. 

Click "Submt" when ready

You can test it out by, click on "Action" ->  Open in playground

If you want to access from "playground", you can do the following. Goto Playground -> Select Router under Categories. Then select your newly created routers.