google adk with tool calling using gwen3.8-2b-distill

 When we are using the model to perform tool calling it is important to prompt correctly. Let''s see the difference if we were to do it this way 

Prompt #1 

When we using the prompt below and notice the output 


banking_agent = Agent(
    name="account_assistant",
    model=model,
    instruction="You are a helpful customer support agent. Answer questions concisely.",
    tools=[get_user_account_balance],
    before_model_callback=inspect_llm_input
)


Output from prompt1


If i specifiy or prompt the model to specifically "use the tool", the model would call the function.

Prompt #2 

When we change our prompt slight to ask it to use the tool. 

# -------------------------------------------------------------
# 2. CREATE THE ADK AGENT
# -------------------------------------------------------------
banking_agent = Agent(
    name="account_assistant",
    model=model,
    instruction="You are a helpful customer support agent. Answer questions concisely. Use the search tool to find relevant information before answering.",
    tools=[get_user_account_balance],
    before_model_callback=inspect_llm_input
)


Output from prompt 2 



And after reloading my model, even with the same prompt, the result is different. So prompt is more important that you can imagine. 








Comments

Post a Comment

Popular posts from this blog

NodeJS: Error: spawn EINVAL in window for node version 20.20 and 18.20

Encounter this issue when running autorest (that uses nodejs).  I am using node version:  v18.20.2 After i revert to use node v18.12.0, then i was able to get my app to run without this error. Since i am working with Azure devops yaml, i was able to use the following to resolve my issue.  - task : NodeTool@0   inputs :     versionSource : 'spec'     versionSpec : '18.18.0'
Read more

llama cpp running it in google colab

Image
There are 2 options to do this in Google  colab.  Option 1 (Easiest)  With this option, we can just install the relevant package and then run the model.  First we need to install the required packages using the following command:-  ! pip install -U llama-cpp-python Next,  we will try to get the model using the following command # !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained(   repo_id= "unsloth/Qwen3-0.6B-GGUF" ,   filename= "Qwen3-0.6B-IQ4_NL.gguf" , ) We can see the model being downloaded:- And then we will run the following command to test this model llm.create_chat_completion(   messages = [     {       "role" : "user" ,       "content" : "What is the capital of France?"     }   ] ) And the output will look something like this:-  Option 2 llama.cpp is a powerful inference engine and if you wanted to get it running in google colab, you co...
Read more