Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable Implement for Vertex LLM #13

Open
stfines-clgx opened this issue Oct 24, 2024 · 2 comments
Open

Unable Implement for Vertex LLM #13

stfines-clgx opened this issue Oct 24, 2024 · 2 comments

Comments

@stfines-clgx
Copy link

So I attempted this with VertexAI using Gemini as the LLM - I verified that it is a function calling LLM and it crashes when it hits this line:
tool_calls = llm.get_tool_calls_from_response( response, error_on_no_tool_call=False )
in the orchestrator() method - it seems that Vertex assumes that the tool_call will be a protocol buffer of some sort:
AttributeError: 'FunctionCall' object has no attribute '_pb'

(the offending code in the vertex source:
for tool_call in tool_calls: response_dict = MessageToDict(tool_call._pb) if "args" not in response_dict or "name" not in response_dict: raise ValueError("Invalid tool call.") argument_dict = response_dict["args"] [...]

What is being accomplished by turning the TransferToAgent message into a Tool? And can it be accomplished in some other way? I've had plenty of luck in invoking non-Function tools with gemini - it is only this function call one that seems to be giving me trouble.

@logan-markewich
Copy link
Contributor

Seems like an issue with vertex -- possibly the generative-ai package updated and broke some underlying code. It would need a PR to fix

This function is just trying to parse the tool calls out of the llm response

@noabenefraim
Copy link

noabenefraim commented Nov 13, 2024

Same issue here.
Is there a workaround?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants