Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to run Exclude-Embed models #1163

Open
balachandarsv opened this issue Dec 24, 2024 · 0 comments
Open

Not able to run Exclude-Embed models #1163

balachandarsv opened this issue Dec 24, 2024 · 0 comments
Labels

Comments

@balachandarsv
Copy link

Describe the bug
I have taken a model which is supported by this library, and have removed the embeddings from the model using exclude-embeds option in builder.py. Now when i try to run the model, it is still asking for input_ids instead of input_embeds.

To Reproduce
Steps to reproduce the behavior:
Qwen/Qwen2.5-0.5 model converted by giving exclude-embeds option and run inference in java.

Image

Desktop (please complete the following information):

  • OS: Mac M3

Can someone share idea on how to make this work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant