Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I'm unsure how to run a model that needs inputs #39

Closed
JonahElbaz opened this issue Apr 26, 2024 · 2 comments
Closed

I'm unsure how to run a model that needs inputs #39

JonahElbaz opened this issue Apr 26, 2024 · 2 comments
Assignees
Labels
question Further information is requested stale

Comments

@JonahElbaz
Copy link

   const ragApplication = await new RAGApplicationBuilder()
      .setModel(new HuggingFace({ modelName: 'timpal0l/mdeberta-v3-base-squad2'}))
      .setQueryTemplate('')
      .setVectorDb(new PineconeDb({
        projectName: 'test',
        namespace: 'dev',
        indexSpec: {
          serverless: {
            cloud: 'aws',
            region: 'us-east-1',
          },
        },
      }))
      .setCache(new LmdbCache({ path: path.resolve('./cache') }))
      .setTemperature(0.01) // closer to 1 = more creative. Closer to 0 = more deterministic
      .setSearchResultCount(100) // hwow much to get from the db
      .build();

    const query = await ragApplication.query('What is Tesla?');

Given this model and many other models on HuggingFace the output error is

Error: Error in `inputs`: value is not a valid dict
    at request 

While I can see the error is from Hugging Face, it's unclear how I would provide the correct inputs in a case like this.

Any help is greatly appreciated!

@adhityan adhityan added the question Further information is requested label May 11, 2024
Copy link

This issue is stale because it has been open for 14 days with no activity.

@github-actions github-actions bot added the stale label Nov 23, 2024
Copy link

This issue was closed because it has been inactive for 30 days since being marked as stale.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested stale
Projects
None yet
Development

No branches or pull requests

2 participants