Skip to content

Using batched generate in sentiment scripts - #249

Merged
younesbelkada merged 1 commit into
huggingface:mainfrom
GauravVirmani:batch-gen-example
Mar 27, 2023
Merged

younesbelkada merged 1 commit into
huggingface:mainfrom
GauravVirmani:batch-gen-example

Conversation

@GauravVirmani

Copy link
Copy Markdown
Contributor

What does this PR do?

Fixes #246

Using batched generate in all the 3 sentiment tuning example scripts: gpt2-sentiment.py, gpt2-sentiment_peft.py and t5-sentiment.py

cc @lvwerra @younesbelkada

@HuggingFaceDocBuilderDev

HuggingFaceDocBuilderDev commented Mar 24, 2023 •

Copy link
Copy Markdown

The documentation is not available anymore as the PR was closed or merged.

@younesbelkada younesbelkada left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work!
I can confirm all the scripts work fine:

Thanks a lot for this amazing contribution 🔥

@younesbelkada
younesbelkada merged commit b5cce0d into huggingface:main Mar 27, 2023
@GauravVirmani
GauravVirmani deleted the batch-gen-example branch March 28, 2023 07:01
yxliu-TAMU pushed a commit to mincheolseong/ECEN743-GRPO-Project-Proposal that referenced this pull request Apr 20, 2025
Co-authored-by: gaurav.vi <gaurav.vi@media.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

why not use bacth for model generate

3 participants