You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- enhance the system prompt with more detailed guidelines for Playwright usage
- add sections on handling popups and missing fields, and tool usage specifics
- improve clarity on variable handling and focus on executing targeted actions
Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.
This PR includes no changesets
When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types
Hey @feder-cr, thanks for doing this! Do you have any examples of where this prompt performed better than the existing one? Would love to add to our eval set :)
@kamath Tested with DeepSeek and GPT-Mini for application across various job search middleware, but this happens because, also for other kind of sites, less powerful models with the current prompt struggle to assess which sections to skip without having to copy anything.
Thanks for taking the time to do this!! I think it should be addressed in #373 though; lmk if this doesn't address your needs :) happy to re-open if so
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
why
many times models like the gpt-4o-mini fail to generate skipSection action, with this prrompt this almost never happens.