Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test cleanup: Remove or unit-ify redundant/outdated e2e tests #39003

Open
wants to merge 16 commits into
base: main
Choose a base branch
from
Open

Test cleanup: Remove or unit-ify redundant/outdated e2e tests #39003

wants to merge 16 commits into from

Conversation

MilesHolland
Copy link
Member

The introduction of the mass evaluator tests made a lot of older tests redundant. This PR accomplishes 3 things (eventually):

  • Finish the saga of mass evaluator testing by accounting for new multimodal evaluators in the mass multimodal test.
  • Remove evaluation tests made redundant by the mass evaluators.
  • Move various tests from e2etests/test_evaluate.py to unit tests where applicable.

@MilesHolland MilesHolland requested a review from a team as a code owner December 30, 2024 19:54
@github-actions github-actions bot added the Evaluation Issues related to the client library for Azure AI Evaluation label Dec 30, 2024
@MilesHolland MilesHolland changed the title Eval/testing/dec24/remove dup tests Test cleanup: Remove or unit-ify redundant/outdated e2e tests Dec 30, 2024
@azure-sdk
Copy link
Collaborator

API change check

API changes are not detected in this pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Evaluation Issues related to the client library for Azure AI Evaluation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@MilesHolland @azure-sdk