Skip to content

Rebase o19s/evaluation_lab to opensearch_projects/main #523

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 192 commits into from
Closed

Rebase o19s/evaluation_lab to opensearch_projects/main #523

wants to merge 192 commits into from
+7,670 −17,243

Conversation

fen-qin
Copy link

@fen-qin fen-qin commented Jun 2, 2025

Description

This PR is rebasing feature branch from evaluation_lab to main

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

fen-qin and others added 30 commits March 20, 2025 10:16
@fen-qin
Mockup for new search-relevance experience (opensearch-project#489)
72b85cb 
Signed-off-by: Fen Qin <[email protected]>
@fen-qin
Component to enable search-relevance and opensearch API calls (opense…
4e3be12 
…arch-project#490)

* Add code formatting

Signed-off-by: Fen Qin <[email protected]>

* Add switch to old and new search relevance workbench experience

Signed-off-by: Fen Qin <[email protected]>

* change name conventions for APIs

Signed-off-by: Fen Qin <[email protected]>

* add search-relevance backend router

Signed-off-by: Fen Qin <[email protected]>

---------

Signed-off-by: Fen Qin <[email protected]>
@fen-qin
Add DEVELOPER_GUIDE.md for router setup + fix missing files (opensear…
d2b8810 
…ch-project#493)

* fix missing route service files

Signed-off-by: Fen Qin <[email protected]>

* add DEVELOPER_GUIDE.md for middleware layer router setup for APIs

Signed-off-by: Fen Qin <[email protected]>

---------

Signed-off-by: Fen Qin <[email protected]>
@fen-qin
add get query set by id to router
85a49a3 
Signed-off-by: Fen Qin <[email protected]>
@wrigleyDan
search config list testing
8638501 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
swap Experimentation pages out for Tester page
cb22386 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
fix Tester page errors
5efc408 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
fix brocken API call to list search configs
44c6691 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
add table view for retrieved search configs to tester page
be4a944 
Signed-off-by: wrigleyDan <[email protected]>
@alexeyrodriguez
WIP Query Set Listing
f5f0f8a
@alexeyrodriguez
Add query set size
b9ef369
@alexeyrodriguez
Navigation to basic query set visualization
b645571
@alexeyrodriguez
First stab at Query Set Creation
91ce2c4
@wrigleyDan
search configuration table overview as component in single page app
e57373f 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
integrate search config table in experiment SPA
f12ab5e 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
commit local changes to prepare for query set merge
ffb84f9 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
resolve merge conflicts
bd3fb88 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
add missing route to resolve 404 when retrieving search configs
cf1860c 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
add TODO for table column extension once the backend is ready.
6f73728 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
add frontend component for search config creation.
ea409b1 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
Merge pull request #1 from o19s/search_config_testing
709204f 
Add first frontend components
@wrigleyDan
adding routes, adjusting form to search config inputs
164c275 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
switch from URL parameters to JSON body
2fab513 
Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
rename pairwise experiment occurrences to result list comparison expe…
b8383c6 
…riments

Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
change custom experiment to result list comparison experiment, show s…
879d983 
…ave judgment button only for llm experiment

Signed-off-by: wrigleyDan <[email protected]>
@alexeyrodriguez
First version of visual comparison component.
8c17306 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@alexeyrodriguez
Remove hard coded text
4ad69e9
@wrigleyDan
fill dropdown boxes for query set and search configs with existing ob…
cc46c59 
…jects retrieved from corresponding APIs.

Signed-off-by: wrigleyDan <[email protected]>
@wrigleyDan
add routes for experiments and integrate them into result list compar…
fb3c305 
…ison experiment form

Signed-off-by: wrigleyDan <[email protected]>
@alexeyrodriguez
Merge pull request #2 from o19s/compare-prototype
caae74e 
Visual comparison component to compare two search results.
alexeyrodriguez and others added 27 commits May 27, 2025 16:14
@alexeyrodriguez
Further fixing of customization
d48e2dd 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@fen-qin
search configuration to take whole DSL query instead of queryBody
6133a96 
Signed-off-by: Fen Qin <[email protected]>
@fen-qin
fix selected search pipeline config parsing issue
e45905a 
Signed-off-by: Fen Qin <[email protected]>
@alexeyrodriguez
Further allowing adjusting eyeballing style
6366ea3 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@alexeyrodriguez
Temporary style selection control
185dcb6 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@fen-qin
fix inline search pipeline validation
af1afdb 
Signed-off-by: Fen Qin <[email protected]>
@epugh
Expose hybrid optimizer in the left nav and expose place holder page
ab519b7 
Signed-off-by: Eric Pugh <[email protected]>
@alexeyrodriguez
Merge pull request #49 from o19s/introduce_hybrid_optimizer_ui
90bc17b 
Expose hybrid optimizer in the left nav and expose place holder page
@alexeyrodriguez
Renaming of styles
90c6c19 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@alexeyrodriguez
One more color scheme to evaluate
ec372c8 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@alexeyrodriguez
Details pane is shown on click rather than on hover
95ecdac
@epugh
Use this term pointwise, it is not about the source of the judgements
bb15e43 
Signed-off-by: Eric Pugh <[email protected]>
@epugh
seperate hybrid optimizer into its own form file, event though right …
f620a23 
…today its the same as the pointwise comparison

Signed-off-by: Eric Pugh <[email protected]>
@fen-qin
update experiment type and index name
0312e61 
Signed-off-by: Fen Qin <[email protected]>
@fen-qin
add advanced setting for llm judgment
ee8529c 
Signed-off-by: Fen Qin <[email protected]>
@epugh
Merge pull request #50 from o19s/align_experiment_names
2ce7683 
Use this term pointwise, it is not about the source of the judgements
@epugh
Merge pull request #45 from o19s/tweak_judgement_types
247778c 
Try out different naming
@epugh
Merge pull request #43 from o19s/tagline
dd05014 
Attempt to come up with a tag line
@epugh
Merge branch 'evaluation_lab' into narrow_search_config_listing_page
075808f 
Signed-off-by: Eric Pugh <[email protected]>
@epugh
Merge pull request #44 from o19s/narrow_search_config_listing_page
6131e95 
Feedback was that a small portion of query body isnt useful
@epugh
Merge pull request #40 from o19s/introduce_list_term_for_judgements
a3fba1e 
Lighter touch tweaking of labels for judgment: judgments and judgement lists
@epugh
Merge pull request #46 from o19s/fix_experiment_buttons
fb69604 
Make the run experimient/cancel,back buttons work the same as other screens
@fen-qin
Merge branch 'main' into evaluation_lab
8e20220 
Signed-off-by: Fen Qin <[email protected]>
@fen-qin
add access control via SRW feature flag in cluster settings
6ec6f08 
Signed-off-by: Fen Qin <[email protected]>
@alexeyrodriguez
Make style selection more discrete
528d456 
Signed-off-by: Alexey Rodriguez Yakushev <[email protected]>
@alexeyrodriguez
Merge pull request #48 from o19s/eyeballing-colors
dda2f07 
Easier to parameterize colors and match Venn diagram colors
@fen-qin
fix advanced setting bugs
e024c5e 
Signed-off-by: Fen Qin <[email protected]>
@fen-qin fen-qin closed this Jun 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@macohen macohen Awaiting requested review from macohen macohen will be requested when the pull request is marked ready for review macohen is a code owner

@mingshl mingshl Awaiting requested review from mingshl mingshl will be requested when the pull request is marked ready for review mingshl is a code owner

@msfroh msfroh Awaiting requested review from msfroh msfroh will be requested when the pull request is marked ready for review msfroh is a code owner

@noCharger noCharger Awaiting requested review from noCharger noCharger will be requested when the pull request is marked ready for review noCharger is a code owner

@sejli sejli Awaiting requested review from sejli sejli will be requested when the pull request is marked ready for review sejli is a code owner

@sumukhswamy sumukhswamy Awaiting requested review from sumukhswamy sumukhswamy will be requested when the pull request is marked ready for review sumukhswamy is a code owner

Assignees
No one assigned
Labels
None yet
Projects
Search Project Board
Status: ✅ Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@fen-qin @wrigleyDan @alexeyrodriguez @epugh