Releases: comet-ml/opik
Releases · comet-ml/opik
1.7.0
What's Changed
- [NA] Fix typo for attachment endpoint documentation by @BorisTkachenko in #1772
- [OPIK-1327] [FE] [Attachments] Add attachments section to trace sidebar by @andriidudar in #1766
- Update test_docs_links.yml by @AndreiCautisanu in #1774
- Update custom_metric.mdx by @SrBliss in #1767
- [NA] Autogenerated code 08-04-2025 by @BorisTkachenko in #1775
- [OPIK-1082] [FE] Implement sorting for traces table by @andriidudar in #1779
- [NA] Alexkuzmik/agent optimizer by @alexkuzmik in #1778
- [OPIK-1370] add guardrails column in project list table by @awkoy in #1777
- Update docs by @jverre in #1783
- [OPIK-1208]: [SDK] Implement AggregatedMetric by @yaricom in #1738
- Update Readme links by @jverre in #1784
- [OPIK-906] Updates to support clickhouse replications by @liyaka in #1400
Full Changelog: 1.6.14...1.7.0
1.6.14
What's Changed
- [OPIK-803] Update Automation Rules FE to support Python scoring by @andriidudar in #1703
- OPIK-1225: Add feedback scores sorting for find spans by @thiagohora in #1705
- [OPIK-1325] add search to syntaxhighlighter by @awkoy in #1702
- NA: Lazy loading executor strategy by @thiagohora in #1710
- add serviceMonitor template disabled by default by @liyaka in #1709
- [OPIK-1246] [SDK] Stop putting usage into span metadata if metadata was not passed at all by @yaricom in #1708
- Implements ROUGE score with unit tests and documentation by @rohithmsr in #1691
- [NA] Fix import in rouge_scorer by @alexkuzmik in #1717
- NA: Fixing @config serialization problem in AutomationRuleEvaluatorServiceImpl by @ldaugusto in #1720
- Update OpikTracer to log ChatModels span inputs in their native format by @Lothiraldan in #1711
- OPIK-1379: Add installation report by @thiagohora in #1713
- [OPIK-1365] Workflow to update span cost daily by @BorisTkachenko in #1721
- [OPIK-1331] create sdk methods for guardrails creation usage by @alexkuzmik in #1653
- NA: Fix search error message response by @thiagohora in #1724
- OPIK-1119: Add stream experiments by name endpoint by @andrescrz in #1723
- NO-JIRA: Increased Python backend Docker daemon wait by @andrescrz in #1727
- [NA] Fix Span cost update workflow by @BorisTkachenko in #1725
- Update span cost from LiteLLM by @github-actions in #1732
- OPIK-1119: Add stream experiments to OpenAPI spec and code by @andrescrz in #1733
- [OPIK-1354] add span type
guardrail
by @idoberko2 in #1726 - OPIK-1313 - threads test by @NatZol in #1714
- fix servicemonitoring labels by @liyaka in #1735
- [OPIK-666] opik-python-backend generating service metrics by @ldaugusto in #1734
- NO-JIRA: Fix Online Scoring Sampler logs by @andrescrz in #1739
- Add default authorization for LiteLLM Proxy example by @Lothiraldan in #1742
- NO-JIRA: Fix online scoring MDC propagation issue by @thiagohora in #1740
- [OPIK-1401] Add isPublic flag to projects by @BorisTkachenko in #1737
- [OPIK-1391] langchain integration as package by @awkoy in #1715
- [ISSUE-1744] [Bug]: No data state when navigating between traces from the experiment page by @andriidudar in #1745
- [OPIK-1399]: fix feedback scores with dots; by @aadereiko in #1719
- NO-JIRA: Fix Online consumer overflown by @andrescrz in #1749
- Parameterize the standard wait-for-clickhouse initContainer by @CRThaze in #1748
- Update docs by @jverre in #1754
- OPIK-1346 Automated tests for checking the docs for broken links by @AndreiCautisanu in #1707
- Update span cost from LiteLLM by @github-actions in #1755
- [NA] refactors preparing for guardrails by @idoberko2 in #1753
- Bump io.netty:netty-bom from 4.1.118.Final to 4.2.0.Final in /apps/opik-backend by @dependabot in #1756
- [OPIK-1392] add readme Langchain Integration JS by @awkoy in #1759
- [OPIK-1420]: label the build mode for FE images; by @aadereiko in #1761
- [OPIK-1415] User in AppStore by @awkoy in #1760
- [OPIK-1289] Integration with open a is new response api by @alexkuzmik in #1722
- Update evaluate_your_llm.mdx by @SrBliss in #1762
- Add timeout by @jverre in #1765
- [OPIK-866] [SDK] Implement stream-based spans search by @japdubengsub in #1633
- [OPIK-1010] fix
Error while processing scores batch
error in log by @idoberko2 in #1764 - [OPIK-1369] Set a guardrail modal by @awkoy in #1747
- [OPIK-1418] Langchain trace output fix by @awkoy in #1763
- NO-JIRA: Disable python evaluator by @andrescrz in #1771
New Contributors
- @yaricom made their first contribution in #1708
- @rohithmsr made their first contribution in #1691
- @github-actions made their first contribution in #1732
- @NatZol made their first contribution in #1714
Full Changelog: 1.6.13...1.6.14
1.6.13
What's Changed
- [OPIK-1018] add OpenAPI spec for the
projectName
field of Span by @idoberko2 in #1678 - [ISSUE-1677] [FR]: Remember pretty/JSON/YAML preference for experiment item view by @andriidudar in #1681
- [OPIK-1350] double scroll fix by @awkoy in #1682
- [OPIK-1276] replace base64 values inside input/output by @awkoy in #1676
- OPIK-1212: Add sorting for experiments by @thiagohora in #1684
- Updated changelog by @jverre in #1693
- [OPIK-729] Delete attachments by @BorisTkachenko in #1667
- Update with async instructions for evaluate function by @jverre in #1689
- Pydantic AI docs by @jverre in #1621
- Refresh model cost from LiteLLM by @Lothiraldan in #1679
- Bump org.jdbi:jdbi3-stringtemplate4 from 3.48.0 to 3.49.0 in /apps/opik-backend by @dependabot in #1694
- NO-OPIK add timeouts to installation tests and update step names by @AndreiCautisanu in #1696
- NO-JIRA: Fixing Python Evaluator URI and service by @andrescrz in #1697
- feat(python-sdk): use jinja2 prompt types by @klcd in #1618
- [OPIK-1240] Extending Python Online Eval for docker or process spawning by @ldaugusto in #1680
- OPIK-1130: Add Otel resource to Open API by @andrescrz in #1698
- [OPIK-1240] Bringing in modifications from OPIK-1697 by @ldaugusto in #1699
- NA: Changing python backend default to processes by @ldaugusto in #1700
- OPIK-1225: Implement sorting for feedback score by @thiagohora in #1690
- docs: Added README in JP, CN and KO by @vincentkoc in #1701
- [OPIK-1239] Adding flags disabling Online Scoring Python metrics by @ldaugusto in #1686
- [OPIK-1277]: price retention banner init; by @aadereiko in #1683
- OPIK-1225: Implement sorting for feedback scores on find traces endpoint by @thiagohora in #1692
- NA: Fix sorting serialization by @thiagohora in #1704
New Contributors
Full Changelog: 1.6.12...1.6.13
1.6.12
What's Changed
- [OPIK-1220] Langchain Javascript integration by @awkoy in #1668
- [NA]: sashaa/add type sdk by @aadereiko in #1675
Full Changelog: 1.6.11...1.6.12
1.6.11
What's Changed
- Update cost_tracking.mdx by @SrBliss in #1659
- Jacques/seo opt by @jverre in #1652
- NA: Fix fat jar manifest definition to allow the use of virtual threads by @thiagohora in #1654
- bugfix: opik cookbook notebook
instructor
by @fschlz in #1657 - add demo-data-generatior job and probes for backend services by @liyaka in #1651
- NA: Adjust health check by @thiagohora in #1661
- NA: Change log level for demo data http call logs by @thiagohora in #1663
- NA: removing duplication logging in python-backend by @ldaugusto in #1666
- OPIK-1267 quickstart guide tests by @AndreiCautisanu in #1642
- Self deployment doc updates by @gidim in #1669
- [OPIK-728] Attachment download and list endpoints by @BorisTkachenko in #1629
- chore: Update CODEOWNERS by @vincentkoc in #1672
- OPIK-1130: Fix AutomationRuleEvaluator Fern by @andrescrz in #1670
- NA: Replicate performance change to traces by @thiagohora in #1662
- [ISSUE-1660] [FR]: Render markdown in experiment output by @andriidudar in #1673
- NO-JIRA: Upgrade Frontend Docker base build image by @andrescrz in #1674
- [OPIK-1018] get span by id should return project name by @idoberko2 in #1664
- NO-OPIK update installation according to updated readmes and docs by @AndreiCautisanu in #1665
New Contributors
- @fschlz made their first contribution in #1657
- @vincentkoc made their first contribution in #1672
Full Changelog: 1.6.10...1.6.11
1.6.10
What's Changed
- Fix issue with parsing log_probs by @jverre in #1640
- OPIK-1130: Exclude Otel resource from Open API spec by @andrescrz in #1643
- SEO updates by @jverre in #1647
- [OPIK-1278] [customer request #1552] Count spans per trace when querying traces list for display in UI by @amirzatcomet in #1565
- [OPIK-1234] OpenTelemetry integration shouldn't drop attributes by default by @ldaugusto in #1644
- [OPIK-1336]: expand button change the behavior; by @aadereiko in #1649
- [OPIK-1340] Sidebar with deleted dataset item information opens after deletion by @andriidudar in #1648
- [OPIK-1329] [GItHub] #1624 Add search functionality for span tree by @andriidudar in #1646
- OPIK-1130: Update Open API spec and SDKs code by @andrescrz in #1645
- OPIK-1263: Change readme and final adjustments by @thiagohora in #1650
- [OPIK-815] Preallocation Python containers for Online Eval by @ldaugusto in #1612
- Update Readme startup instructions by @Nimrod007 in #1655
- Doc updates by @jverre in #1656
Full Changelog: 1.6.9...1.6.10
1.6.9
What's Changed
- [OPIK-727] Implement attachment feature for OS installations by @BorisTkachenko in #1588
- OPIK-1263: Add script to show user friendly message on start by @thiagohora in #1589
- Update FAQ by @jverre in #1605
- Jacques/oss docs by @jverre in #1606
- Small fixes to the quickstart by @Lothiraldan in #1608
- Andrei/opik 1233/fixes for install tests by @AndreiCautisanu in #1601
- [OPIK-1255] Improve expand/collapse discoverability of side menu by @andriidudar in #1609
- OPIK-1260: Add trigger to create demo data by @thiagohora in #1603
- Jacques/mcp docs by @jverre in #1613
- Jacques/agent optimization by @jverre in #1614
- Update SEO by @jverre in #1615
- Jacques/seo improvements by @jverre in #1616
- update initContainer for opik-backend by @liyaka in #1585
- Changelog update by @jverre in #1619
- update docs with snippet for external clickhouse configuration by @liyaka in #1622
- OPIK-664: Add Python code evaluator integration by @andrescrz in #1611
- OPIK-1263: Add ps1 file to start opik by @thiagohora in #1604
- [OPIK-1258] add minio to default helm configuration by @liyaka in #1625
- OPIK-1260: Fix health check by @thiagohora in #1626
- [OPIK-1288] [FE] Placeholder investigation: table performance degradation by @andriidudar in #1623
- [OPIK-1181] Optional - usage limit enforcement by @idoberko2 in #1592
- fix opik-python-backend build by @liyaka in #1631
- [OPIK-1287] Update getWorkspaceName endpoint by @BorisTkachenko in #1634
- NO-JIRA: Fix images path in Python backend by @andrescrz in #1630
- [NA] Add report for sdk tests by @liyaka in #1627
- [NA] Fix naming mismatch between Opik backend and remote auth service by @idoberko2 in #1638
- OPIK-1260: Remove demo data from daily report by @thiagohora in #1639
Full Changelog: 1.6.8...1.6.9
1.6.8
What's Changed
- [NA] Bump gh-action-pypi-publish version from 1.9.0 to 1.12.4 by @alexkuzmik in #1600
- Bump version to 1.6.8 by @andriidudar in #1602
Full Changelog: 1.6.7...1.6.8
1.6.7
What's Changed
- [OPIK-1266]: change the logic of a default workspace when changing an organization; by @aadereiko in #1580
- [OPIK-1061] [FE] Add support for
is_empty
in the feedback scores by @andriidudar in #1581 - [OPIK-974] Make table rows clickable while allowing for text selection by @andriidudar in #1583
- NA: Remove deprecated endpoint by @thiagohora in #1575
- [OPIK-1039] chart animation improvements by @awkoy in #1584
- OPIK-1215: Remove duplicated code from test by @thiagohora in #1557
- [OPIK-1160] radar chart refactoring by @awkoy in #1586
- [OPIK-1275] Gemini provider config by @andriidudar in #1594
- OPIK-1233 installation tests by @AndreiCautisanu in #1555
- [NA] removed no longer supported
gemini-1.0-pro
model by @idoberko2 in #1593 - [OPIK-1160] fix legend hover for radar chart by @awkoy in #1595
- OPIK-1215: Add traces search endpoint by @thiagohora in #1563
- [NA] Alexkuzmik/fix dspy tests by @alexkuzmik in #1599
- [NA] Fix update of original metadata dict when usage is logged by @alexkuzmik in #1579
- [OPIK-1237] Add new experiment Config env update by @awkoy in #1597
Full Changelog: 1.6.6...1.6.7
1.6.6
What's Changed
- OPIK-1238: Improve create individual span performance by @andrescrz in #1542
- [OPIK-726] Upload attachment endpoints implementation by @BorisTkachenko in #1536
- [Opik 1237] [Bug] Fix getting started issue with os import for injected code by @amirzatcomet in #1529
- Update cost example by @jverre in #1534
- Update changelog by @jverre in #1546
- add imagePullSecrets to clickhouse configuration by @liyaka in #1543
- Fix links by @jverre in #1550
- Bump software.amazon.awssdk:bom from 2.30.21 to 2.31.1 in /apps/opik-backend by @dependabot in #1547
- Bump opentelmetry.version from 2.13.0 to 2.14.0 in /apps/opik-backend by @dependabot in #1548
- OPIK 1171 Demo data test by @AndreiCautisanu in #1538
- [OPIK-654] New build flow - faster main builds by @liyaka in #1545
- [OPIK-1226] fix feedback scores
is_empty
filter by @idoberko2 in #1544 - [OPIK-1266]: use workspaces instead of getTeams; by @aadereiko in #1558
- [OPIK-1159] [FR][FE]: Freeze table header during data scroll by @andriidudar in #1549
- [OPIK-1021] add padding for feedback score cell by @awkoy in #1562
- [OPIK-1249] add support for anthropic usage logging in langchain integration by @alexkuzmik in #1556
- [NA] Autogenerated code 18-03-2025 by @BorisTkachenko in #1564
- [OPIK-1252] [FE] No bottom border on pinned columns by @andriidudar in #1559
- [OPIK-1266]: fix the bug with the workspaces where a user is not an admin; by @aadereiko in #1566
- Update README.md by @Lothiraldan in #1569
- [NA] url_helpers ensure base urls have ending slash by @alexkuzmik in #1570
- [NA] Revert Autogenerated code 18-03-2025 by @BorisTkachenko in #1578
- [OPIK-1160] radar and bar chart for experiments compare page by @awkoy in #1560
New Contributors
- @amirzatcomet made their first contribution in #1529
Full Changelog: 1.6.5...1.6.6