v1.4.2

What's new

• Update base version to 1.4.2 0c59576 @CometActions
• [OPIK-753] [FE] Autocomplete component for variable key select (#1067) 5268758 @andriidudar
• Implemented BLEU score, wrote unit tests and documentation for it. (#1006) e835dfd @kadamrahul18
• [OPIK-770] Fix haystack integration (#1070) 79501b1 @alexkuzmik
• Disable printing messages content (#1071) abffddd @alexkuzmik

New contributors

Special thanks to @kadamrahul18, our new external contributor, for implementing SentenceBLEU and CorpusBLEU metrics for our metrics library!

v1.4.1

• Increment patch version (#1059) 720a0c3 @ferc
• [OPIK-781] Fix project not found illegal state (#1053) 395f686 @BorisTkachenko
• Jacques/fix code snippets (#1061) 6f0fed4 @jverre
• OPIK-802: add an option to use external clickhouse (#1065) 07cf99a @liyaka
• Contribution guide (#1062) 17b6cb6 @alexkuzmik
• [OPIK-706] simplify home page (#1063) fd48d17 @awkoy
• Temporary disable litellm import warnings (#1068) 40dc733 @alexkuzmik
• [OPIK-809] sdk sentry track decorator extract inputs may fail (#1069) 133b8a6 @alexkuzmik

1.4.0

• [OPIK-799] Can't add trace to dataset (#1056) 13d4327 @andriidudar
• Increment minor version (#1057) 42a6b30 @ferc

1.3.6

What's Changed

• [OPIK-611] support gemini models in playground by @idoberko2 in #987
• Updated changelog by @jverre in #1036
• [OPIK-702] [Docs] Crew AI integration docs by @japdubengsub in #1037
• [OPIK-743] Fix properties naming strategy by @thiagohora in #1035
• [OPIK-595]: Add Redis Caching part 1 by @thiagohora in #1015
• Update g_eval.md by @jverre in #1039
• Jacques/evaluate prompt by @jverre in #1023
• [OPIK-594] Triggering LLM calls to score after Traces are received by @ldaugusto in #1038
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1046
• OPIK-775 [FE] Add ability to edit dataset description from UI by @andriidudar in #1049
• Update docs by @jverre in #1048
• [OPIK-595] Automation rule evaluator cache by @thiagohora in #1042
• [OPIK-695] sdk sentry integration by @alexkuzmik in #1045
• [OPIK-718] quickstart page integrations update by @awkoy in #1034
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1051
• [OPIK-721] Return more detailed error message for Json deserialization errors by @BorisTkachenko in #1040
• [NA] Add misconfiguration check to Opik.init by @alexkuzmik in #1052
• [OPIK-751] Use Mustache for online scoring by @thiagohora in #1043

Full Changelog: 1.3.5...1.3.6

1.3.5

What's Changed

• Dspy integration docs by @jverre in #1005
• [OPIK-593] OnlineScoring sampling and preparing traces for Automation Rules by @ldaugusto in #1002
• [OPIK-737] redirect to project page after successful creation by @awkoy in #1012
• OPIK-653: Add integration with CrewAI by @japdubengsub in #988
• OPIK-364 feedback definitions crud tests by @AndreiCautisanu in #1013
• [OPIK-655]: finish initial dataset UI by @aadereiko in #1016
• [OPIK-735] Online Scoring: null projectId error when creating a rule by @ldaugusto in #1011
• NO-OPIK automation fixes by @AndreiCautisanu in #1017
• [OPIK-622] Remove deprecated dataset item fields by @BorisTkachenko in #1003
• [OPIK-655]: dataset playground fixes by @aadereiko in #1019
• [OPIK-655]: add truncate; by @aadereiko in #1020
• [OPIK-148] Implement batching for feedback scores, update and add new tests by @alexkuzmik in #1008
• Updated changelog by @jverre in #1024
• Bump org.redisson:redisson from 3.41.0 to 3.42.0 in /apps/opik-backend by @dependabot in #1025
• Bump com.diffplug.spotless:spotless-maven-plugin from 2.43.0 to 2.44.1 in /apps/opik-backend by @dependabot in #1026
• NA: Upgrade dependencies by @thiagohora in #1018
• Update the demo project by @robertlacok in #980
• [OPIK-655]: fix the dataset number; by @aadereiko in #1027
• [OPIK-719] add get-started page, update quickstart page by @awkoy in #1021
• [OPIK-736] Fix deserialization issue by @thiagohora in #1022
• [OPIK-739]: hide unsupported by ai proxy models; by @aadereiko in #1028
• [OPIK-720] Manually set span cost by @BorisTkachenko in #1014
• [OPIK-740]: handle adding provider by @aadereiko in #1031
• [NA] Autogenerated code by @BorisTkachenko in #1030
• [OPIK-742]: open an error tooltip for a disabled run button; by @aadereiko in #1032

New Contributors

• @awkoy made their first contribution in #1012

Full Changelog: 1.3.4...1.3.5

1.3.4

What's Changed

• [OPIK-558] Adapt Fern for TypeScript SDK by @ferc in #972
• [OPIK-679] fix feedback scores tests by @idoberko2 in #970
• Fix llamaIndex docs by @jverre in #974
• Bump org.redisson:redisson from 3.40.1 to 3.41.0 in /apps/opik-backend by @dependabot in #965
• OPIK-645 Return all feedback score names for project ids endpoint by @BorisTkachenko in #947
• [OPIK-558] Typescript SDK - basic client by @ferc in #919
• OPIK-672 [SDK] Fix cyclic reference/recursion issue in json_encoder by @japdubengsub in #964
• [OPIK-647] Return 409 instead of throwing exception for workspaceId or project mismatch by @BorisTkachenko in #977
• [OPIK-590] Online Scoring Automation Rules endpoints by @ldaugusto in #945
• Update to Opik roadmap by @jverre in #981
• [Docs]: Update quickstart.mdx by @connectwithprakash in #986
• [OPIK-709] fix NPE in find projects by @idoberko2 in #984
• [NA] apply spotless by @idoberko2 in #985
• [NA] Fix test visibility by @thiagohora in #989
• [OPIK-580] StreamExperimentItems endpoint return full content for experiment items by @BorisTkachenko in #973
• [OPIK-610] multi models support and anthropic implementation by @idoberko2 in #957
• NO-JIRA: Remove docker-compose.yaml port binding by @andrescrz in #991
• Automated testing for codeblocks in docs by @jverre in #992
• Update github actions by @jverre in #993
• NO-JIRA: Add OpenAPI server script by @andrescrz in #995
• [NA] apply spotless by @idoberko2 in #994
• edit prompt button name by @AndreiCautisanu in #998
• NO-JIRA: Add Spotless backend formatting workflow by @andrescrz in #999
• [OPIK-717] Fix click into a span in the tree-viewer in Safari by @ferc in #1001
• Add py.typed to package data by @alexkuzmik in #997
• NO-JIRA: Update locking service logs by @andrescrz in #1004

New Contributors

• @ldaugusto made their first contribution in #945
• @connectwithprakash made their first contribution in #986

Full Changelog: 1.3.3...1.3.4

1.3.3

What's Changed

• Added support for llms.txt by @jverre in #968
• Fix traces/spans aggregations for feedback scores by @ferc in #969

Full Changelog: 1.3.2...1.3.3

1.3.2

What's Changed

• OPIK-651 Log usage information for LlamaIndex by @japdubengsub in #959
• [OPIK-673] implement OPIK_TRACK_DISABLE configuration by @alexkuzmik in #962

Full Changelog: 1.3.1...1.3.2

1.3.1

What's Changed

• [OPIK-624] [FE] Add duration chart to Metrics tab (#929) 179d90d @andriidudar
• Update Dify Chatbot id (#930) 403dfdb @Lothiraldan
• OPIK-626 Add metadata and change_description to prompt_version (#928) f83916d @BorisTkachenko
• OPIK-626 PromptVersion new fields documentation and SDK (#931) 5906283 @BorisTkachenko
• [OPIK-579] [FR]: add output formats as it own fields for prompts (#932) d2aa0d9 @andriidudar
• OPIK-567 Basic Prompts CRUD tests (#925) 68cc522 @AndreiCautisanu
• [OPIK-579] Change component to present metadata (#933) 6070d73 @andriidudar
• Opik 640 sdk improve ux in evaluate function when provider rate limit exceeded (#923) ad165a6 @alexkuzmik
• Added .gitattributes (#935) 0945990 @jverre
• Fix typo (#937) 9ca2b89 @jverre
• [OPIK-619]: playground fe cache (#936) 0500603 @aadereiko
• [OPIK-633] sdk add support for metadata field in prompt version resource (#934) 7d44dfa @alexkuzmik
• OPIK-639 Add cost support for new OpenAI models 2024-12-18 (#942) fe65e5a @BorisTkachenko
• [OPIK-616] Add fields to LLM Provider Api Key endpoints (#939) 7cae567 @BorisTkachenko
• Update readme (#946) fbc0a5f @jverre
• Update uuid7 generation package (#944) 580d962 @alexkuzmik
• LLM gateway documentation (#948) f07111a @jverre
• • docs: update log_traces.mdx (#950) a1e45ad @eltociear
• Documentation update (#952) 658f03c @jverre
• [OPIK-287] Add project level aggregations (#894) d43c18f @thiagohora
• OPIK-556: Add embedded python service POC (#955) f8d6678 @andrescrz
• [OPIK-641] create guardrails integration (#954) af3dbcf @alexkuzmik
• NO-JIRA: Fix redis URL configuration (#958) f3b278a @andrescrz
• OPIK-615 [SDK] DSPY integration (#940) 7537149 @japdubengsub

Full Changelog: 1.3.0...1.3.1

1.3.0

What's Changed

• Add missing workflow, fix typo in requirements format (#908) 5bc9b3d @alexkuzmik
• Docs for Agent tracing (#909) d04d57b @jverre
• [OPIK-578] [FR]: Prompt diff (#912) be33b93 @andriidudar
• [OPIK-571] error tracking sdk add e 2 e tests for traces spans with errors (#907) 7251935 @alexkuzmik
• Fix homepage formating (#910) 8f12090 @jverre
• Added haystack dependency for Python referece docs (#911) 9d042a9 @jverre
• [OPIK-635] [Experiments page] After deleting all experiments page shows empty state message for few seconds (#915) b3e9276 @andriidudar
• [OPIK-446] Add duration to trace and span (#883) a012ea6 @thiagohora
• [OPIK-446] remove materialized column (#916) 4c686d7 @idoberko2
• Update tip (#917) 1745782 @alexkuzmik
• [OPIK-627] Delete LLM Provider Api key endpoint (#913) 16a3403 @BorisTkachenko
• OPIK-627 Delete LLM Provider Api key endpoint documentation and SDK code (#918) c5d11ee @BorisTkachenko
• [OPIK-446] Add duration metric (#889) 7286f28 @thiagohora
• [OPIK-605] [SDK] Add track parameter to LLM metrics and make evaluate function create both trace and spans (#900) 363a7b8 @japdubengsub
• [OPIK-623] [FE] Add duration column to Traces/LLM Calls tables (#922) cb7c326 @andriidudar
• Updated max body size for docker deployments (#924) 3f42cb6 @jverre
• [OPIK-539]: add a config tab and proxy; (#921) def0955 @aadereiko
• Update minor version to 1.3.0 (#926) 2fc94d3 @ferc

Full Changelog: 1.2.8...1.3.0