đŸŽ„ Free on-demand webinar "How to use LLM-as-a-judge to evaluate LLM systems." Get your access
Community

Evidently Community Call #2 Recap: custom text comments, color schemes and a library of statistical tests

May 24, 2022

In April, we held the second call with the Evidently Community to give a tour of the recent feature updates in our open-source ML monitoring tool. As Evidently itself is built for community and with the community, connecting with users is our primary inspiration source. Thanks to everyone for joining!

And in case you missed it, below is a recap of what we covered.

More customization features: text comments and color schemes

We introduced the new customization options available in Evidently 0.1.47 and above:

Custom color schemes

With this feature, you can add some color to the Evidently Dashboards. You can change the default red and gray colors used for the two datasets and customize the palette for all the smaller details that appear in other widgets. The feature is handy if you want the dashboards to suit your corporate color guidelines or just feel creative!

Here is an example and a pro tip by Alex Strick van Linschoten: you can use tools like Color Hunt to find a matching combination.

Evidently custom color scheme
Source: the latest blog by Alex "How to trust the data you feed your model: alternative data validation solutions in a computer vision context (part 3)"

Custom text comments

‍Now you can also create text annotations in Dashboards, and include them like a custom widget. Add notes, leave comments or describe report results to share thoughts and discuss issues with other members of your team.

More statistical tests to detect and target data drift

You are reading a blog about the first Evidently release. The tool has evolved since then! It supports various new customizations and features. Check out the current documentation.

We added more options on how to detect target drift and data drift. Previously, you needed to implement a custom function to replace the default statistical tests. Now, you can directly choose between some popular statistical tests from the options library. These include Wasserstein Distance test, Jensen–Shannon distance, Kullback-Leibler divergence, and Population Stability Index (PSI).

To follow the Q&A session and watch the full replay of Evidently Community Call #2, hit play on the recording:

How can I contribute?

We welcome all sorts of contributions, not only the code one!

Give feedback. Recent personalization options are directly inspired by the user feedback, so do not hesitate to send us feature requests. Post to our Discord community or create an issue on GitHub.

Contribute to the codebase. We are building Evidently together with the community! If you want to take part, check out the contribution guide, and feel free to hop on our Discord to chat about your contribution ideas. You can also open an issue on GitHub to report a bug or suggest improvements.

And if you like Evidently, spread the word!

[fs-toc-omit]Get started with AI observability
Try our open-source library with over 20 million downloads, or sign up to Evidently Cloud to run no-code checks and bring all the team to a single workspace to collaborate on AI quality.

Sign up free ⟶


Or try open source ⟶

You might also like

Get Started with AI Observability

Book a personalized 1:1 demo with our team or sign up for a free account.
Icon
No credit card required
By clicking “Accept”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Privacy Policy for more information.