Superwise

Superwise is a robust platform designed to provide full ML observability. It helps data scientists and ML engineers to ensure the ongoing health and performance of machine learning models in a production environment. The platform offers capabilities for creating, customizing, and automating ML monitoring with a vast library of pre-built and customizable metrics for data, drift, performance, bias, and explainability. With Superwise, users can easily identify and investigate model shifts, track performance continuously, analyze changes, and drill down into granular data to pinpoint the root cause of any issues. It also offers features for explaining model behaviors, comparing versions, and managing incidents, ensuring that potential problems are resolved before they impact business operations.

• ML Monitoring: Easily create, customize & automate your ML monitoring with our library of metrics, policies & notification channels.
• Model Metric Store: 100+ pre-built & fully customizable metrics for data, drift, performance, bias, & explainability.
• Data Monitoring: Monitor data quality metrics or build custom integrity metrics.
• Drift Monitoring: Customize drift metrics from a-z – distance functions, features, datasets, timeframes, sensitivity, and more.
• Bias Monitoring: Build any bias metric your business needs and monitor them across different protected classes and sub-groups.
• Performance Analysis: Track performance continuously and analyze changes, and drill into behavior segment by segment.
• Explainability: Explain model behaviors on the global, cohort, and individual decision level.
• Version Comparison: Analyze and compare versions, datasets, and production timeframes to detect changes.
• Anomaly Investigation: Correlate and group anomalies to quickly pinpoint casualty and resolve issues.
• LLM Monitoring: Gain visibility into LLM and prompt/response behaviors and detect drift, security issues, and privacy violations.