| View file | ||||
|---|---|---|---|---|
|
When the The performance of the AI model gets worse, it may cause a serious decline in quality of service.
...
If a model predicts something, we can calculate the accuracy of the inference with real data after targeting time that model predicted.
If a model decide values or action of other functions, we can measure the credibility of the models' decision by tracking KPIs collected from the environment.
...
<proposed monitoring system and scenario>
(#image1)
Monitoring system consists of a monitoring server deployed in the central cluster, monitoring agents distributed in the RICs, pluggable performance analysis modules and additional functions in the dashboard.
...
If all raw data is not necessary to be transferred, basically statistical values such as mean,std,min,max and skew are calculated and sent every 5ms. ( time interval and format is flexible )(#image2,3)
Since InfluxDB is default time-series DB in RIC,
...