|
We evaluated our pipeline on a sample dataset provided by Ericsson. The details are hidden as it contains proprietary information We also collected open-source samples from NTC-template that provides free-form, unstructured text from a variety of network vendors to evaluate each pipeline of algorithms. We labeled each line with noise and data labels to evaluate the accuracy of our unsupervised approach. Our evaluation method consists of manually labeling each input and determining the accuracy of the processed file by comparing it with the manual labels. We then take a mean of the accuracy of the 50 samples and calculate F1-score.
|