iemodel evaluate train_model
The iemodel evaluate train_model command evaluates and trains an
existing Spectrum Information Extraction model. This function cannot be
performed on a new model.
Note: For better results on evaluation and training of an existing
Spectrum Information Extraction, use this command: iemodel
trainAndevaluate model. For details, see iemodel trainAndevaluate model.
Usage
iemodel evaluate train_model --f trainingOptionsFile --u trueOrFalse --o outputFileName --c categoryCount --d trueOrfalse| Required | Argument | Description |
|---|---|---|
| Yes | --f trainingOptionsFile | Specifies the name and location of the training options file used to train the model. Directory paths you specify here are relative to the location where you are running the Administration Utility. |
| No | --u overWriteIfExists | Specifies whether to overwrite the existing trained model (if one exists).
TrueOrFalse is one of the following:
|
| No | --o outputFileName | Specifies the name and location of the output file that will store the evaluation results. |
| No | --c categoryCount | Specifies the number of categories in the model; must be a numeric value. Note: It
is applicable only for Text Classification model. |
| No | --d trueOrfalse | Specifies whether to display a table with entity wise detailed analysis; the value
must be true or false, as below:
false. The Model Evaluation Results table, with its columns as described below,displays the counts per entity. Note: If the command is run without this argument or with the argument value
false, the Model Evaluation Results table is not displayed.
Only the Model Evaluation Statistics are displayed. |
Output
- Model Evaluation Statistics
- Executing this command displays these evaluation statistics in a tabular format:
- Precision
- Recall
- F1 Measure
- Model Evaluation Results
- If the command is run with the argument
--d true, the match counts of all the entities are displayed in a tabular format. The columns of the table are:- Input Count
- The number of occurrences of the entity in the input data.
- Mismatch Count
- The number of times the entity match failed.
- Match Count
- The number of times the entity match succeeded.
Example
This example:
iemodel evaluate train_model --f C:\Spectrum\IEModels\ModelTrainingFile
--u true --o C:\Spectrum\IEModels\MyModelTestOutput --c 4 --d
true- Uses a training options file called "ModelTrainingFile" that is located in "C:\Spectrum\IEModels"
- Overwrites any existing output file of the same name
- Stores the output of the evaluation in a file called "MyModelTestOutput"
- Specifies a category count of 4
- Specifies that a detailed analysis of the evaluation is required