iemodel evaluate train_model

The iemodel evaluate train_model command evaluates and trains an existing Spectrum Information Extraction model. This function cannot be performed on a new model.
Note: For better results on evaluation and training of an existing Spectrum Information Extraction, use this command: iemodel trainAndevaluate model. For details, see iemodel trainAndevaluate model.

Usage

iemodel evaluate train_model --f trainingOptionsFile --u trueOrFalse --o outputFileName --c categoryCount --d trueOrfalse
RequiredArgumentDescription
Yes--f trainingOptionsFileSpecifies the name and location of the training options file used to train the model. Directory paths you specify here are relative to the location where you are running the Administration Utility.
No--u overWriteIfExistsSpecifies whether to overwrite the existing trained model (if one exists). TrueOrFalse is one of the following:
true
Overwrites the existing model.
false
Does not overwrite the existing model.
No--o outputFileNameSpecifies the name and location of the output file that will store the evaluation results.
No--c categoryCountSpecifies the number of categories in the model; must be a numeric value.
Note: It is applicable only for Text Classification model.
No--d trueOrfalseSpecifies whether to display a table with entity wise detailed analysis; the value must be true or false, as below:
true
Detailed evaluation results are required.
false
Detailed evaluation results are not required.
The default is false.

The Model Evaluation Results table, with its columns as described below,displays the counts per entity.

Note: If the command is run without this argument or with the argument value false, the Model Evaluation Results table is not displayed. Only the Model Evaluation Statistics are displayed.

Output

Model Evaluation Statistics
Executing this command displays these evaluation statistics in a tabular format:
  • Precision
  • Recall
  • F1 Measure
Model Evaluation Results
If the command is run with the argument --d true, the match counts of all the entities are displayed in a tabular format. The columns of the table are:
Input Count
The number of occurrences of the entity in the input data.
Mismatch Count
The number of times the entity match failed.
Match Count
The number of times the entity match succeeded.

Example

This example:
  • Uses a training options file called "ModelTrainingFile" that is located in "C:\Spectrum\IEModels"
  • Overwrites any existing output file of the same name
  • Stores the output of the evaluation in a file called "MyModelTestOutput"
  • Specifies a category count of 4
  • Specifies that a detailed analysis of the evaluation is required
iemodel evaluate train_model --f C:\Spectrum\IEModels\ModelTrainingFile --u true --o C:\Spectrum\IEModels\MyModelTestOutput --c 4 --d true