- Overview
- Model building
- Model validation
- Model deployment
- API
- Frequently asked questions
Unstructured and complex documents user guide
Reviewing predictions
Evaluate the initial predictions the model generated based on the extraction schema you defined beforehand. This way, you understand where you might need to adjust your prompt instructions to improve the performance of the model.
The model uses generative AI to map fields and field groups defined in the extraction schema and predict them with confidence and accuracy. It extracts these fields and field groups and returns them in a structured JSON format, if they are present in the document.
Predictions are generated automatically. However, you might need to select the Predict extractions button, on the Validate predictions page, to refresh the predictions if you made changes to your taxonomy or uploaded new documents.
-
Review the predictions on a sample of 2-3 documents.
-
Decide if you need to modify your prompt instructions.
-
Gradually increase the test sample to 10, 20, 30 documents, and so on. This will be an iterative process. You can decide how many documents to update, beyond the minimum of 10, based on your business acceptance criteria.
You can use the filter button on annotated documents to view annotations from the current page or submitted annotations only, as opposed to annotations and predictions compared against one another. Select one of the following options:
- Current page
- Submitted annotations only
Modifying instructions
Once you review the out-of-the-box predictions, check where you need to modify the original prompt instructions to provide additional context for the model. The iterative refinement of instructions is essential to enhance the performance of the model.
Modifying the Overall extraction instruction
To modify the Overall extraction instruction, go to the Build tab, select Manage Taxonomy, and edit the prompt instruction.
Modifying field instructions
You can modify the prompt instructions of fields from the following locations:
- Manage taxonomy page.
- Annotation pane of the Validate predictions page.
From Manage taxonomy
-
In the Build tab, select Manage taxonomy.
-
Under the Fields and field groups tab, expand a field group, and, for a specific field, modify the instruction directly in the inline table.
-
Select Save.
From the annotation pane
-
In the Build tab, select Validate predictions.
-
From the annotation pane, select the ellipsis for your field.
-
Select Edit field, and modify the instruction.
-
Select Save.
Modifying field group instructions
You can modify the prompt instructions of field groups from the following locations:
- The Manage taxonomy page.
- Annotation pane of the Validate predictions page.
From Manage taxonomy
-
In the Build tab, select Manage taxonomy.
-
In the Fields and field groups tab, modify the instruction for a specific field group directly in the inline table.
-
Select Save.
From the annotation pane
-
In the Build tab, select Validate predictions page.
-
From the annotation pane, select the ellipsis for the field group.
-
Select Edit field group.
-
In the side panel that appears, under Field group details, you can modify the instructions.
-
Select the pencil button.
-
In the Instruction field, modify your instruction.
-
Select Save.
Using change history for fields and field groups
The Change history feature allows you to review, compare, and restore previous versions of a field or field group. You can use it to safely iterate on names, field types, and instructions without reverting the entire project version.
You can access Change history from the following locations:
- Manage Taxonomy page.
- Annotation pane on the Validate predictions page.
Viewing and comparing previous versions
To use the Change history feature, proceed as follows:
- In the Build tab, select Manage Taxonomy.
- Select the ellipsis for your field or field group.
- Select View change history.
- In the window that appears, you can view all prior versions of the selected field or field group.
- Enable the option Compare with current to compare any past version with the current one. The feature displays the following details:
- The date and time the field or field group was last updated.
- Field name
- Field type
- InstructionUse the version list to select any prior state and review how it differs from the current configuration.
- After you have compared the versions between them, select one of the following options: Restore all - Restores the entire selected version, including name, field type, and instructions. Restore instructions - Restores only the instructions from the selected version while keeping the current name and field type. The system applies the restored configuration immediately and records it as a new project version.
Alternatively, you can access Change history from the annotation pane, using the ellipsis for
fields and field groups.
Reverting to previous instructions
To revert to a previous instruction, proceed as follows:
-
Navigate to the Build tab.
-
Select Manage taxonomy.
-
Select the ellipsis for your field or field group, and then View change history. In the window that appears, you can view all prior versions of the selected field or field group.
-
Then, select the version that contains the instructions you want to restore.
-
Enable the option Compare with current to compare any past version with the current one.
-
Select Restore instructions to restore only the instructions from the selected version while keeping the current name and field type.
Checking new predictions
To check new predictions, proceed as follows:
-
Navigate to the Build tab in the Unstructured and complex documents capability.
-
Select Validate predictions.
-
New predictions should appear in the side panel. If not, select the Predict extractions button.
