- Overview
- Model building
- Model evaluation
- Model deployment
- Consuming models
- Developer
- Frequently asked questions
- Access and availability
- Data and security
- Migration
- Design-time
- Runtime
- Document processing limits
- Maintenance and monitoring
Maintenance and monitoring
Frequently asked questions about maintenance and monitoring in IXP in Flow, covering deployed models in Orchestrator, run traces, consumption, and model performance.
Where do I find the deployed IXP models?
- In Orchestrator, select a folder.
- Open the IXP models tab. The tab shows the models deployed to the folder.
The tab has the following filters, each showing a list of model names:
- IXP - Models that the Extract node in Flow creates and publishes. This includes models from design-time debug and from runtime.
- IXP Standalone - Models that you create and publish in IXP, outside Flow.
How do I get more details about a deployed model?
To open the details of a deployed model, select the model name, or select the three-dot menu (⋮), and then select View details. The details of the model include the following tabs:
- Details - Shows the model configuration and the taxonomy.
- Runs - Shows the list of model runs. The trace of each run also shows the details of the LLM, that is, the family and version.
How do I examine a run?
Each run has a unique identifier. Select the identifier to see the run details and the trace.
What does the trace show?
The trace gives full visibility into the run execution. It shows the following:
- The sequence of the operations.
- The model details.
- The governance data.
- The metadata.
Only the user who generated the predictions that a trace belongs to can view that trace.
How do I see the files for an operation?
Each digitization and extraction operation has a Files tab. The tab shows the trace files for that operation:
- The input file.
- The prompt.
- The schema.
- The output JSON.
Use these files to debug, maintain, and monitor your processes.
Can I monitor the consumption of IXP in Flow?
Yes, through the Consumables dashboards in the Admin page. Monitoring in the Insights IXP and tenant dashboards will be available soon.
Can we auto-detect performance decay, for example, data drift, lower F1 scores, and so on?
For now, IXP in Flow does not provide any model performance notifications or alerts.
How often do users need to update their models or prompt instructions?
This depends on each use case, but you should refine your prompt instructions whenever the predictions of your model underperform.
- Where do I find the deployed IXP models?
- How do I get more details about a deployed model?
- How do I examine a run?
- What does the trace show?
- How do I see the files for an operation?
- Can I monitor the consumption of IXP in Flow?
- Can we auto-detect performance decay, for example, data drift, lower F1 scores, and so on?
- How often do users need to update their models or prompt instructions?