Duco is designed to process data at scale. We process recon runs with tens of millions of records regularly. Most of these recon runs finish in seconds. However a minority of them may take hours to run. The time it takes depends on data volume, data quality and process configurations. This section contains the key parts of process configuration which could impact its run time.
Match fields
Each additional match field you configure increases the processing effort required by the matching engine. While the platform is designed to handle complex scenarios with 100+ match fields, using too many match fields unnecessarily can impact performance and efficiency.
Recommendation: Keep match rules as simple and focused as possible - include only the fields that are genuinely needed for accurate reconciliation. Use reported fields to have additional data available to users for exception investigation and reporting.
Look back history
Record tracking and auto-close features both rely on looking back through run histories to find the corresponding records in historical runs to link them or close them. When there are lots of records to be traced, through many runs, it could impact the run time performance.
To manage your exceptions effectively, the best practice is to keep all outstanding exceptions in the latest run by using record tracking, carry over and auto-close. Then you can limit the record tracking and auto-close look back period, which ensures your process runs quickly all the time.
See here for more information.
Recommendation: Always use the default limits. Review the process settings and enable them if needed.
Data quality checks
Duco’s matching engine is designed to work with data sets of all sizes - from small batches up to 10s of millions records or more. However in rare scenarios where the data quality is low, the engine may spend excessive time attempting to find matches. To prevent the platform from being stuck with such a scenario, it would pause the processing and alert the user to review configurations and their data. See here for more details and how you may optimize your process configurations.
Recommendation: When you encounter the pre-optimized results, review your process settings. Optimize your configurations using the platform’s guidance to ensure efficient performance and accurate results.