Often you need to upload data files that also contain records that are not relevant to your matching process.
The Filter rules screen enables you to define filter rules to EXCLUDE unnecessary records from your input data sets. This avoids having to pre-process the input files before uploading them to Duco.
Example
- Assume you want to match two data sets that we'll call "Internal" and "External"
- The "Internal" data set contains data about option trades
- The "External" data set contains data about option and futures trades
You can use a filtering rule to remove the records regarding futures from the "External" data set and match only the options trades. Assume that the data sets look as follows:
Defining rules
To define filter rules:
- Go to Settings > Filter rules within a process
- Click on Add Rule
- Build a rule using the drop-down options
In our example we want a rule to exclude records where the "Product" field has the value "Future".
To build this rule:
- Click on Add Rule
- From the drop-down menu choose "Something is equal to something"
- From the drop-down menu to the left of "is equal to" choose "A field" and then the "Product" matched field
- From the drop-down menu to the right of "is equal to" choose "Some text " and then type the text "Future"
- Select only "Exchange" to the right of the rule to indicate that the rule applies only to that data set.
It is possible to define multiple rules. Consider the following examples:
The effect of the rules above is to exclude:
- All records in the "Exchange" data set where the "Product" field has the value "Future"
- All records in both the "Internal" and "Exchange" data set where trade date is before March 18th - In simple terms, only the March option trades are kept for matching.
Finally, ensure that your filters have been switched on for the relevant side, otherwise your filter rules will not be applied.
Now run your process and you will find that the filtered items will not be included in the results.
You can learn more about creating rules reading the page Rules using Natural Rule Language (NRL), which covers this topic in detail.
Result reporting
Duco reports as Filtered records that a filter rule excludes from the matching process (note: the Filtered bucket will only appear once a filter has been applied):