Often you need to upload data files that also contain records that are not relevant to your matching process.
The Filter rules screen enables you to define filter rules to EXCLUDE unnecessary records from your input data sets. This avoids having to pre-process the input files before uploading them to Duco.
- Assume you want to match two data sets that we'll call "Internal" and "External"
- The "Internal" data set contains data about option trades
- The "External" data set contains data about option and futures trades
You can use a filtering rule to remove the records regarding futures from the "External" data set and match only the options trades. Assume that the data sets look as follows:
To define filter rules:
- Go to the Filter rule screen within a process
- Click on Add Rule
- Form a rule using the drop-down menus
- Select the data sets to which the rules apply
In our example we want a rule to exclude records where the "Product" field has the value "Future".
To form this rule:
- Click on Add Rule
- From the drop-down menu choose "Something is equal to something"
- From the drop-down menu to the left of "is equal to" choose "A field" and then the "Product" matched field
- From the drop-down menu to the right of "is equal to" choose "Some text " and then type the text "Future"
- Select only "External" at the right of the rule to indicate that the rule applies only to that data set.
It is possible to define multiple rules. Consider the following example:
The effect of the rules above is to exclude:
- All records in the "External" data set where the "Product" field has the value "Future"
- All records in both the "Internal" and "External" data set where trade date is before June 1
- All records in both the "Internal" and "External" data set where trade date is on or after July 1
In simpler terms: Only the June option trades are kept for matching.
Finally, ensure that your filters have been switched on for the relevant side, otherwise your filter rules will not be applied.
Now run your process and you will find that the filtered items will not be included in the results.
You can learn more about creating rules reading the page Rules using Natural Rule Language (NRL), which covers this topic in detail.
Duco reports as Filtered records that a filter rule excludes from the matching process (note: the Filtered bucket will only appear once a filter has been applied):