I am wanting to verify within the pipeline that the row count before and after a dataflow matches, accounting for any rows which have been filtered out.
For example:
a) rowsRead = 500 b) rowsWritten = 450 c) rowsFiltered = 50
Since A = B + C, the pipeline would pass. In the event that B + C ≠ A, I would like the pipeline to fail.
but am struggling to get a count of the rows which have been filtered out
Image
Hoping someone can assist me in creating a system variable for the count of rows which have been filtered out.
