Description
Given a target dataset and reference dataset with a known sensitive attribute, the tool provides different metrics.
- Metrics to compare the quality and the diversity of the target and the reference dataset for each value of the sensitive attribute.
- Metrics to assess the balance level of the target dataset with respect to the sensitive attribute.
Operation
The tool is a python package with easy-to-use commands. It comes with commented-out example configuration files that explain the different parameters of each implemented metric. The tool generates the metrics results in CSV format and as figures.