Coverage¶

Elliot integrates the following coverage metrics.

Summary¶

`item_coverage.item_coverage.ItemCoverage`(…)	Item Coverage
`num_retrieved.num_retrieved.NumRetrieved`(…)	Number of Recommendations Retrieved
`user_coverage.user_coverage.UserCoverage`(…)	User Coverage
`user_coverage.user_coverage_at_n.UserCoverageAtN`(…)	User Coverage on Top-N rec.

Item Coverage¶

class elliot.evaluation.metrics.coverage.item_coverage.item_coverage.ItemCoverage(recommendations, config, params, eval_objects)[source]¶

Bases: elliot.evaluation.metrics.base_metric.BaseMetric

Item Coverage

This class represents the implementation of the Item Coverage recommendation metric.

For further details, please refer to the book

Note

The simplest measure of catalog coverage is the percentage of all items that can ever be recommended. This measure can be computed in many cases directly given the algorithm and the input data set.

To compute the metric, add it to the config file adopting the following pattern:

simple_metrics: [ItemCoverage]

Number of Recommendations Retrieved¶

class elliot.evaluation.metrics.coverage.num_retrieved.num_retrieved.NumRetrieved(recommendations, config, params, eval_objects)[source]¶

Bases: elliot.evaluation.metrics.base_metric.BaseMetric

Number of Recommendations Retrieved

This class represents the implementation of the Number of Recommendations Retrieved recommendation metric.

For further details, please refer to the link

simple_metrics: [NumRetrieved]

User Coverage¶

class elliot.evaluation.metrics.coverage.user_coverage.user_coverage.UserCoverage(recommendations, config, params, eval_objects)[source]¶

Bases: elliot.evaluation.metrics.base_metric.BaseMetric

User Coverage

This class represents the implementation of the User Coverage recommendation metric.

For further details, please refer to the book

Note

The proportion of users or user interactions for which the system can recommend items. In many applications the recommender may not provide recommendations for some users due to, e.g. low confidence in the accuracy of predictions for that user.

To compute the metric, add it to the config file adopting the following pattern:

simple_metrics: [UserCoverage]

User Coverage At N¶

class elliot.evaluation.metrics.coverage.user_coverage.user_coverage_at_n.UserCoverageAtN(recommendations, config, params, eval_objects)[source]¶

Bases: elliot.evaluation.metrics.base_metric.BaseMetric

User Coverage on Top-N rec. Lists

This class represents the implementation of the User Coverage recommendation metric.

For further details, please refer to the book

To compute the metric, add it to the config file adopting the following pattern:

simple_metrics: [UserCoverageAtN]