Last updated on 2025-06-25 05:49:58 CEST.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.3.2 | 16.40 | 186.89 | 203.29 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.3.2 | 7.73 | 116.84 | 124.57 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.4.0 | 529.57 | OK | |||
| r-devel-linux-x86_64-fedora-gcc | 0.4.0 | 475.65 | OK | |||
| r-devel-windows-x86_64 | 0.3.2 | 15.00 | 150.00 | 165.00 | ERROR | |
| r-patched-linux-x86_64 | 0.3.2 | 13.03 | 278.37 | 291.40 | ERROR | |
| r-release-linux-x86_64 | 0.3.2 | 10.53 | 151.17 | 161.70 | ERROR | |
| r-release-macos-arm64 | 0.3.2 | 156.00 | NOTE | |||
| r-release-macos-x86_64 | 0.4.0 | 276.00 | OK | |||
| r-release-windows-x86_64 | 0.4.0 | 16.00 | 275.00 | 291.00 | OK | |
| r-oldrel-macos-arm64 | 0.3.2 | 137.00 | NOTE | |||
| r-oldrel-macos-x86_64 | 0.4.0 | 261.00 | OK | |||
| r-oldrel-windows-x86_64 | 0.4.0 | 22.00 | 343.00 | 365.00 | OK |
Version: 0.3.2
Check: Rd files
Result: NOTE
checkRd: (-1) groupdiff_tau.Rd:23: Lost braces
23 | \code{groupdiff_tau()} computes \eqn{min(x/y, y/x)}, i.e. the smallest symmetric ratio between \eqn{x} and eqn{y}
| ^
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64, r-release-macos-arm64, r-oldrel-macos-arm64
Version: 0.3.2
Check: Rd cross-references
Result: NOTE
Found the following Rd file(s) with Rd \link{} targets missing package
anchors:
MeasureFairness.Rd: mlr_measures_classif.ce,
mlr_measures_classif.fpr, mlr_measures, Task
MeasureFairnessComposite.Rd: Task
MeasureFairnessConstraint.Rd: Task
MeasureSubgroup.Rd: mlr_measures_classif.fpr
compas.Rd: TaskClassif
compute_metrics.Rd: Task
fairness_accuracy_tradeoff.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Task, Measure, TaskClassif
fairness_compare_metrics.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Measure, TaskClassif, Task
fairness_prediction_density.Rd: PredictionClassif, ResampleResult,
BenchmarkResult, Task, TaskClassif
fairness_tensor.Rd: data.table, PredictionClassif, ResampleResult,
TaskClassif, Task
groupdiff_tau.Rd: Task
groupwise_metrics.Rd: Task
mlr_learners_classif.fairfgrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_classif.fairzlrm.Rd: Learner, mlr_learners, lrn
mlr_learners_fairness.Rd: Task
mlr_learners_regr.fairfrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairnclm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairzlm.Rd: Learner, mlr_learners, lrn
mlr_measures_fairness.Rd: Task
mlr_pipeops_equalized_odds.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_explicit_pta.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_reweighing.Rd: R6Class, PipeOpTaskPreproc, PipeOp
report_fairness.Rd: Task
task_summary.Rd: Task
Please provide package anchors for all Rd \link{} targets not in the
package itself and the base packages.
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64
Version: 0.3.2
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: MeasureFairness
> ### Title: Base Measure for Fairness
> ### Aliases: MeasureFairness
>
> ### ** Examples
>
> library("mlr3")
> # Create MeasureFairness to measure the Predictive Parity.
> t = tsk("adult_train")
> learner = lrn("classif.rpart", cp = .01)
> learner$train(t)
> measure = msr("fairness", base_measure = msr("classif.ppv"))
> predictions = learner$predict(t)
> predictions$score(measure, task = t)
Error in prediction$clone()$filter(rws)$score(base_measure, task = task, :
unused argument (weights = NULL)
Calls: <Anonymous> ... score_groupwise -> map_dbl -> map_mold -> vapply -> FUN
Execution halted
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-release-linux-x86_64
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [21s/22s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [03:20:03.608] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:20:04.360] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:20:04.428] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:20:04.472] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:20:04.516] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:20:04.549] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:20:04.589] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:20:04.620] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:20:04.743] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:20:04.830] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:20:04.905] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:20:04.979] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:20:05.011] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:20:05.050] [mlr3] Finished benchmark
INFO [03:20:05.437] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:20:05.483] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:20:05.524] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:20:05.566] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:20:05.609] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:20:05.643] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:20:05.673] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:20:05.703] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:20:05.752] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:20:05.800] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:20:05.838] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:20:05.866] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:20:05.895] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:20:05.926] [mlr3] Finished benchmark
INFO [03:20:06.218] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:20:06.235] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:20:06.276] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:20:06.319] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:20:06.362] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:20:06.403] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:20:06.490] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:20:06.538] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:20:06.576] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:20:06.614] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:20:06.704] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:20:06.759] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:20:06.793] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:20:06.835] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15360 bytes
Input file size = 15450 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12282
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12282
Output IDAT size = 12282 bytes (3078 bytes decrease)
Output file size = 12360 bytes (3090 bytes = 20.00% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17425 bytes
Input file size = 17527 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13328
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13328
Output IDAT size = 13328 bytes (4097 bytes decrease)
Output file size = 13406 bytes (4121 bytes = 23.51% decrease)
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [11s/12s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [16:50:44.606] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:50:44.770] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:50:44.828] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:50:44.869] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:50:44.910] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:50:44.946] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:50:45.026] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:50:45.053] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:50:45.088] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:50:45.116] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:50:45.148] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:50:45.226] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:50:45.296] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:50:45.350] [mlr3] Finished benchmark
INFO [16:50:45.607] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:50:45.635] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:50:45.665] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:50:45.694] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:50:45.724] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:50:45.748] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:50:45.774] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:50:45.828] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:50:45.869] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:50:45.908] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:50:45.942] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:50:46.018] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:50:46.053] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:50:46.077] [mlr3] Finished benchmark
INFO [16:50:46.256] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:50:46.269] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:50:46.300] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:50:46.332] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:50:46.373] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:50:46.470] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:50:46.550] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:50:46.636] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:50:46.668] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:50:46.699] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:50:46.731] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:50:46.758] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:50:46.781] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:50:46.807] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15540 bytes
Input file size = 15630 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12358
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12358
Output IDAT size = 12358 bytes (3182 bytes decrease)
Output file size = 12436 bytes (3194 bytes = 20.44% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 18635 bytes
Input file size = 18737 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 14193
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 14193
Output IDAT size = 14193 bytes (4442 bytes decrease)
Output file size = 14271 bytes (4466 bytes = 23.84% decrease)
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: examples
Result: ERROR
Running examples in 'mlr3fairness-Ex.R' failed
The error most likely occurred in:
> ### Name: MeasureFairness
> ### Title: Base Measure for Fairness
> ### Aliases: MeasureFairness
>
> ### ** Examples
>
> library("mlr3")
> # Create MeasureFairness to measure the Predictive Parity.
> t = tsk("adult_train")
> learner = lrn("classif.rpart", cp = .01)
> learner$train(t)
> measure = msr("fairness", base_measure = msr("classif.ppv"))
> predictions = learner$predict(t)
> predictions$score(measure, task = t)
Error in prediction$clone()$filter(rws)$score(base_measure, task = task, :
unused argument (weights = NULL)
Calls: <Anonymous> ... score_groupwise -> map_dbl -> map_mold -> vapply -> FUN
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.3.2
Check: tests
Result: ERROR
Running 'testthat.R' [12s]
Running the tests in 'tests/testthat.R' failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [12:53:06.291] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:53:06.461] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:53:06.520] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:53:06.560] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:53:06.607] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:53:06.627] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:53:06.649] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:53:06.676] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:53:06.711] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:53:06.746] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:53:06.783] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:53:06.809] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:53:06.832] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:53:06.864] [mlr3] Finished benchmark
INFO [12:53:07.130] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:53:07.168] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:53:07.203] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:53:07.244] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:53:07.280] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:53:07.304] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:53:07.325] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:53:07.345] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:53:07.379] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:53:07.423] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:53:07.476] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:53:07.505] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:53:07.534] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:53:07.570] [mlr3] Finished benchmark
INFO [12:53:07.750] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:53:07.770] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:53:07.797] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:53:07.828] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:53:07.867] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:53:07.904] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:53:07.932] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:53:07.958] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:53:07.992] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:53:08.028] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:53:08.066] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:53:08.095] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:53:08.129] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:53:08.158] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at D:\RCompile\CRANpkg\local\4.6\mlr3fairness.Rcheck\tests\testthat\helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at D:\RCompile\CRANpkg\local\4.6\mlr3fairness.Rcheck\tests\testthat\helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building 'debiasing-vignette.Rmd' using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building 'debiasing-vignette.Rmd'
--- re-building 'measures-vignette.Rmd' using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'measures-vignette.Rmd'
--- re-building 'reports-vignette.Rmd' using rmarkdown
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─... %>% kable_paper("hover", full_width = F)
2. ├─kableExtra::kable_paper(., "hover", full_width = F)
3. │ └─kableExtra:::kable_light(...)
4. │ └─kableExtra::kable_styling(...)
5. ├─kableExtra::kbl(., col.names = c("value"))
6. │ └─knitr::kable(...)
7. └─resample_result$aggregate(fair_metrics)
8. └─mlr3:::.__ResampleResult__aggregate(...)
9. └─mlr3:::resample_result_aggregate(self, measures)
10. ├─... %??% set_names(numeric(), character())
11. ├─base::unlist(...)
12. └─mlr3misc::map(...)
13. └─base::lapply(.x, .f, ...)
14. └─mlr3 (local) FUN(X[[i]], ...)
15. └─m$aggregate(rr)
16. └─mlr3:::.__Measure__aggregate(...)
17. └─mlr3:::score_measures(...)
18. └─mlr3misc::pmap_dbl(...)
19. └─mlr3misc:::mapply_list(.f, .x, list(...))
20. └─base::.mapply(.f, .dots, .args)
21. └─mlr3 (local) `<fn>`(...)
22. └─mlr3:::score_single_measure(...)
23. └─get_private(measure)$.score(...)
24. └─mlr3fairness:::.__MeasureFairness__.score(...)
25. └─mlr3fairness:::score_groupwise(...)
26. └─mlr3misc::map_dbl(...)
27. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
28. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
29. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'reports-vignette.Rmd'
--- re-building 'visualization-vignette.Rmd' using rmarkdown
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'visualization-vignette.Rmd'
SUMMARY: processing the following files failed:
'debiasing-vignette.Rmd' 'measures-vignette.Rmd'
'reports-vignette.Rmd' 'visualization-vignette.Rmd'
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15644 bytes
Input file size = 15734 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12463
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12463
Output IDAT size = 12463 bytes (3181 bytes decrease)
Output file size = 12541 bytes (3193 bytes = 20.29% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17998 bytes
Input file size = 18100 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13421
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13421
Output IDAT size = 13421 bytes (4577 bytes decrease)
Output file size = 13499 bytes (4601 bytes = 25.42% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17899 bytes
Input file size = 18001 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13031
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13031
Output IDAT size = 13031 bytes (4868 bytes decrease)
Output file size = 13109 bytes (4892 bytes = 27.18% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 234 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2764 bytes
Input file size = 3556 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2595
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2595
Output IDAT size = 2595 bytes (169 bytes decrease)
Output file size = 2673 bytes (883 bytes = 24.83% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10082 bytes
Input file size = 10172 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8053
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8053
Output IDAT size = 8053 bytes (2029 bytes decrease)
Output file size = 8131 bytes (2041 bytes = 20.06% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-patched-linux-x86_64
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [15s/26s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [14:50:42.855] [mlr3] Running benchmark with 12 resampling iterations
INFO [14:50:43.163] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [14:50:43.306] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [14:50:43.395] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [14:50:43.498] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [14:50:43.593] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [14:50:43.707] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [14:50:43.786] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [14:50:43.914] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [14:50:43.999] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [14:50:44.047] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [14:50:44.096] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [14:50:44.144] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [14:50:44.239] [mlr3] Finished benchmark
INFO [14:50:45.005] [mlr3] Running benchmark with 12 resampling iterations
INFO [14:50:45.096] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [14:50:45.180] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [14:50:45.267] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [14:50:45.361] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [14:50:45.452] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [14:50:45.536] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [14:50:45.622] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [14:50:45.768] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [14:50:45.853] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [14:50:45.928] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [14:50:46.059] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [14:50:46.146] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [14:50:46.241] [mlr3] Finished benchmark
INFO [14:50:46.656] [mlr3] Running benchmark with 12 resampling iterations
INFO [14:50:46.686] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [14:50:46.774] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [14:50:46.874] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [14:50:46.973] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [14:50:47.081] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [14:50:47.171] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [14:50:47.250] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [14:50:47.325] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [14:50:47.365] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [14:50:47.406] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [14:50:47.478] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [14:50:47.543] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [14:50:47.599] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-release-linux-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15294 bytes
Input file size = 15384 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12085
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12085
Output IDAT size = 12085 bytes (3209 bytes decrease)
Output file size = 12163 bytes (3221 bytes = 20.94% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 16912 bytes
Input file size = 17014 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12906
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12906
Output IDAT size = 12906 bytes (4006 bytes decrease)
Output file size = 12984 bytes (4030 bytes = 23.69% decrease)
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-release-linux-x86_64