Skip to content

Issues: Lightning-AI/torchmetrics

Create gallery of realistic examples
#2438 opened Mar 7, 2024 by Borda
Open 1
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

71 Open 874 Closed
71 Open 874 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

MultilabelExactMatch agnostic to 'ignore_index' bug / fix Something isn't working help wanted Extra attention is needed
#3083 opened May 6, 2025 by championsnet
2
R2 result > 1 bug / fix Something isn't working help wanted Extra attention is needed
#3077 opened Apr 30, 2025 by forestbat
5
Multiclass accuracy with micro and top-k does not work as expected. bug / fix Something isn't working help wanted Extra attention is needed
#3068 opened Apr 17, 2025 by mmcdermott
1
4
Unified Metrics class for multiple metrics enhancement New feature or request
#3066 opened Apr 16, 2025 by ZhiyuanChen
meanIoU calculation error for 1.8.0.dev0 (build from source) bug / fix Something isn't working help wanted Extra attention is needed
#3047 opened Apr 7, 2025 by insomniaaac
3
Pose estimation metrics enhancement New feature or request New metric
#3026 opened Mar 23, 2025 by Isalia20 future
3
Lip Vertex Error (LVE) Metrics for 3D Talking Heads Evaluation enhancement New feature or request New metric
#3003 opened Mar 11, 2025 by rittik9 future
@rittik9
6
A differentiable pytorch VMAF implementation. enhancement New feature or request New metric
#2961 opened Feb 18, 2025 by NilanEkanayake future
1
1
Multi Label Precision numerical stability issues with MPS bug / fix Something isn't working duplicate This issue or pull request already exists help wanted Extra attention is needed v1.6.x
#2955 opened Feb 15, 2025 by dmnkf
3
Report nan in PR curve above max threshold enhancement New feature or request
#2873 opened Dec 17, 2024 by ytang137
1
Support tensors in edit distance computations enhancement New feature or request
#2856 opened Dec 1, 2024 by kylebgorman future
1
1
GeneralizedDiceScore yields 0 scores when using per_class=True for samples where class is not present bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.6.x v1.7.x
#2846 opened Nov 28, 2024 by nkaenzig
3
Reference Metric in multiclass pecision recall unittests provides wrong answer when ignore_index is specified with average = 'macro' bug / fix Something isn't working help wanted Extra attention is needed Priority Critical task/issue v1.5.x
#2828 opened Nov 5, 2024 by rittik9
3
[Bug] torchmetrics.functional.classification.binary_auroc gives wrong results when logits are large bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.4.x v1.6.x v1.7.x
#2819 opened Nov 2, 2024 by zbingsong
2
Segmentation IOU compute Ignore some tagged values that don't need to be recorded (such as 255) enhancement New feature or request
#2747 opened Sep 16, 2024 by woldier
@SkafteNicki
2
BERT score: maximum at self-comparison, symmetry, invariance to additional items bug / fix Something isn't working good first issue Good for newcomers help wanted Extra attention is needed v1.4.x
#2728 opened Sep 9, 2024 by GPPassos
4
Make ignore_index work when all batch elements are to be ignored enhancement New feature or request wontfix
#2685 opened Aug 12, 2024 by fteufel
2
Retrieval metrics are misleading - here's how it should be done instead enhancement New feature or request
#2611 opened Jun 26, 2024 by devinbost future
7
Need higher level RAG metrics enhancement New feature or request Important milestonish New metric
#2598 opened Jun 14, 2024 by devinbost future
2
Classification Report, maybe with the option to select even more metrics enhancement New feature or request help wanted Extra attention is needed
#2580 opened Jun 1, 2024 by rakro101
@rittik9
13
Support for DLM (AIM) metric enhancement New feature or request New metric
#2562 opened May 25, 2024 by saswat0 future
1
1
Clarify that nan is supported in zero_division documentation Improvements or additions to documentation enhancement New feature or request v1.3.x
#2535 opened May 12, 2024 by robmarkcole v1.3.x
@SkafteNicki
4
Ordinal classification metrics enhancement New feature or request New metric
#2509 opened Apr 18, 2024 by Zhylkaaa future
1
Discrepancy in optimal threshold calculation between sklearn and torchmetrics ROC implementations bug / fix Something isn't working v1.3.x
#2489 opened Apr 4, 2024 by vitalwarley
@SkafteNicki
4
[Bug] No backend type associated with device type cpu bug / fix Something isn't working help wanted Extra attention is needed v1.3.x
#2477 opened Mar 27, 2024 by rballeba
@SkafteNicki
12
ProTip! Exclude everything labeled bug with -label:bug.