Content-Length: 517320 | pFad | http://github.com/espnet/espnet/pull/5959

00 Universa Tasks for unified versatile evaluation of speech and audio by ftshijt · Pull Request #5959 · espnet/espnet · GitHub
Skip to content

Universa Tasks for unified versatile evaluation of speech and audio #5959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 91 commits into
base: master
Choose a base branch
from

Conversation

ftshijt
Copy link
Collaborator

@ftshijt ftshijt commented Nov 16, 2024

Will keep on updating the task for unified evaluation

@mergify mergify bot added the ESPnet2 label Nov 16, 2024
@ftshijt ftshijt marked this pull request as draft November 16, 2024 11:08
@ftshijt ftshijt changed the title [WIP] Universa Tasks for unified versatile evaluation of speech and audio Universa Tasks for unified versatile evaluation of speech and audio May 20, 2025
@ftshijt ftshijt marked this pull request as ready for review May 20, 2025 12:26
@mergify mergify bot added the CI Travis, Circle CI, etc label May 26, 2025
Copy link

codecov bot commented May 26, 2025

Codecov Report

Attention: Patch coverage is 5.31208% with 713 lines in your changes missing coverage. Please review.

Project coverage is 27.05%. Comparing base (3856d99) to head (e5ca8c2).
Report is 5 commits behind head on master.

Files with missing lines Patch % Lines
espnet2/universa/base/universa_base.py 0.00% 199 Missing ⚠️
espnet2/bin/universa_inference.py 0.00% 127 Missing ⚠️
espnet2/tasks/universa.py 0.00% 106 Missing ⚠️
espnet2/train/preprocessor.py 11.22% 87 Missing ⚠️
espnet2/universa/espnet_model.py 0.00% 58 Missing ⚠️
espnet2/train/collate_fn.py 15.00% 34 Missing ⚠️
espnet2/train/dataset.py 9.09% 20 Missing ⚠️
espnet2/train/iterable_dataset.py 0.00% 16 Missing ⚠️
espnet2/spk/pooling/chn_attn_stat_pooling.py 12.50% 14 Missing ⚠️
espnet2/universa/abs_universa.py 0.00% 10 Missing ⚠️
... and 10 more

❗ There is a different number of reports uploaded between BASE (3856d99) and HEAD (e5ca8c2). Click for more details.

HEAD has 7 uploads less than BASE
Flag BASE (3856d99) HEAD (e5ca8c2)
test_integration_espnetez 2 0
test_integration_espnet2 5 0
Additional details and impacted files
@@             Coverage Diff             @@
##           master    #5959       +/-   ##
===========================================
- Coverage   44.74%   27.05%   -17.69%     
===========================================
  Files         621      889      +268     
  Lines       55994    83347    +27353     
===========================================
- Hits        25054    22553     -2501     
- Misses      30940    60794    +29854     
Flag Coverage Δ
test_integration_espnet2 ?
test_integration_espnetez ?
test_python_espnet1 15.18% <0.00%> (?)
test_python_espnetez 12.64% <5.31%> (?)
test_utils 20.63% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ftshijt
Copy link
Collaborator Author

ftshijt commented May 27, 2025

As said https://github.com/espnet/espnet/actions/runs/15262647137/job/42923105541?pr=5959#step:9:43, does it mean that we need to support at least from torch 2.6 for all transformers' checkpoints?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/espnet/espnet/pull/5959

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy