Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gen DGRL Dataset[Feature Request] #1678

Closed
1 of 3 tasks
braj29 opened this issue Nov 7, 2023 · 4 comments
Closed
1 of 3 tasks

Gen DGRL Dataset[Feature Request] #1678

braj29 opened this issue Nov 7, 2023 · 4 comments
Assignees
Labels
enhancement New feature or request

Comments

@braj29
Copy link

braj29 commented Nov 7, 2023

Motivation

Want to add the Gen DGRL Dataset for benchmarking RL algorithms in a easy & efficient way

Solution

Use D4RL wrapper (https://github.com/Farama-Foundation/D4RL) to download and load the dataset ready for training using simple python commands

Alternatives

For larger datasets it maybe best to download the files partially and then delete them as training progressing while simultaneously downloading remaining data

Additional context

Add any other context or screenshots about the feature request here.

Checklist

  • I have had an initial discussion with @vmoens
  • Get familiar with TorchRL and GenDGRL Dataset
  • Create a wrapper to download and load the dataset
@braj29 braj29 added the enhancement New feature or request label Nov 7, 2023
@vmoens
Copy link
Contributor

vmoens commented Nov 7, 2023

Here too, I'd rather not use anything D4RL-based. The library is 100% unmaintained, and it's a disaster to install. I believe we have everything we need in-house to build this. Have a look at how torchvision does the data download and extraction, and feel free to copy paste parts of their code if needed!
https://github.com/pytorch/vision/tree/main/torchvision/datasets

@braj29
Copy link
Author

braj29 commented Nov 8, 2023

Thanks a ton @vmoens ! I will take a look at how they have used torchvision datasets and do it that way

@vmoens
Copy link
Contributor

vmoens commented Mar 5, 2024

Closed by #1773

@vmoens vmoens closed this as completed Mar 5, 2024
@sr1998
Copy link

sr1998 commented May 29, 2024

I have had problems uncompressing the dataset files and have not only used torchrl but also some custom methods of doing it. The error I get is: ReadError: not an lzma file

After manually extracting the files, it seems to not be possible to read the files and the content of the files seem to be inaccessible.

OS: Windows

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy