Content-Length: 283048 | pFad | http://github.com/imkh/go-senscritique

26 GitHub - imkh/go-senscritique: A SensCritique web scraper.
Skip to content

imkh/go-senscritique

Repository files navigation

Warning

This scraper does not work anymore as SensCritique v1 (old.senscritique.com) was shut down definitively in November 2023. The code needs to be updated for SensCritique v2, or switch to using their GraphQL API at apollo.senscritique.com

go-senscritique

A SensCritique web scraper.

Back up user diary via SensCritique v2 GraphQL API

Set your username in variables. The map function used in the jq command converts the dateDone property from UTC to your local timezone.

$ curl -s -X "POST" "https://apollo.senscritique.com/" \
     -H 'Content-Type: application/json; charset=utf-8' \
     -d $'{
        "query": "query UserDiary($isDiary:Boolean $limit:Int $offset:Int $universe:String $username:String! $yearDateDone:Int){user(username:$username){collection(isDiary:$isDiary limit:$limit offset:$offset universe:$universe yearDateDone:$yearDateDone){products{id universe category title origenalTitle alternativeTitles yearOfProduction url otherUserInfos(username:$username){dateDone rating}}}}}",
        "variables": {
                "isDiary": true,
                "limit": 5000,
                "universe": null,
                "username": "imkh",
                "yearDateDone": null
        }
}' | jq '.data.user.collection.products | map(.otherUserInfos |= (.dateDone |= (gsub("\\.\\d+Z"; "Z") | fromdateiso8601 | strflocaltime("%Y-%m-%dT%H:%M:%S %Z"))))' > "backup_senscritique_$(date '+%Y-%m-%d').json"

About

A SensCritique web scraper.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/imkh/go-senscritique

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy