■はてなブックマーク一行スクレイピング

実行すると、各記事を

{

　title:記事タイトル,

　url:記事URL,

　users:ブクマ数,

　tags:[タグ]

}

の形式に変換し、500ブクマ以上でフィルタし、ブクマ数降順で返す。

#一行版

curl -s https://b.hatena.ne.jp/hotentry/it | pup --charset utf-8 'div.entrylist-contents-main json{}' | jq -r '[.[] | {title: (.. | select(.class? == "entrylist-contents-title") | .children[].title), url: (.. | select(.class? == "entrylist-contents-title")) | .children[].href, users: (.. | select(.class? == "entrylist-contents-users") | .children[].children[].text | tonumber), tags: ([.. | select(.class? == "entrylist-contents-tags") | .children[]?.children[]?.text])}] | unique | map(select(.users ＞= 500)) | sort_by(.users) | reverse'

#変数版

title='title: (.. | select(.class? == "entrylist-contents-title") | .children[].title)'
users='users: (.. | select(.class? == "entrylist-contents-users") | .children[].children[].text | tonumber)'
url='url: (.. | select(.class? == "entrylist-contents-title")) | .children[].href'
tags='tags: ([.. | select(.class? == "entrylist-contents-tags") | .children[]?.children[]?.text])'
target='https://b.hatena.ne.jp/'
hotentry='hotentry/it'
curl -s $target$hotentry | ￥
pup --charset utf-8 'div.entrylist-contents-main json{}' | ￥
jq -r "[.[] | {${title}, ${url}, ${users}, ${tags}}] | unique | map(select(.users ＞= 500)) | sort_by(.users) | reverse"

Permalink | 記事への反応(0) | 20:57

ツイートシェア