pta
/
WeatherNews.jl
forked from gg/WeatherNews.jl
1
0
Fork 0
Code Pull Requests Activity
268 Commits 1 Branch 0 Tags 622 KiB
Commit Graph

268 Commits

Author SHA1 Message Date
pta cb105176b2 Add cron job to make final view count update after exactly 10 days 
This cron job will run twice per live WNL segment to update the view
count of the stream from exactly 10 days ago. This gives every stream
exactly the same amount of time to mature before we record its view
count for the last time. Ten days gives even notable streams plenty of
time to get most of its views before the rewatch per day rate drops to
nearly nothing.
 2024-05-09 12:46:16 -04:00
pta bca7133795 Ensure every WNL row in schedule table gets assigned its video 
Now every caster schedule entry will get assigned data from its
corresponding video, no matter what unusual scheduled time it has.

Videos are known well advance, so updating every 3 hours, or once per
stream, should be enough to record new streams, even if the youtube json
request fails once or twice.

Upcoming streams are now assigned a null rather than 0 view count so
zeros aren't accidentally included in view count calculations.

Upcoming streams now have their jst derived from their start time rather
than titles, in case staff initially makes a copy-paste error to the
title.
 2024-05-09 12:44:36 -04:00
pta ebff641a0a Bump youtube streams request up to 30 
Momo's Sunshine stream on 2024-05-03 got buried under 25 newer streams
just before the cron job could record its view count after it got
unprivatized. A cutoff at 30 should always be ample enough.
 2024-05-08 22:16:55 -04:00
gg1234 e2754fb4c5 Add PlotlyJS as a dependency 2024-04-29 02:39:22 -07:00
gg1234 41f8cfd0ae Transform jst into ZonedDateTimes 2024-04-29 02:38:57 -07:00
gg1234 4fb138e52b Add WeatherNews.Helpers 
- Also export jst2zdt(str) helper function.
 2024-04-29 02:37:52 -07:00
gg1234 6d03c43365 Rename seg.n AS segment instead of title 2024-04-28 10:52:36 -07:00
gg1234 2fc0a8abf5 Insert au PAY shows for 2024-05 2024-04-28 10:51:55 -07:00
gg1234 9c34758578 Count appearances grouped by caster, month, and segment 2024-04-28 10:51:14 -07:00
gg1234 f6945e507a Add view_count to big joined SELECT example 2024-04-28 10:49:37 -07:00
gg1234 6428bae369 Add Plots as a dependency 2024-04-25 01:09:37 -07:00
gg1234 f3429e0101 Filter out view_count == 0 
This makes the Julia results consistent with the SQL results.
 2024-04-23 18:05:05 -07:00
gg1234 9815bc259d Add DB.load_schedule_joined(db) 
Load the schedule data into a DataFrame that can be explored with Julia
 2024-04-23 17:45:05 -07:00
gg1234 2bf95ca33a Add some queries that explore schedule.view_count 2024-04-23 17:44:19 -07:00
gg1234 172c25be6c Add DataFramesMeta as a dependency 2024-04-23 17:42:52 -07:00
gg1234 2eccd4a454 Align views column to the right 2024-04-23 07:55:36 -07:00
gg1234 d29801585a Add a `views` column to the schedule display 2024-04-23 02:17:18 -07:00
gg 4fe3e10656 Merge pull request 'Mention yt-dlp in README and start recording view counts' (#10) from pta/WeatherNews.jl:main into main 
Reviewed-on: gg/WeatherNews.jl#10
 2024-04-23 02:51:25 +00:00
pta 2d1c05baa4 Start recording view counts in schedule table 2024-04-19 18:21:28 -04:00
pta d352ebbc17 Document yt-dlp dependency and update docstring 2024-04-18 18:24:31 -04:00
gg b4fbc705ed Merge pull request 'Get video ids from youtube with yt-dlp' (#8) from pta/WeatherNews.jl:yt-dlp into main 
Reviewed-on: gg/WeatherNews.jl#8
 2024-04-17 23:18:48 +00:00
pta 63b1f54515 Get video ids from youtube with yt-dlp 
For two reasons:
1. Youtube is the primary source.
   Apparently staff manually copies the video id youtube gives them,
   since they sometimes forget to update their json. With this commit,
   I'm practically implementing the automation they should have
   implemented themselves.
2. Make links available ahead of time for convenience.
   Currently on our site, links aren't available until the moment the
   program starts. So in practice, I have to open youtube to copy the
   next stream's url for playing in mpv, lest I miss the first several
   seconds of the show. (I know staff puts the next stream's link in
   chat, but since it's manual, occasionally they forget, and the url is
   usually in "/live/" rather than "/watch?v=" format: the latter makes
   clearer screenshot filenames, imo.

yt-dlp becomes a required dependency. The same information could be
sourced with Julia code to scrape an invidious instance, but that would
incur more code to produce the same array of per-video dictionaries,
which could be desireable later as exercise in Julia.
 2024-04-17 13:37:00 -04:00
gg1234 82ff0f95f3 Ignore au PAY when figuring out caster's last appearance 2024-04-16 18:09:57 -07:00
gg1234 60ef78df99 Align columns 2024-04-16 16:59:36 -07:00
gg1234 0e1cd80098 More au PAY updates 2024-04-16 16:59:27 -07:00
gg1234 b4ae9e0e50 Add link to post that started the conversation about gaps 2024-04-13 08:09:44 -07:00
gg1234 5ba57b2fad Add many queries for finding gaps between appearances 2024-04-13 08:05:04 -07:00
gg1234 0ba825e945 Add video_id for Senna's next au PAY show 2024-04-11 09:28:37 -07:00
gg1234 092db136d0 Add 2024-04 schedule for au PAY 2024-03-29 13:50:42 -07:00
gg1234 c601e39c41 Bump LIVE_SEARCH_LIMIT to 22 2024-03-15 03:10:21 -07:00
gg1234 745daf3da0 Add a query for finding most recent appearance by caster 2024-03-13 08:25:52 -07:00
gg1234 96038bef34 Add more au PAY shows for 2024-03 2024-03-11 15:54:24 -07:00
gg1234 34ad772719 Add au PAY shows for 2024-03 2024-03-06 05:39:55 -08:00
gg1234 82923a49b4 Add video_id for Mi-chan's upcoming au PAY show 2024-02-24 21:10:55 -08:00
gg1234 e613e5486f Fix a bunch of video_ids 
JSON-STAFF-SAN!!!
 2024-02-20 21:57:18 -08:00
gg1234 7e22d20bb9 Add video_id for Rinon's upcoming au PAY show on 2/19 2024-02-14 15:54:28 -08:00
gg1234 a5e29317c9 Add video_ids for upcoming au PAY shows 2024-02-07 14:40:33 -08:00
gg1234 82d7345a06 Add au PAY shows for 2024-02 2024-01-30 23:59:16 -08:00
gg1234 8dafb9ce1b Add video_ids for Yui and Mizuki's upcoming au PAY streams 2024-01-20 14:39:23 -08:00
gg1234 d82ea8bf79 Add a query for finding days casters had to cover for eachother 2024-01-11 16:04:11 -08:00
gg1234 905d66aefb Add video_ids for upcoming au PAY streams 2024-01-10 03:44:42 -08:00
gg1234 397b9de8bf Add au PAY shows for 2024-01 2024-01-04 05:37:12 -08:00
gg1234 1c1d9a9552 See if julia-repl syntax works in README 2023-12-29 07:52:51 -08:00
gg1234 8eea6012ed Add year end au PAY shows 2023-12-21 17:42:19 -08:00
gg1234 52e2cbcf00 Add au PAY show for Senna 2023-12-20 04:52:27 -08:00
gg1234 3bf068d148 Remove unused domains; stick to vern 2023-12-18 18:08:46 -08:00
gg1234 de66681973 Merge branch 'main' of ssh://vern.cc:1813/gg/WeatherNews.jl 2023-12-06 01:33:03 -08:00
gg1234 0a299d9d0e Add upcoming au PAY for Ayaka 2023-12-06 01:31:39 -08:00
gg1234 28f05627b6 Fill in some missing schedule data 2023-11-30 23:00:07 -08:00
gg 9ebf3c7b9c Update links 2023-11-28 00:07:26 +00:00