toxblh/podcasts
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
1,183 Commits 6 Branches 16 Tags
5b8b2653713e6d81ef14b196b767f3bb0b2c76ff
Commit Graph
371 Commits
Author SHA1 Message Date
Jordan Petridis 1625f773c2 hammond-data: Fix PartialEq implementations, add NewPodcast.insert unit test. 2018-01-21 08:39:50 +02:00
Jordan Petridis da8c3a7827 Implement PartialEq accross Insertable and Queryable diesel models. 2018-01-20 19:09:25 +02:00
Jordan Petridis 6c9e0984a5 Migrate podcast tests to use the internet archive snapshots. 2018-01-20 18:02:07 +02:00
Jordan Petridis df17a10014 Source: refactor into_feed test. 2018-01-20 16:43:32 +02:00
Jordan Petridis ef52a026bc Feed: Add Builder pattern. 2018-01-20 08:46:05 +02:00
Jordan Petridis 7d9781052f hammond-data: Rework the modules privacy. 2018-01-20 07:28:30 +02:00
Jordan Petridis 855b1517a7 Feed: Removee unimplemented! hack to guard against my future stupidity. 2018-01-19 19:20:21 +02:00
Jordan Petridis 1606ceaadb Source: split response_to_channel into more futures. 2018-01-19 16:29:50 +02:00
Jordan Petridis 46b6c0d27e hammond-data: Remove leftover synchronous code. 2018-01-19 15:41:37 +02:00
Jordan Petridis b92ba7be76 Switch from libtest to criterion.rs for benchmarks. 2018-01-19 14:32:43 +02:00
Jordan Petridis 44dbb06dcc Add benchmarks for the async path. 2018-01-19 13:15:21 +02:00
Jordan Petridis e6b0cfccb5 Apply clippy suggestions. 2018-01-19 10:32:25 +02:00
Jordan Petridis 5c5faafc72 Source: Move around code and change some methods signature. 
request_constructor is now a Source method.
update_etags now takes &mut self instead of mut self.
update_etags now uses source setters methods instead of raw fields.
changed the naming of into_feed to to_feed according to rust convention.
 2018-01-19 07:51:55 +02:00
Jordan Petridis 9dc555cad7 Feed: Add an index_async implementation. 2018-01-18 18:57:44 +02:00
Jordan Petridis 1394366f91 hammond-data: Delete some dead code. 2018-01-18 17:04:57 +02:00
Jordan Petridis 6abf2535b0 hammond_data: Make index a trait that requires Insert + Update. 2018-01-18 16:33:07 +02:00
Jordan Petridis 1c96288178 hammond_data: Add more benchmark cases. 2018-01-18 15:50:48 +02:00
Jordan Petridis 098c5755b0 hammond-data: Do batch indexing of new_episodes. 2018-01-18 13:47:40 +02:00
Jordan Petridis 93372a30d0 1.21 Gigawatts. Remove non-future indexing loop. 
Tried to have a seperate futures loop but it's too confusign having
too write a Trait2, functon2, etc version of everything and keep it together.

Futures are functional sort of, so the synchronous versioun can be removed.
It still needs a ton of work though to be ready, or even get near the perf
of of the sync+rayon version.
 2018-01-18 11:38:24 +02:00
Jordan Petridis 5d88998180 hammond_data: Add an EpisodeMinimal Diesel model. 2018-01-17 10:21:16 +02:00
Jordan Petridis 574cfae5c6 rustfmt: enable reorder imports. 2018-01-17 08:57:02 +02:00
Jordan Petridis e707087e72 hammond_data: Split models::queriables into multiple modules. 2018-01-17 08:45:14 +02:00
Jordan Petridis 3a6f6d8931 hammond_data: Split models::insertables into multiple modules. 2018-01-17 08:27:39 +02:00
Jordan Petridis 3766db2b14 hammond_data: Move parse_podcast into a NewEpisode method. 2018-01-17 07:31:24 +02:00
Jordan Petridis 8174fe0bac hammond_data: Move parse_episode from parser into a NewEpisode method. 2018-01-17 07:16:59 +02:00
Jordan Petridis bd9844f012 Dbquerries: Use map_err() instead of ? into Ok() pattern. 2018-01-17 07:13:34 +02:00
Jordan Petridis f64779f70a Parser: Add NewEpisodeMinimal struct. 
Parsing whole episodes can be expensive and we only need
a subset to determine if it should be indexed/updated or ignored.
 2018-01-16 18:33:32 +02:00
Jordan Petridis 978e5a61f6 Dbquerries: add EXIST querries for podcast and episode. 2018-01-16 17:26:41 +02:00
Jordan Petridis fa03c20b00 Feed: add parse_channel_items_future method. 2018-01-16 14:52:20 +02:00
Jordan Petridis bf4f655ed2 Pipeline: remove submodule hack. 2018-01-16 14:37:51 +02:00
Jordan Petridis b3460b15a2 hammond_data::Feed: add parse_podcast_future method. 2018-01-16 13:44:33 +02:00
Jordan Petridis 7f78e87551 hammond_data::Feed: Remove unused parts. 2018-01-16 12:35:08 +02:00
Jordan Petridis 3358fcd0b3 hammond_data::Feed: general cleanup of no longer needed stuff. 2018-01-15 11:03:40 +02:00
Jordan Petridis 10345ffda7 Pipeline: add matching on status code. 2018-01-15 10:16:01 +02:00
Jordan Petridis 2f7a22355f Minor cleanup of the mess. 2018-01-14 08:27:50 +02:00
Jordan Petridis e63a366fdc I don't know why the benchmarks keep cycling. 2018-01-14 06:48:42 +02:00
Jordan Petridis 1031315cdd Getting somewhere? 2018-01-14 06:37:47 +02:00
Jordan Petridis a5fd79e220 I hate futures error handling. 2018-01-13 14:47:38 +02:00
Jordan Petridis e162f8fd3f Non-working yet benchmark. 2018-01-13 08:31:16 +02:00
Jordan Petridis e4d77a6ba4 Cleanup the id() method mess of the diesel models. 2018-01-13 07:46:56 +02:00
Jordan Petridis 6517956987 This works somehow... 2018-01-13 07:09:59 +02:00
Jordan Petridis ee9cede921 hammond_data: Remove Source dependancy from Feed struct. 2018-01-13 06:08:51 +02:00
Jordan Petridis 1dd25f91fd Minor cleanup 2018-01-13 05:47:23 +02:00
Jordan Petridis 771b7b3804 Something Something futures. 2018-01-13 01:28:02 +02:00
Jordan Petridis 8e367b7e86 Dont ask me how this is working. 2018-01-12 08:50:16 +02:00
Jordan Petridis 955845110b Merge branch 'master' into 33-downloader-re-work 2018-01-09 12:06:38 +02:00
Jordan Petridis ea70addbc6 Removed some unwrap()s. 2018-01-09 09:21:07 +02:00
Jordan Petridis 345d4b3865 Check more http status codes when parsing feeds. 2018-01-08 02:41:37 +02:00
Jordan Petridis 81b1ec810c Apply clippy suggestions. 2018-01-07 08:36:02 +02:00
Jordan Petridis 074284d286 Move unsub show logic and get_download_folder func to hammond-data::utils. 2018-01-07 08:26:38 +02:00