toxblh/podcasts
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
636 Commits 6 Branches 16 Tags
8095919bbe6790943da8e9aac584f68ab199f307
Commit Graph
238 Commits
Author SHA1 Message Date
Jordan Petridis 8095919bbe This sort of works? 2018-01-23 10:12:32 +02:00
Jordan Petridis f7f6087d70 NewPodcast: On update unit test assert .id and .source_id fields stay the same. 2018-01-22 21:09:06 +02:00
Jordan Petridis ea75d50053 NewEpisode: Add insert unit test. 2018-01-22 17:25:23 +02:00
Jordan Petridis 44d7a4e222 NewEpisodeMinimal: Add unit test for into_new_episode method. 2018-01-22 15:49:58 +02:00
Jordan Petridis 2d6f34fa4d NewEpisode: Clean up tests a bit. 2018-01-22 15:34:57 +02:00
Jordan Petridis d231cc165f Fix batch indexing. 2018-01-22 14:51:31 +02:00
Jordan Petridis 7bd361fbbb Upgrade dependancies. 2018-01-22 11:47:17 +02:00
Jordan Petridis 66e816fc5f Upgrade Diesel to 1.1 2018-01-22 11:22:01 +02:00
Jordan Petridis 20f36a67a0 Upgrade log and loggerv. 2018-01-21 15:22:13 +02:00
Jordan Petridis eb75e68b72 Fix benchmarks. 2018-01-21 14:52:21 +02:00
Jordan Petridis dc9a28c0c7 Remove xml files. 2018-01-21 14:49:54 +02:00
Jordan Petridis 843feabf25 NewEpisode: Move the parsing tests, delete old xml files. 2018-01-21 13:35:35 +02:00
Jordan Petridis 937bd61d5e NewPodcast: Add unit test for the to_podcast() method. 2018-01-21 12:17:47 +02:00
Jordan Petridis 4ee5888b7f NewPodcast: Rename into_podcast method -> to_podcast since it now does not take owenership. 2018-01-21 11:04:15 +02:00
Jordan Petridis 73eeb1b545 NewPodcast: Add NewPodcast.index unit test. 2018-01-21 10:04:53 +02:00
Jordan Petridis 16bbfb5478 NewPodcast: Add (lackign) NewPodcast.update unit test. 2018-01-21 09:35:48 +02:00
Jordan Petridis 410657c98b NewPodcast: Remove the boilerplate on the unit tests. 2018-01-21 08:57:50 +02:00
Jordan Petridis 1625f773c2 hammond-data: Fix PartialEq implementations, add NewPodcast.insert unit test. 2018-01-21 08:39:50 +02:00
Jordan Petridis da8c3a7827 Implement PartialEq accross Insertable and Queryable diesel models. 2018-01-20 19:09:25 +02:00
Jordan Petridis 6c9e0984a5 Migrate podcast tests to use the internet archive snapshots. 2018-01-20 18:02:07 +02:00
Jordan Petridis df17a10014 Source: refactor into_feed test. 2018-01-20 16:43:32 +02:00
Jordan Petridis ef52a026bc Feed: Add Builder pattern. 2018-01-20 08:46:05 +02:00
Jordan Petridis 7d9781052f hammond-data: Rework the modules privacy. 2018-01-20 07:28:30 +02:00
Jordan Petridis 855b1517a7 Feed: Removee unimplemented! hack to guard against my future stupidity. 2018-01-19 19:20:21 +02:00
Jordan Petridis 1606ceaadb Source: split response_to_channel into more futures. 2018-01-19 16:29:50 +02:00
Jordan Petridis 46b6c0d27e hammond-data: Remove leftover synchronous code. 2018-01-19 15:41:37 +02:00
Jordan Petridis b92ba7be76 Switch from libtest to criterion.rs for benchmarks. 2018-01-19 14:32:43 +02:00
Jordan Petridis 44dbb06dcc Add benchmarks for the async path. 2018-01-19 13:15:21 +02:00
Jordan Petridis e6b0cfccb5 Apply clippy suggestions. 2018-01-19 10:32:25 +02:00
Jordan Petridis 5c5faafc72 Source: Move around code and change some methods signature. 
request_constructor is now a Source method.
update_etags now takes &mut self instead of mut self.
update_etags now uses source setters methods instead of raw fields.
changed the naming of into_feed to to_feed according to rust convention.
 2018-01-19 07:51:55 +02:00
Jordan Petridis 9dc555cad7 Feed: Add an index_async implementation. 2018-01-18 18:57:44 +02:00
Jordan Petridis 1394366f91 hammond-data: Delete some dead code. 2018-01-18 17:04:57 +02:00
Jordan Petridis 6abf2535b0 hammond_data: Make index a trait that requires Insert + Update. 2018-01-18 16:33:07 +02:00
Jordan Petridis 1c96288178 hammond_data: Add more benchmark cases. 2018-01-18 15:50:48 +02:00
Jordan Petridis 098c5755b0 hammond-data: Do batch indexing of new_episodes. 2018-01-18 13:47:40 +02:00
Jordan Petridis 93372a30d0 1.21 Gigawatts. Remove non-future indexing loop. 
Tried to have a seperate futures loop but it's too confusign having
too write a Trait2, functon2, etc version of everything and keep it together.

Futures are functional sort of, so the synchronous versioun can be removed.
It still needs a ton of work though to be ready, or even get near the perf
of of the sync+rayon version.
 2018-01-18 11:38:24 +02:00
Jordan Petridis 5d88998180 hammond_data: Add an EpisodeMinimal Diesel model. 2018-01-17 10:21:16 +02:00
Jordan Petridis 574cfae5c6 rustfmt: enable reorder imports. 2018-01-17 08:57:02 +02:00
Jordan Petridis e707087e72 hammond_data: Split models::queriables into multiple modules. 2018-01-17 08:45:14 +02:00
Jordan Petridis 3a6f6d8931 hammond_data: Split models::insertables into multiple modules. 2018-01-17 08:27:39 +02:00
Jordan Petridis 3766db2b14 hammond_data: Move parse_podcast into a NewEpisode method. 2018-01-17 07:31:24 +02:00
Jordan Petridis 8174fe0bac hammond_data: Move parse_episode from parser into a NewEpisode method. 2018-01-17 07:16:59 +02:00
Jordan Petridis bd9844f012 Dbquerries: Use map_err() instead of ? into Ok() pattern. 2018-01-17 07:13:34 +02:00
Jordan Petridis f64779f70a Parser: Add NewEpisodeMinimal struct. 
Parsing whole episodes can be expensive and we only need
a subset to determine if it should be indexed/updated or ignored.
 2018-01-16 18:33:32 +02:00
Jordan Petridis 978e5a61f6 Dbquerries: add EXIST querries for podcast and episode. 2018-01-16 17:26:41 +02:00
Jordan Petridis fa03c20b00 Feed: add parse_channel_items_future method. 2018-01-16 14:52:20 +02:00
Jordan Petridis bf4f655ed2 Pipeline: remove submodule hack. 2018-01-16 14:37:51 +02:00
Jordan Petridis b3460b15a2 hammond_data::Feed: add parse_podcast_future method. 2018-01-16 13:44:33 +02:00
Jordan Petridis 7f78e87551 hammond_data::Feed: Remove unused parts. 2018-01-16 12:35:08 +02:00
Jordan Petridis 3358fcd0b3 hammond_data::Feed: general cleanup of no longer needed stuff. 2018-01-15 11:03:40 +02:00