Commit Graph
83 Commits
Author SHA1 Message Date
Jordan Petridis cbc0692482 Added an etag bypass when updating the feeds. 2017-10-05 18:29:37 +03:00
Jordan Petridis 3b4acf9fc3 Improved get_temp_db helper func. 2017-10-05 18:02:15 +03:00
Jordan Petridis dce7fc1468 Updated .gitlab-ci.yml 2017-10-05 16:24:59 +03:00
Jordan Petridis 8d17976b8a Dependancy cleanup. 2017-10-05 16:03:51 +03:00
Jordan Petridis 078331c15f Split hammond_data::errors to its own file. 2017-10-05 15:07:40 +03:00
Jordan Petridis 93027e5530 Final crate restructure I hope. 2017-10-05 15:02:19 +03:00
Jordan Petridis 77797ee027 More crate splitting. 2017-10-05 00:22:05 +03:00
Jordan Petridis bf9e544a2b Error handling cleanup. 2017-10-04 23:51:53 +03:00
Jordan Petridis f25ce64e34 Initial split into workspaces in order to be more flexible. 2017-10-04 22:41:17 +03:00
Jordan Petridis 98f7f6e37a I hate everything. 2017-10-04 12:20:07 +03:00
Jordan Petridis 3e2471953b Revert "Codecov take 2."
This reverts commit 693def007a.
2017-10-04 12:16:23 +03:00
Jordan Petridis 693def007a Codecov take 2. 2017-10-04 11:49:41 +03:00
Jordan Petridis b6879f82b6 Added some, lacking but better than nothing, integration tests. 2017-10-04 11:45:13 +03:00
Jordan Petridis 1b69fd5091 Re enable codecov integration. 2017-10-04 10:11:46 +03:00
Jordan Petridis f6d8f52a92 Added a really crappy ui. 2017-10-03 20:49:26 +03:00
Jordan Petridis af60949e65 Merged cli.rs to main.rs 2017-10-03 14:59:51 +03:00
Jordan Petridis 1dddd237c8 Implemeted .part for the downloader. 2017-10-03 14:43:51 +03:00
Jordan Petridis 828a12054d Initial local_uri suppoer for the downloader. 2017-10-03 13:49:32 +03:00
Jordan Petridis d5c4b13b4d Added limit option for dbquerries::latest_dl. 2017-10-03 12:29:40 +03:00
Jordan Petridis fc693a569b Sort of works atm. 2017-10-03 12:01:01 +03:00
Jordan Petridis fe7ef323c4 Building on stable too now. 2017-10-02 19:42:38 +03:00
Jordan Petridis 6b689f4635 Seperated the pipelines for nightly and stable rust builds. 2017-10-02 19:03:29 +03:00
Jordan Petridis e02edfd53b Testing gitlab-ci configs. 2017-10-02 18:57:05 +03:00
Jordan Petridis cdab10b016 Disable codecov integration. 2017-10-02 18:37:18 +03:00
Jordan Petridis f75d282f80 Initial prototype of a downloader. 2017-10-02 16:02:39 +03:00
Jordan Petridis 42cef658fc test_complete_index cleanup. 2017-10-02 11:48:58 +03:00
Jordan Petridis 10834b75dc Added test_complete_index. 2017-10-02 11:27:15 +03:00
Jordan Petridis 83964c5552 CDD, #CI_driven_development 2017-10-01 11:19:29 +03:00
Jordan Petridis a488dc6999 gitlab-ci take 3. Action. 2017-10-01 11:07:26 +03:00
Jordan Petridis 4402c6906c gitlab-ci take 2. 2017-10-01 11:04:51 +03:00
Jordan Petridis aa7e928b05 added gitlab-ci config. 2017-10-01 10:58:09 +03:00
Jordan Petridis 9251b21bc5 More splitting. 2017-10-01 10:57:22 +03:00
Jordan Petridis 6bf65f2d92 Split complete_index_source into higher order functions. 2017-10-01 10:13:45 +03:00
Jordan Petridis f70f707a69 Replaced annoying let _ = map/collect; paterns with for_each 2017-10-01 09:17:19 +03:00
Jordan Petridis 108f667d47 Created a tempdb helper function for the tests. 2017-10-01 09:11:26 +03:00
Jordan Petridis 40af418d73 Added License. 2017-09-30 22:39:31 +03:00
Jordan Petridis 1ca6c50fb1 code cleanup, initial index_feed.rs tests. 2017-09-30 22:39:08 +03:00
Jordan Petridis 108ed34b40 Some code cleanup. 2017-09-29 20:45:47 +03:00
Jordan Petridis 07d3135d91 Factored out rfc822 sanitization to its own crate, also fucked up a bit some of the NewEpisode and Episode api's. 2017-09-28 13:47:41 +03:00
Jordan Petridis b2d4414d4d Regex and Datetimes just to torture my future self. 2017-09-27 13:31:30 +03:00
Jordan Petridis 53a5004122 Ooh, The things I do for datetiems. 2017-09-27 10:40:14 +03:00
Jordan Petridis 5a2355b686 Par_Iter all the things! 2017-09-26 13:38:43 +03:00
Jordan Petridis e61044aebb Rayon is so nice. 2017-09-26 13:16:11 +03:00
Jordan Petridis ea15e6aa63 Initial split of fetch_feeds. 2017-09-26 12:35:40 +03:00
Jordan Petridis 580aeba095 Split indexing functions to higher order funcs. 2017-09-26 11:06:22 +03:00
Jordan Petridis 6c25bd7eaa Some cleanup. 2017-09-26 10:44:25 +03:00
Jordan Petridis a0064fcb4f Playing around with rayon. 2017-09-26 10:21:37 +03:00
Jordan Petridis e1cc4f0d9f Broken implementation of etag/last_mod request. 2017-09-23 15:07:13 +03:00
Jordan Petridis d76d367a9c Initial refactor of the index/update loop. 2017-09-23 12:53:34 +03:00
Jordan Petridis b2ac9685ff Compare fields before indexing. 2017-09-23 11:24:54 +03:00
Jordan Petridis a3e47effb4 Pre-commit cargo test and cargo fmt hook test. 2017-09-23 10:12:48 +03:00
Jordan Petridis d2e9c5fcbe More rustfmt stuff. 2017-09-23 09:52:32 +03:00
Jordan Petridis 874d33c1f4 Setup of Rustfmt and rustfmt.toml config file. 2017-09-23 09:06:15 +03:00
Jordan Petridis 2c1f66f85f Fixed The breakthrough rss feed and updated some unit tests. 2017-09-22 16:50:52 +03:00
Jordan Petridis 17fe120299 Datetime formats... 2017-09-22 16:36:46 +03:00
Jordan Petridis 68d185b7ef I hate daytimes with a passion. 2017-09-22 15:26:21 +03:00
Jordan Petridis dad74dc706 Fixed epoch implementation for episode. 2017-09-22 14:10:13 +03:00
Jordan Petridis cc353c120e Refactored Setter methods for the diesel models. 2017-09-22 13:06:33 +03:00
Jordan Petridis 709a3e555d Fixed the setters of the diesel querable structs, WIP of etag update refactoring. 2017-09-22 12:17:12 +03:00
Jordan Petridis 68e9098d83 More unit tests. 2017-09-21 13:12:36 +03:00
Jordan Petridis 5598740fd5 Split the unit test monolyths to per-feed tests. 2017-09-21 12:49:14 +03:00
Jordan Petridis aefc237296 index_podcast/episode/source now also return the row they indexed. 2017-09-21 11:50:52 +03:00
Jordan Petridis 78a892b4be Setters and getters, and decoupling of insert and update logic for Episode struct. 2017-09-21 11:44:28 +03:00
Jordan Petridis 5dc6c002fe Prototype of decoupled insert and update logic for podcast struct. 2017-09-21 10:29:06 +03:00
Jordan Petridis 356cc54ba1 Initial prototype of decoupling insert/update logic. 2017-09-21 09:57:55 +03:00
Jordan Petridis 6b4b772462 Renamed parse_feeds.rs to feedparser.rs 2017-09-21 08:33:45 +03:00
Jordan Petridis 870e37e5b1 Updated test_parse_episode and TheBreakthrough xml feed file. 2017-09-21 07:31:29 +03:00
Jordan Petridis 64ed1790ce Getting there. 2017-09-21 06:35:22 +03:00
Jordan Petridis 5187bd1f32 Schema tweaks of the episodes table. 2017-09-20 13:36:55 +03:00
Jordan Petridis 159ac4cd5d Finally getting somewhere. 2017-09-19 14:16:40 +03:00
Jordan Petridis 91b314a81f Still figuring out the schema. 2017-09-19 12:16:12 +03:00
Jordan Petridis a696e60f07 I dont even know at this point. 2017-09-19 10:22:34 +03:00
Jordan Petridis fe2d8c8b52 rss Channel guarantes that some fields exist and dont need to be Option<foo>. 2017-09-19 08:33:14 +03:00
Jordan Petridis ffda7c6fc8 Trying insertable stucts that might own their data. 2017-09-19 08:15:54 +03:00
Jordan Petridis c204a61ff7 Even more schema changes. 2017-09-18 15:44:08 +03:00
Jordan Petridis 97dbab0b89 Extended test_parse_episode a bit. 2017-09-16 08:15:09 +03:00
Jordan Petridis f802e187f3 Added parse_episode and test_parse_episode functions, Added missing pubdate to db schema. 2017-09-16 07:43:46 +03:00
Jordan Petridis 1542309478 small schema fix. 2017-09-16 07:30:15 +03:00
Jordan Petridis dbe606f5d5 Extended parse_podcast_test and implemented parse_podcast. 2017-09-16 05:52:45 +03:00
Jordan Petridis dcd5a8dcb7 Initial parse_podcast_test. 2017-09-16 03:48:15 +03:00
Jordan Petridis 55a310d3a5 Initial diesel models. 2017-09-16 02:22:23 +03:00
Jordan Petridis 600415ff5d Diesel and XDG yak-shaving. 2017-09-15 04:45:25 +03:00
Jordan Petridis 44eb261b95 Initial yak shaving. 2017-09-15 03:24:17 +03:00