Jordan Petridis
e6b0cfccb5
Apply clippy suggestions.
2018-01-19 10:32:25 +02:00
Jordan Petridis
9dc555cad7
Feed: Add an index_async implementation.
2018-01-18 18:57:44 +02:00
Jordan Petridis
1394366f91
hammond-data: Delete some dead code.
2018-01-18 17:04:57 +02:00
Jordan Petridis
6abf2535b0
hammond_data: Make index a trait that requires Insert + Update.
2018-01-18 16:33:07 +02:00
Jordan Petridis
098c5755b0
hammond-data: Do batch indexing of new_episodes.
2018-01-18 13:47:40 +02:00
Jordan Petridis
93372a30d0
1.21 Gigawatts. Remove non-future indexing loop.
...
Tried to have a seperate futures loop but it's too confusign having
too write a Trait2, functon2, etc version of everything and keep it together.
Futures are functional sort of, so the synchronous versioun can be removed.
It still needs a ton of work though to be ready, or even get near the perf
of of the sync+rayon version.
2018-01-18 11:38:24 +02:00
Jordan Petridis
574cfae5c6
rustfmt: enable reorder imports.
2018-01-17 08:57:02 +02:00
Jordan Petridis
e707087e72
hammond_data: Split models::queriables into multiple modules.
2018-01-17 08:45:14 +02:00
Jordan Petridis
3a6f6d8931
hammond_data: Split models::insertables into multiple modules.
2018-01-17 08:27:39 +02:00
Jordan Petridis
3766db2b14
hammond_data: Move parse_podcast into a NewEpisode method.
2018-01-17 07:31:24 +02:00
Jordan Petridis
8174fe0bac
hammond_data: Move parse_episode from parser into a NewEpisode method.
2018-01-17 07:16:59 +02:00
Jordan Petridis
978e5a61f6
Dbquerries: add EXIST querries for podcast and episode.
2018-01-16 17:26:41 +02:00
Jordan Petridis
fa03c20b00
Feed: add parse_channel_items_future method.
2018-01-16 14:52:20 +02:00
Jordan Petridis
b3460b15a2
hammond_data::Feed: add parse_podcast_future method.
2018-01-16 13:44:33 +02:00
Jordan Petridis
7f78e87551
hammond_data::Feed: Remove unused parts.
2018-01-16 12:35:08 +02:00
Jordan Petridis
3358fcd0b3
hammond_data::Feed: general cleanup of no longer needed stuff.
2018-01-15 11:03:40 +02:00
Jordan Petridis
1031315cdd
Getting somewhere?
2018-01-14 06:37:47 +02:00
Jordan Petridis
e4d77a6ba4
Cleanup the id() method mess of the diesel models.
2018-01-13 07:46:56 +02:00
Jordan Petridis
ee9cede921
hammond_data: Remove Source dependancy from Feed struct.
2018-01-13 06:08:51 +02:00
Jordan Petridis
785a5f80c6
hammond-data::utils: Small and minor refactor.
2017-12-31 01:42:28 +02:00
Jordan Petridis
ca06a16bd9
Closes #2 . Kudo to @jwykeham for the fix!.
2017-12-29 02:45:02 +02:00
Jordan Petridis
bfb74c4dba
hammond-data: Index_loop does not wait for GET request to finish now.
2017-12-26 18:18:48 +02:00
Jordan Petridis
b528c48e3b
Run rustfmt.
2017-12-09 05:57:16 +02:00
Jordan Petridis
74a1aae168
Upgraded diesel to 0.99 and switched from the git master into crated.io.
...
Also did a cargo upgrade of all the dependancies.
Notable upgrades are r2d2, lazystatic 1.0, loggerv 0.6 and rss 1.2
2017-12-02 01:39:28 +02:00
Jordan Petridis
e4a7a7becf
Add module Doc comments.
2017-11-28 09:38:05 +02:00
Jordan Petridis
34e808182c
Documented a bit hammond-data/src/feed.rs.
2017-11-27 06:06:14 +02:00
Jordan Petridis
cb65782829
Extended the NewModel builder and added a bunch of unit tests.
2017-11-27 04:32:21 +02:00
Jordan Petridis
ee4f08c5cf
Implemented a BuildPattern for NewModels. Swiched stuff to pub(crate).
...
Added a Constructor for NewModels in order to make their fields private.
Also added getter methods that are mainly used in Unit tests.
2017-11-26 23:30:56 +02:00
Jordan Petridis
866904a687
Use generic IntoIterator instead of &[foo] slices.
2017-11-26 07:03:21 +02:00
Jordan Petridis
9d0df9de46
Tweak cargo privacy settings.
2017-11-26 06:21:14 +02:00
Jordan Petridis
ce3a76aee1
Update episode rows instead of replacing them.
2017-11-26 00:13:51 +02:00
Jordan Petridis
f83f894e44
Replaced pool.get().unwrap() statements with get()?.
2017-11-25 03:29:06 +02:00
Jordan Petridis
f0a0fdfa83
Added a truncate_db helper function.
2017-11-25 03:01:21 +02:00
Jordan Petridis
d9ef4fed53
Truncate the temp db before running test_complete_index. Should close #17 .
2017-11-24 20:31:10 +02:00
Jordan Petridis
f7f0a16858
Minor cleanup.
2017-11-24 19:28:34 +02:00
Jordan Petridis
91f4a30c01
Moved episode indexing into a transaction.
2017-11-23 21:30:17 +02:00
Jordan Petridis
5570fdd118
Switched to using r2d2 instead of a databaseConnection object.
2017-11-23 21:09:50 +02:00
Jordan Petridis
aa7c493e81
hammond-data/src/feed.rs api changes.
2017-11-23 18:48:41 +02:00
Jordan Petridis
31328355b1
Methods renaming, Api changes.
2017-11-22 06:25:34 +02:00
Jordan Petridis
9bc6df2cba
Made Disel NewModels private.
2017-11-22 05:50:25 +02:00
Jordan Petridis
7be0b5bbf8
Added a url cleanr. Closes #4 .
2017-11-20 22:06:29 +02:00
Jordan Petridis
0ce4107be4
Revert back to using an Arc<Mutex<Connection>> instead of the pool.
2017-11-20 18:09:53 +02:00
Jordan Petridis
ce29602431
I hate everything.
2017-11-20 16:57:27 +02:00
Jordan Petridis
55442529a8
Initial switch to using r2d2.
2017-11-19 22:06:10 +02:00
Jordan Petridis
a6dbf65575
Move stuff from hammond_data/src/lib.rs into utils.
2017-11-18 20:55:19 +02:00
Jordan Petridis
563f249a48
Reverted index_channel items to the synchronous version.
...
Using a transaction yields ~1/3 better performance as of now.
2017-11-18 19:57:50 +02:00
Jordan Petridis
5c84b77434
Converted iter_mut into into_iter wherever possible.
2017-11-18 19:23:25 +02:00
Jordan Petridis
494761beaf
Removed id function from diesel models.
...
It's automaticly declared upon derive identifiable,
And there's no need to overwrite it.
2017-11-18 15:23:40 +02:00
Jordan Petridis
1bf5187e48
Renamed hammond-data/src/feedparser.rs module into parser.rs.
2017-11-18 15:05:55 +02:00
Jordan Petridis
6894f33895
Renamed hammond-data/src/index_feeds.rs module into feed.rs.
2017-11-18 14:32:58 +02:00
