Commit Graph
59 Commits
Author SHA1 Message Date
Kikimanox e95d534e78 Added deleting finished/not started jobs. Modified code to work with new ATEapi docker 2022-10-24 16:54:58 +02:00
Kikimanox 21fa8542c9 Added async version of izlusciPoIskanju 2022-10-19 11:24:59 +02:00
Kikimanox 7682cd0e0a popravljen json, swagger, oss_controller, da se ujema z novo strukturo zahtev 2022-10-19 10:39:30 +02:00
Marko Ferme 94b04a2922 oblika fix 2022-10-19 10:12:15 +02:00
Marko Ferme 107e5fd4d3 Dodani popravki za iskanje kandidatov in števila besedil. Dodana logika za klicanje ocrja. Popravljen bug za timeout v ateapi-ju. Popravljen swager. 2022-10-19 04:07:15 +02:00
Marko Ferme d44a268b24 Merge remote-tracking branch 'origin/main' 2022-10-19 00:06:38 +02:00
Marko Ferme aefb4800c8 db connection and oss file count 2022-10-19 00:01:34 +02:00
Kikimanox acb028073a Added additional error handling to job related functionalities. (Formatted file in db_utils, which might cause a merge conflict, just override my file later) 2022-10-18 22:48:51 +02:00
Marko Ferme 8ffa85cd76 mariadb update 2022-10-18 19:58:04 +02:00
Kikimanox 82718d71bb lets not use localhost on the server 2022-10-18 19:25:05 +02:00
Kikimanox f89b84dd31 extract method (async) 2022-10-18 19:24:38 +02:00
Kikimanox 673a83691b Improved extract method to work properly (sync) 2022-10-18 19:08:41 +02:00
Marko Ferme abf79be4c8 tika update 2022-10-18 12:26:16 +02:00
Kikimanox 5833dfafc8 Preperation for merging multiple conllus, also added ATE files 2022-10-18 10:07:01 +02:00
Kikimanox be84cdae1b No need for two datetime imports, whoops 2022-09-20 00:05:02 +02:00
Kikimanox ac35026577 Typo 2022-09-19 23:50:57 +02:00
Kikimanox 916b2bef2a implemented the rest of the async functions and changed the way multithreading works 2022-09-19 17:11:59 +02:00
Kikimanox 9e82f3b93a updated endpoint definitions/names and reformatted some files and code 2022-09-14 16:40:29 +02:00
Kikimanox 0b90b6555b forgot to remove temp wrong name 2022-09-01 18:33:46 +02:00
Kikimanox 729dfb14cf Added two more async endpoints (temporary implementation) 2022-09-01 18:30:58 +02:00
Kikimanox fcf192b00b Made text extraction methods more generic for re-use in other modules/files (should probably move these into some utils file) 2022-09-01 18:26:03 +02:00
Kikimanox 0da8332426 Rename: oznaciBesedilo -> oznaciBesediloAsync 2022-09-01 17:34:16 +02:00
Kikimanox 93aba45e6a Dodane backup metode, ce bi slucajno padla tika. 2022-09-01 17:33:55 +02:00
Kikimanox 511118f4d7 no need for uncommented maria db if this wont be ran otuside of the docker 2022-08-31 18:37:23 +02:00
Kikimanox 63099da8c9 reverting most useless attempts at trying to make this work 2022-08-31 18:34:51 +02:00
Kikimanox 621b047ebb forgot to remove dot 2022-08-31 18:14:31 +02:00
Kikimanox c4558242e1 time to try running it without docker instead 2022-08-31 18:00:44 +02:00
Kikimanox 7d4aceb457 reverted attempted workarounds back to initial state 2022-08-31 17:39:46 +02:00
Kikimanox cf8e217c82 Will this workaround maybe work on the server? 2022-08-31 17:27:19 +02:00
Kikimanox bb4adeee2e testing 2022-08-31 16:39:15 +02:00
Kikimanox 55ea46397f maybe this will work, because it works locally... 2022-08-31 16:33:40 +02:00
Kikimanox 80a9b9638b seems like "http://tika:9999/tika" endpoint doesn't want to work, lets see if "http://localhost:9999/tika" works..? 2022-08-31 16:24:51 +02:00
Kikimanox 0561fd03af changed the way tika runs in docker-compose.yml, port 9998 already taken on the server currently 2022-08-31 16:20:04 +02:00
Kikimanox a8319072f8 Trying to figure out how to run this without messing up Ivan's Tika instance 2022-08-31 15:52:54 +02:00
Kikimanox 8b974c7b55 back to 9998 2022-08-31 15:45:22 +02:00
Kikimanox 500e5aa2a5 Different tika port since 9998 is already in use 2022-08-31 15:42:19 +02:00
Kikimanox f16c78bbdc Dodana endpointa za sync pridobivanje connlu-jev, ali preprosto file -> text, ali file -> ocr -> text. 2022-08-31 15:37:04 +02:00
Kikimanox c30b014a68 Dodana tika & format (v swagger definiciji se ni nic novega v tem commitu) 2022-08-31 14:49:47 +02:00
Marko Ferme 5a87193490 Hitri popravki in navodila 2022-08-31 06:52:47 +02:00
Kikimanox fedb72f1d7 does this path change work? 2022-08-29 23:43:37 +02:00
Kikimanox dfe2f08b84 debug 2022-08-29 23:36:07 +02:00
Kikimanox 5bdba94035 limit ngrams to 200 because this temporary implementation is kind of slow 2022-08-29 23:35:22 +02:00
Kikimanox 246c60de02 attachment_filename -> download_name 2022-08-29 23:31:59 +02:00
Kikimanox c8586513a9 Added new logic (temporary logic for getting files by search) and converting from files to txt 2022-08-29 22:53:49 +02:00
Kikimanox dd42b56c28 PYTHONUNBUFFERED=1 helped, but the main problem was not being able to connect to mariadb... 2022-08-29 16:42:27 +02:00
Kikimanox 1f2c9161fb will this workaround work....? 2022-08-29 16:36:07 +02:00
Kikimanox 7360c41099 will this workaround work...? 2022-08-29 16:29:20 +02:00
Kikimanox ba944cfac0 debug info 2022-08-29 16:20:25 +02:00
Kikimanox 15fc2e0f62 fixed docker specific paths so that everything works... 2022-08-29 15:20:21 +02:00
Kikimanox 4be3ace842 tmp debug info 2022-08-29 14:02:59 +02:00