Commit Graph
75 Commits
Author SHA1 Message Date
Kikimanox 44d4e58ec3 increased recursion limit at conllu utils since it made some files not go trough 2022-12-23 17:56:55 +01:00
Kikimanox ae9dd4c1c3 job creation no longer checks for already existing/same jobs 2022-12-22 18:31:55 +01:00
Kikimanox 3f4a298fd1 Changed the way jobs are handled, so they can be cancelled mid-operation now (doesn't work on izlusciPoIskanju currently though so cancelling that returns a different message/denial) 2022-12-22 18:31:15 +01:00
Kikimanox 27fb70987c Console error logging at unexpected errors 2022-12-22 11:45:04 +01:00
Kikimanox 120c85a2a1 Slight readme update 2022-12-06 21:57:22 +01:00
Kikimanox d3cedd47b5 'Priority que' logic implementation 2022-12-06 21:53:19 +01:00
Kikimanox 911bc8f0c9 Added mentioned post requests, made it so that the response body is a clear json (as requested) in case the response is a json, fixed decimal bug, updated swagger templates and json 2022-11-29 17:14:40 +01:00
Kikimanox 3c2577a5d6 Workaround for enabling ATEapi to work on the server, it doesn't without this 2022-11-21 12:02:58 +01:00
Kikimanox e82f5eafa6 Quick update related to job_output formatting 2022-11-21 11:42:06 +01:00
Kikimanox dd79c42c59 ATE api update 3 2022-11-11 15:45:22 +01:00
Kikimanox e9345ee887 ATE api update 2 2022-11-11 15:45:00 +01:00
Kikimanox 7b7214905a Updated so json doesn't get sorted anymore, bugfixes, added new parameter to two endpoints, docker-compose jobs saving location update, json & swagger update 2022-11-03 15:58:11 +01:00
Kikimanox fe6120fb18 Return 200 should be done without Response fix 2022-10-24 18:54:39 +02:00
Kikimanox e95d534e78 Added deleting finished/not started jobs. Modified code to work with new ATEapi docker 2022-10-24 16:54:58 +02:00
Kikimanox 5947cc1b00 Updated ate-api 2022-10-24 16:32:14 +02:00
Kikimanox 21fa8542c9 Added async version of izlusciPoIskanju 2022-10-19 11:24:59 +02:00
Kikimanox 7682cd0e0a popravljen json, swagger, oss_controller, da se ujema z novo strukturo zahtev 2022-10-19 10:39:30 +02:00
Kikimanox acb028073a Added additional error handling to job related functionalities. (Formatted file in db_utils, which might cause a merge conflict, just override my file later) 2022-10-18 22:48:51 +02:00
Kikimanox 82718d71bb lets not use localhost on the server 2022-10-18 19:25:05 +02:00
Kikimanox f89b84dd31 extract method (async) 2022-10-18 19:24:38 +02:00
Kikimanox 673a83691b Improved extract method to work properly (sync) 2022-10-18 19:08:41 +02:00
Kikimanox b483e1643f Update gitignore and added todo to README.md 2022-10-18 16:38:58 +02:00
Kikimanox 5833dfafc8 Preperation for merging multiple conllus, also added ATE files 2022-10-18 10:07:01 +02:00
Kikimanox be84cdae1b No need for two datetime imports, whoops 2022-09-20 00:05:02 +02:00
Kikimanox ac35026577 Typo 2022-09-19 23:50:57 +02:00
Kikimanox 916b2bef2a implemented the rest of the async functions and changed the way multithreading works 2022-09-19 17:11:59 +02:00
Kikimanox 9e82f3b93a updated endpoint definitions/names and reformatted some files and code 2022-09-14 16:40:29 +02:00
Kikimanox 0b90b6555b forgot to remove temp wrong name 2022-09-01 18:33:46 +02:00
Kikimanox 729dfb14cf Added two more async endpoints (temporary implementation) 2022-09-01 18:30:58 +02:00
Kikimanox fcf192b00b Made text extraction methods more generic for re-use in other modules/files (should probably move these into some utils file) 2022-09-01 18:26:03 +02:00
Kikimanox 0da8332426 Rename: oznaciBesedilo -> oznaciBesediloAsync 2022-09-01 17:34:16 +02:00
Kikimanox 93aba45e6a Dodane backup metode, ce bi slucajno padla tika. 2022-09-01 17:33:55 +02:00
Kikimanox 511118f4d7 no need for uncommented maria db if this wont be ran otuside of the docker 2022-08-31 18:37:23 +02:00
Kikimanox 63099da8c9 reverting most useless attempts at trying to make this work 2022-08-31 18:34:51 +02:00
Kikimanox 8bd8567b98 running out of ideas what to do 2022-08-31 18:30:49 +02:00
Kikimanox 621b047ebb forgot to remove dot 2022-08-31 18:14:31 +02:00
Kikimanox 3e450b9d41 forgot to remove dot 2022-08-31 18:00:53 +02:00
Kikimanox c4558242e1 time to try running it without docker instead 2022-08-31 18:00:44 +02:00
Kikimanox 3415d790d6 . 2022-08-31 17:52:43 +02:00
Kikimanox ffbb292289 reverted all workarounds that didn't work 2022-08-31 17:44:03 +02:00
Kikimanox 7d4aceb457 reverted attempted workarounds back to initial state 2022-08-31 17:39:46 +02:00
Kikimanox 08711f38f9 maybe this? 2022-08-31 17:33:09 +02:00
Kikimanox cf8e217c82 Will this workaround maybe work on the server? 2022-08-31 17:27:19 +02:00
Kikimanox bb4adeee2e testing 2022-08-31 16:39:15 +02:00
Kikimanox 55ea46397f maybe this will work, because it works locally... 2022-08-31 16:33:40 +02:00
Kikimanox 80a9b9638b seems like "http://tika:9999/tika" endpoint doesn't want to work, lets see if "http://localhost:9999/tika" works..? 2022-08-31 16:24:51 +02:00
Kikimanox 0561fd03af changed the way tika runs in docker-compose.yml, port 9998 already taken on the server currently 2022-08-31 16:20:04 +02:00
Kikimanox a8319072f8 Trying to figure out how to run this without messing up Ivan's Tika instance 2022-08-31 15:52:54 +02:00
Kikimanox 8b974c7b55 back to 9998 2022-08-31 15:45:22 +02:00
Kikimanox f28fa109fa forgot to remove dot 2022-08-31 15:42:27 +02:00
Kikimanox 500e5aa2a5 Different tika port since 9998 is already in use 2022-08-31 15:42:19 +02:00
Kikimanox f16c78bbdc Dodana endpointa za sync pridobivanje connlu-jev, ali preprosto file -> text, ali file -> ocr -> text. 2022-08-31 15:37:04 +02:00
Kikimanox c30b014a68 Dodana tika & format (v swagger definiciji se ni nic novega v tem commitu) 2022-08-31 14:49:47 +02:00
Kikimanox fedb72f1d7 does this path change work? 2022-08-29 23:43:37 +02:00
Kikimanox dfe2f08b84 debug 2022-08-29 23:36:07 +02:00
Kikimanox 5bdba94035 limit ngrams to 200 because this temporary implementation is kind of slow 2022-08-29 23:35:22 +02:00
Kikimanox 246c60de02 attachment_filename -> download_name 2022-08-29 23:31:59 +02:00
Kikimanox 77c5473142 fix dateutil ver 2022-08-29 23:19:20 +02:00
Kikimanox c8586513a9 Added new logic (temporary logic for getting files by search) and converting from files to txt 2022-08-29 22:53:49 +02:00
Kikimanox dd42b56c28 PYTHONUNBUFFERED=1 helped, but the main problem was not being able to connect to mariadb... 2022-08-29 16:42:27 +02:00
Kikimanox 1f2c9161fb will this workaround work....? 2022-08-29 16:36:07 +02:00
Kikimanox 7360c41099 will this workaround work...? 2022-08-29 16:29:20 +02:00
Kikimanox ba944cfac0 debug info 2022-08-29 16:20:25 +02:00
Kikimanox 44222fea39 typo 2022-08-29 15:32:39 +02:00
Kikimanox 796fca551a more server specific paths 2022-08-29 15:26:12 +02:00
Kikimanox 15fc2e0f62 fixed docker specific paths so that everything works... 2022-08-29 15:20:21 +02:00
Kikimanox 748db5ad0f nl 2022-08-29 14:26:02 +02:00
Kikimanox 4be3ace842 tmp debug info 2022-08-29 14:02:59 +02:00
Kikimanox 7cd4004ba9 Added .env logic (finally) 2022-08-29 13:01:02 +02:00
Kikimanox 023d448a28 path typo 2022-08-29 12:50:45 +02:00
Kikimanox 3e38875485 dockerfile, req update 2022-08-29 12:45:08 +02:00
Kikimanox 64e10542f2 update requirements.txt 2022-08-29 12:28:41 +02:00
Kikimanox 763ca8a7c6 Dodana vrsta oz. semafor pri obdelovanju conllu datotek 2022-07-11 15:27:46 +02:00
Kikimanox aa2946ee4a updated gitignore 2022-07-07 13:48:13 +02:00
Kikimanox 34039e38dd changed id to file_id in multiple instances, which caused the calls to not work 2022-06-29 14:50:28 +02:00