15 changed files with 4228 additions and 269 deletions
-
2.gitignore
-
202LICENSE.txt
-
37README.md
-
140Result.py
-
14ResultNode.py
-
14ResultTree.py
-
3Tree.py
-
14Value.py
-
0config.ini
-
284dependency-parsetree.py
-
14generic.py
-
BINlogos/CJVT.png
-
0logos/CLARIN.png
-
3773logos/FF.svg
-
BINlogos/FRI.png
@ -0,0 +1,202 @@ |
|||
|
|||
Apache License |
|||
Version 2.0, January 2004 |
|||
http://www.apache.org/licenses/ |
|||
|
|||
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION |
|||
|
|||
1. Definitions. |
|||
|
|||
"License" shall mean the terms and conditions for use, reproduction, |
|||
and distribution as defined by Sections 1 through 9 of this document. |
|||
|
|||
"Licensor" shall mean the copyright owner or entity authorized by |
|||
the copyright owner that is granting the License. |
|||
|
|||
"Legal Entity" shall mean the union of the acting entity and all |
|||
other entities that control, are controlled by, or are under common |
|||
control with that entity. For the purposes of this definition, |
|||
"control" means (i) the power, direct or indirect, to cause the |
|||
direction or management of such entity, whether by contract or |
|||
otherwise, or (ii) ownership of fifty percent (50%) or more of the |
|||
outstanding shares, or (iii) beneficial ownership of such entity. |
|||
|
|||
"You" (or "Your") shall mean an individual or Legal Entity |
|||
exercising permissions granted by this License. |
|||
|
|||
"Source" form shall mean the preferred form for making modifications, |
|||
including but not limited to software source code, documentation |
|||
source, and configuration files. |
|||
|
|||
"Object" form shall mean any form resulting from mechanical |
|||
transformation or translation of a Source form, including but |
|||
not limited to compiled object code, generated documentation, |
|||
and conversions to other media types. |
|||
|
|||
"Work" shall mean the work of authorship, whether in Source or |
|||
Object form, made available under the License, as indicated by a |
|||
copyright notice that is included in or attached to the work |
|||
(an example is provided in the Appendix below). |
|||
|
|||
"Derivative Works" shall mean any work, whether in Source or Object |
|||
form, that is based on (or derived from) the Work and for which the |
|||
editorial revisions, annotations, elaborations, or other modifications |
|||
represent, as a whole, an original work of authorship. For the purposes |
|||
of this License, Derivative Works shall not include works that remain |
|||
separable from, or merely link (or bind by name) to the interfaces of, |
|||
the Work and Derivative Works thereof. |
|||
|
|||
"Contribution" shall mean any work of authorship, including |
|||
the original version of the Work and any modifications or additions |
|||
to that Work or Derivative Works thereof, that is intentionally |
|||
submitted to Licensor for inclusion in the Work by the copyright owner |
|||
or by an individual or Legal Entity authorized to submit on behalf of |
|||
the copyright owner. For the purposes of this definition, "submitted" |
|||
means any form of electronic, verbal, or written communication sent |
|||
to the Licensor or its representatives, including but not limited to |
|||
communication on electronic mailing lists, source code control systems, |
|||
and issue tracking systems that are managed by, or on behalf of, the |
|||
Licensor for the purpose of discussing and improving the Work, but |
|||
excluding communication that is conspicuously marked or otherwise |
|||
designated in writing by the copyright owner as "Not a Contribution." |
|||
|
|||
"Contributor" shall mean Licensor and any individual or Legal Entity |
|||
on behalf of whom a Contribution has been received by Licensor and |
|||
subsequently incorporated within the Work. |
|||
|
|||
2. Grant of Copyright License. Subject to the terms and conditions of |
|||
this License, each Contributor hereby grants to You a perpetual, |
|||
worldwide, non-exclusive, no-charge, royalty-free, irrevocable |
|||
copyright license to reproduce, prepare Derivative Works of, |
|||
publicly display, publicly perform, sublicense, and distribute the |
|||
Work and such Derivative Works in Source or Object form. |
|||
|
|||
3. Grant of Patent License. Subject to the terms and conditions of |
|||
this License, each Contributor hereby grants to You a perpetual, |
|||
worldwide, non-exclusive, no-charge, royalty-free, irrevocable |
|||
(except as stated in this section) patent license to make, have made, |
|||
use, offer to sell, sell, import, and otherwise transfer the Work, |
|||
where such license applies only to those patent claims licensable |
|||
by such Contributor that are necessarily infringed by their |
|||
Contribution(s) alone or by combination of their Contribution(s) |
|||
with the Work to which such Contribution(s) was submitted. If You |
|||
institute patent litigation against any entity (including a |
|||
cross-claim or counterclaim in a lawsuit) alleging that the Work |
|||
or a Contribution incorporated within the Work constitutes direct |
|||
or contributory patent infringement, then any patent licenses |
|||
granted to You under this License for that Work shall terminate |
|||
as of the date such litigation is filed. |
|||
|
|||
4. Redistribution. You may reproduce and distribute copies of the |
|||
Work or Derivative Works thereof in any medium, with or without |
|||
modifications, and in Source or Object form, provided that You |
|||
meet the following conditions: |
|||
|
|||
(a) You must give any other recipients of the Work or |
|||
Derivative Works a copy of this License; and |
|||
|
|||
(b) You must cause any modified files to carry prominent notices |
|||
stating that You changed the files; and |
|||
|
|||
(c) You must retain, in the Source form of any Derivative Works |
|||
that You distribute, all copyright, patent, trademark, and |
|||
attribution notices from the Source form of the Work, |
|||
excluding those notices that do not pertain to any part of |
|||
the Derivative Works; and |
|||
|
|||
(d) If the Work includes a "NOTICE" text file as part of its |
|||
distribution, then any Derivative Works that You distribute must |
|||
include a readable copy of the attribution notices contained |
|||
within such NOTICE file, excluding those notices that do not |
|||
pertain to any part of the Derivative Works, in at least one |
|||
of the following places: within a NOTICE text file distributed |
|||
as part of the Derivative Works; within the Source form or |
|||
documentation, if provided along with the Derivative Works; or, |
|||
within a display generated by the Derivative Works, if and |
|||
wherever such third-party notices normally appear. The contents |
|||
of the NOTICE file are for informational purposes only and |
|||
do not modify the License. You may add Your own attribution |
|||
notices within Derivative Works that You distribute, alongside |
|||
or as an addendum to the NOTICE text from the Work, provided |
|||
that such additional attribution notices cannot be construed |
|||
as modifying the License. |
|||
|
|||
You may add Your own copyright statement to Your modifications and |
|||
may provide additional or different license terms and conditions |
|||
for use, reproduction, or distribution of Your modifications, or |
|||
for any such Derivative Works as a whole, provided Your use, |
|||
reproduction, and distribution of the Work otherwise complies with |
|||
the conditions stated in this License. |
|||
|
|||
5. Submission of Contributions. Unless You explicitly state otherwise, |
|||
any Contribution intentionally submitted for inclusion in the Work |
|||
by You to the Licensor shall be under the terms and conditions of |
|||
this License, without any additional terms or conditions. |
|||
Notwithstanding the above, nothing herein shall supersede or modify |
|||
the terms of any separate license agreement you may have executed |
|||
with Licensor regarding such Contributions. |
|||
|
|||
6. Trademarks. This License does not grant permission to use the trade |
|||
names, trademarks, service marks, or product names of the Licensor, |
|||
except as required for reasonable and customary use in describing the |
|||
origin of the Work and reproducing the content of the NOTICE file. |
|||
|
|||
7. Disclaimer of Warranty. Unless required by applicable law or |
|||
agreed to in writing, Licensor provides the Work (and each |
|||
Contributor provides its Contributions) on an "AS IS" BASIS, |
|||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or |
|||
implied, including, without limitation, any warranties or conditions |
|||
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A |
|||
PARTICULAR PURPOSE. You are solely responsible for determining the |
|||
appropriateness of using or redistributing the Work and assume any |
|||
risks associated with Your exercise of permissions under this License. |
|||
|
|||
8. Limitation of Liability. In no event and under no legal theory, |
|||
whether in tort (including negligence), contract, or otherwise, |
|||
unless required by applicable law (such as deliberate and grossly |
|||
negligent acts) or agreed to in writing, shall any Contributor be |
|||
liable to You for damages, including any direct, indirect, special, |
|||
incidental, or consequential damages of any character arising as a |
|||
result of this License or out of the use or inability to use the |
|||
Work (including but not limited to damages for loss of goodwill, |
|||
work stoppage, computer failure or malfunction, or any and all |
|||
other commercial damages or losses), even if such Contributor |
|||
has been advised of the possibility of such damages. |
|||
|
|||
9. Accepting Warranty or Additional Liability. While redistributing |
|||
the Work or Derivative Works thereof, You may choose to offer, |
|||
and charge a fee for, acceptance of support, warranty, indemnity, |
|||
or other liability obligations and/or rights consistent with this |
|||
License. However, in accepting such obligations, You may act only |
|||
on Your own behalf and on Your sole responsibility, not on behalf |
|||
of any other Contributor, and only if You agree to indemnify, |
|||
defend, and hold each Contributor harmless for any liability |
|||
incurred by, or claims asserted against, such Contributor by reason |
|||
of your accepting any such warranty or additional liability. |
|||
|
|||
END OF TERMS AND CONDITIONS |
|||
|
|||
APPENDIX: How to apply the Apache License to your work. |
|||
|
|||
To apply the Apache License to your work, attach the following |
|||
boilerplate notice, with the fields enclosed by brackets "[]" |
|||
replaced with your own identifying information. (Don't include |
|||
the brackets!) The text should be enclosed in the appropriate |
|||
comment syntax for the file format. We also recommend that a |
|||
file or class name and description of purpose be included on the |
|||
same "printed page" as the copyright notice for easier |
|||
identification within third-party archives. |
|||
|
|||
Copyright [yyyy] [name of copyright owner] |
|||
|
|||
Licensed under the Apache License, Version 2.0 (the "License"); |
|||
you may not use this file except in compliance with the License. |
|||
You may obtain a copy of the License at |
|||
|
|||
http://www.apache.org/licenses/LICENSE-2.0 |
|||
|
|||
Unless required by applicable law or agreed to in writing, software |
|||
distributed under the License is distributed on an "AS IS" BASIS, |
|||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
|||
See the License for the specific language governing permissions and |
|||
limitations under the License. |
|||
@ -1,140 +0,0 @@ |
|||
import copy |
|||
import string |
|||
|
|||
from generic import create_output_string_form, create_output_string_deprel, create_output_string_lemma, \ |
|||
create_output_string_upos, create_output_string_xpos, create_output_string_feats, generate_key |
|||
|
|||
|
|||
class Result(object): |
|||
def __init__(self, node, architecture_order, create_output_strings): |
|||
# self.array = [[create_output_string(node) for create_output_string in create_output_strings]] |
|||
# if create_output_string_lemma in create_output_strings: |
|||
# key_array = [[create_output_string(node) if create_output_string != create_output_string_lemma else 'L=' + create_output_string(node) for create_output_string in create_output_strings]] |
|||
# else: |
|||
# key_array = self.array |
|||
# if len(self.array[0]) > 1: |
|||
# self.key = '&'.join(key_array[0]) |
|||
# else: |
|||
# # output_string = create_output_strings[0](node) |
|||
# self.key = key_array[0][0] |
|||
|
|||
self.array, self.key = generate_key(node, create_output_strings) |
|||
self.key_free = self.key |
|||
# self.array = [[output_string]] |
|||
self.order_key = str(architecture_order) |
|||
self.order = [architecture_order] |
|||
self.deprel = node.deprel.get_value() |
|||
# order with original numbers in sentences |
|||
# self.order = str([architecture_order]) |
|||
# order with numbers from 0 to n of n-gram |
|||
self.root = '' |
|||
self.final_order = '' |
|||
self.separators = [] |
|||
|
|||
def __repr__(self): |
|||
return self.key |
|||
|
|||
def add(self, string, architecture_order, separator, is_left): |
|||
if is_left: |
|||
self.array = [string] + self.array |
|||
self.order = [architecture_order] + self.order |
|||
# self.order = [architecture_order] + self.order |
|||
self.separators = [separator] + self.separators |
|||
self.key = string + ' ' + separator + ' ' + self.key |
|||
self.order_key = architecture_order + ' ' + separator + ' ' + self.order_key |
|||
|
|||
else: |
|||
self.array += [string] |
|||
self.order += [architecture_order] |
|||
# self.order += [architecture_order] |
|||
self.separators += [separator] |
|||
|
|||
self.key += ' ' + separator + ' ' + string |
|||
self.order_key += ' ' + separator + ' ' + architecture_order |
|||
|
|||
def add_separator(self, separator, left=True): |
|||
self_copy = copy.copy(self) |
|||
if left: |
|||
self_copy.separators += [separator] |
|||
self_copy.key += separator |
|||
self_copy.order_key += separator |
|||
else: |
|||
self_copy.separators = [separator] + self_copy.separators |
|||
self_copy.key = separator + self_copy.key |
|||
self_copy.order_key = separator + self_copy.order_key |
|||
return self_copy |
|||
|
|||
# def merge_results2(self): |
|||
|
|||
|
|||
def merge_results(self, right_t, separator, left=True): |
|||
left_tree = copy.copy(self) |
|||
right_tree = copy.copy(right_t) |
|||
|
|||
if separator: |
|||
if left: |
|||
# merged_results.append(left_part + right_part + separator) |
|||
left_tree.key = left_tree.key + right_tree.key + separator |
|||
left_tree.order_key = left_tree.order_key + right_tree.order_key + separator |
|||
left_tree.array = left_tree.array + right_tree.array |
|||
left_tree.order = left_tree.order + right_tree.order |
|||
# left_tree.order = str([architecture_order]) |
|||
left_tree.separators = left_tree.separators + right_tree.separators + [separator] |
|||
else: |
|||
# merged_results.append(left_part + separator + right_part) |
|||
left_tree.key = left_tree.key + separator + right_tree.key |
|||
left_tree.order_key = left_tree.order_key + separator + right_tree.order_key |
|||
left_tree.array = left_tree.array + right_tree.array |
|||
left_tree.order = left_tree.order + right_tree.order |
|||
# left_tree.order = str([architecture_order]) |
|||
left_tree.separators = left_tree.separators + [separator] + right_tree.separators |
|||
else: |
|||
# merged_results.append(left_part + right_part) |
|||
left_tree.key = left_tree.key + right_tree.key |
|||
left_tree.order_key = left_tree.order_key + right_tree.order_key |
|||
left_tree.array = left_tree.array + right_tree.array |
|||
left_tree.order = left_tree.order + right_tree.order |
|||
# left_tree.order = str([architecture_order]) |
|||
left_tree.separators = left_tree.separators + right_tree.separators |
|||
|
|||
return left_tree |
|||
|
|||
def extend_answer(self, other_answer, separator): |
|||
self.array.extend(other_answer.array) |
|||
self.order.extend(other_answer.order) |
|||
self.key += separator + other_answer.key |
|||
self.order_key += separator + other_answer.order_key |
|||
self.separators.extend(separator) |
|||
|
|||
def put_in_bracelets(self, inplace=False): |
|||
if inplace: |
|||
self.key = ('(' + self.key + ')') |
|||
self.order_key = ('(' + self.order_key + ')') |
|||
return |
|||
result = copy.copy(self) |
|||
result.key = ('(' + result.key + ')') |
|||
result.order_key = ('(' + result.order_key + ')') |
|||
return result |
|||
|
|||
def finalize_result(self): |
|||
result = copy.copy(self) |
|||
result.key = result.key[1:-1] |
|||
result.set_root() |
|||
|
|||
# create order letters |
|||
order_letters = [''] * len(result.order) |
|||
for i in range(len(result.order)): |
|||
ind = result.order.index(min(result.order)) |
|||
result.order[ind] = 10000 |
|||
order_letters[ind] = string.ascii_uppercase[i] |
|||
result.order = ''.join(order_letters) |
|||
# result.order_key = result.order_key[1:-1] |
|||
# TODO When tree is finalized create relative word order (alphabet)! |
|||
return result |
|||
|
|||
def set_root(self): |
|||
if len(self.array[0]) > 1: |
|||
self.root = '&'.join(self.array[0]) |
|||
else: |
|||
# output_string = create_output_strings[0](node) |
|||
self.root = self.array[0][0] |
|||
|
After Width: 2500 | Height: 2500 | Size: 76 KiB |
|
Before Width: 359 | Height: 150 | Size: 28 KiB After Width: 359 | Height: 150 | Size: 28 KiB |
3773
logos/FF.svg
File diff suppressed because it is too large
View File
File diff suppressed because it is too large
View File
|
After Width: 1306 | Height: 697 | Size: 128 KiB |
Write
Preview
Loading…
Cancel
Save
Reference in new issue