Skip to content

amaloraini/cross-lingual-ZP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is a cross-lingual zero pronoun resolution using BERT with other positional features as well.

Json files show we represent the data to our model.

Json files are formatted as:

"id": train/test id

"sentence1": sentence 1

"sentence2": sentence 2 (if AZP and its candidates appear in two different sentences)

"azp_index": [azp index in sentence 1, azp index in sentence 2], (-1 if does not exist)

"candidate_start_indices": [[start indices of candidates in sentence 1],[start indices of candidates in sentence 2]]

"candidate_end_indices": [[end indices of candidates in sentence 1],[end indices of candidates in sentence 2]]

"labels": [candidate labels]

In train.json, we show how we represent one data instance for two cases:

  1. AZP and its candidates in one sentence.
  2. AZP in one sentence, and candidates in another

OntoNotes 5.0 text is copyrighted, but freely available at https://catalog.ldc.upenn.edu/LDC2013T19

Note: We also included BERT tokenization file. We made it work smoothly with get_wordpiece_indices() function to extract subtoken indices (check line 211 for more information).

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages