Skip to content

Commit

Permalink
Add TSV processing for ministers.
Browse files Browse the repository at this point in the history
  • Loading branch information
@TomazErjavec
TomazErjavec committed May 14, 2022
1 parent 2dc92eb commit dbdd38f
Show file tree
Hide file tree
Showing 19 changed files with 2,556 additions and 2 deletions.
2 changes: 2 additions & 0 deletions Data/Metadata/ParlaMint_ministers-BE.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Country PersonID Role From To Ref. Ana.
BE - minister - - -
60 changes: 60 additions & 0 deletions Data/Metadata/ParlaMint_ministers-BG.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
Country PersonID Role From To Ref. Ana.
BG RadevValentin minister 2017-05-04 2018-09-13 - -
BG PetkovBiser minister 2017-05-04 2019-11-29 - -
BG BanovBoil minister 2017-05-04 - - -
BG GoranovVladislav minister 2017-05-04 2020-07-24 - -
BG KirilovDanail minister 2019-04-05 2020-08-27 - -
BG SachevaDenitsa minister 2019-12-03 - - -
BG AhladovaDesislava minister 2020-09-03 - - -
BG TanevaDesislava minister 2019-05-15 - - -
BG TanevaDesislava minister 2014-11-07 2019-05-14 - -
BG ZaharievaEkaterina minister 2017 - - -
BG KaranikolovEmil minister 2017-05-04 2020-07-24 - -
BG MoskovskiIvajlo minister 2017-05-04 2018-09-20 - -
BG AnanievKiril minister 2017-11 2020-07 - -
BG AngelovKostadin minister 2020-07-24 - - -
BG KralevKrasen minister 2014-05-04 2017-01-27 - -
BG KralevKrasen minister 2017-05-04 - - -
BG ValchevKrasimir minister 2017-05-04 - - -
BG KarakachanovKrasimir minister 2017 - - -
BG PavlovaLiljana minister 2011-09-09 2013-02-20 - -
BG PavlovaLiljana minister 2017-05-04 2018-12-31 - -
BG VasilevaLozana minister 2017-05-04 2018-12-31 - -
BG NikolovaMariyana minister 2020-07-24 - - -
BG MarinovMladen minister 2018-09-20 2020 - -
BG DimovNeno minister 2017-05-04 2020-01-10 - -
BG AngelkovaNikolina minister 2017 2020 - -
BG AvramovaPetya minister 2018-09-20 - - -
BG ZheljazkovRosen minister 2018-09-20 - - -
BG PorozhanovRumen minister 2017-05-04 2019-05-15 - -
BG PetkovaTemenuzhka minister 2017-05-04 - - -
BG PetkovaTemenuzhka minister 2014-11-07 2017-01-27 - -
BG TerziyskiChristo minister 2020-07-24 - - -
BG TsachevaTsetska minister 2017-05-04 2019-04-05 - -
BG StonovVasil minister 2014-08-06 2014-11-07 - -
BG GrudevVasil minister 2014-08-06 2014-11-07 - -
BG ShalamanovVelizar minister 2014-08-06 2014-11-07 - -
BG DonevGylyb minister 2017-01-27 2017-05-04 - -
BG MitovDaniel minister 2014-08-06 2017-01-27 - -
BG KostovDimityr minister 1995-01-25 1997-02-12 - -
BG RoussinovaZornitsa minister 2014-11-19 2017-01-27 - -
BG CanovaIliyana minister 2013-03-13 2013-05-29 - -
BG CanovaIliyana minister 2014-08-06 2014-11-07 - -
BG SemerdzievIlko minister 2017-01-27 2017-05-04 - -
BG KostovaIrina minister 2017-01-27 2017-05-04 - -
BG MihajlovaIskra minister 2013 2014 - -
BG HristoskovYordan minister 2014-08-06 2014-11-07 - -
BG BakalovYordan minister 2014-08-06 2014-11-07 - -
BG NenkovMiroslav minister - - - -
BG PavlovNikolay minister 2017-01-27 2017-05-04 - -
BG DenkovNikolay minister 2017-01-27 2017-05-04 - -
BG PetrovNikolay minister 2017-05-04 2017-11-10 - -
BG MoskovPetar minister 2014-11-07 2017-01-27 - -
BG UzunovPlamen minister 2017-01-27 2017-05-04 - -
BG KolarovaRumyana minister 2014-08-06 2014-11-07 - -
BG ZhekovaSvetlana minister 2014-08-06 2014-11-07 - -
BG PopnikolovSpas minister 2017-01-27 2017-05-04 - -
BG YanevStefan minister 2017-01-27 2017-05-04 - -
BG TanevTodor minister 2014-11-07 2016-02-03 - -
BG IvanovHristo minister 2014-08-06 2014-11-07 - -
BG IvanovHristo minister 2014-11-07 2015-12-18 - -
86 changes: 86 additions & 0 deletions Data/Metadata/ParlaMint_ministers-CZ.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
Country PersonID Role From To Ref. Ana.
CZ AdamVojtech.1986 minister 2021-05-26T12:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ AdamVojtech.1986 minister 2018-06-27T09:00:00 2020-09-21T12:00:00 government government.VladaCR.1494
CZ AdamVojtech.1986 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ AlenaSchillerova.1964 minister 2018-06-27T09:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ AlenaSchillerova.1964 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ AndrejBabis.1954 minister 2014-01-29T14:00:00 2017-05-24T17:00:00 government government.VladaCR.1164
CZ AnnaHubackova.1957 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ AntoninStanek.1966 minister 2018-06-27T09:00:00 2019-07-31T00:00:00 government government.VladaCR.1494
CZ BohuslavSobotka.1971 minister 2017-03-01T00:00:00 2017-04-04T12:00:00 government government.VladaCR.1164
CZ BohuslavSobotka.1971 minister 2005-04-25T17:00:00 2006-08-16T16:00:00 government government.VladaCR.740
CZ BohuslavSobotka.1971 minister 2004-08-04T11:00:00 2005-04-25T09:00:00 government government.VladaCR.731
CZ BohuslavSobotka.1971 minister 2002-07-15T00:00:00 2004-08-04T11:00:00 government government.VladaCR.603
CZ DanTok.1959 minister 2018-06-27T09:00:00 2019-04-30T12:00:00 government government.VladaCR.1494
CZ DanTok.1959 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ DanTok.1959 minister 2014-12-04T11:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ DanielHerman.1963 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ HelenaLangsadlova.1963 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ HelenaValkova.1951 minister 2014-01-29T14:00:00 2015-03-01T00:00:00 government government.VladaCR.1164
CZ IvanBartos.1980 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ IvanPilny.1944 minister 2017-05-24T17:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ JanChvojka.1980 minister 2016-12-01T00:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ JanHamacek.1978 minister 2021-04-12T14:00:00 2021-04-21T14:00:00 government government.VladaCR.1494
CZ JanHamacek.1978 minister 2018-06-27T09:00:00 2018-10-16T12:00:00 government government.VladaCR.1494
CZ JanHamacek.1978 minister 2018-06-27T09:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ JanLipavsky.1985 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ JanMladek.1960 minister 2014-01-29T14:00:00 2017-02-28T23:00:00 government government.VladaCR.1164
CZ JanMladek.1960 minister 2005-11-16T11:00:00 2006-08-16T16:00:00 government government.VladaCR.740
CZ JanaCernochova.1973 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ JiriDienstbier.1969 minister 2014-01-29T14:00:00 2016-11-30T23:00:00 government government.VladaCR.1164
CZ JiriPospisil.1975 minister 2010-07-13T00:00:00 2012-06-27T00:00:00 government government.VladaCR.951
CZ JiriPospisil.1975 minister 2007-01-09T11:00:00 2009-05-08T16:00:00 government government.VladaCR.849
CZ JiriPospisil.1975 minister 2006-09-04T14:00:00 2007-01-09T11:00:00 government government.VladaCR.757
CZ JozefSikela.1967 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ KarelHavlicek.1969 minister 2020-01-24T00:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ KarelHavlicek.1969 minister 2019-04-30T12:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ KarelSchwarzenberg.1937 minister 2010-07-13T00:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ KarelSchwarzenberg.1937 minister 2007-01-09T11:00:00 2009-05-08T16:00:00 government government.VladaCR.849
CZ KarlaSlechtova.1977 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ KarlaSlechtova.1977 minister 2014-10-08T12:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ KaterinaValachova.1976 minister 2015-06-17T11:00:00 2017-06-21T16:00:00 government government.VladaCR.1164
CZ KlaraDostalova.1971 minister 2018-06-27T09:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ KlaraDostalova.1971 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ LeosHeger.1948 minister 2010-07-13T00:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ LubomirMetnar.1967 minister 2018-06-27T09:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ LubomirMetnar.1967 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ LubomirZaoralek.1956 minister 2019-08-27T13:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ LubomirZaoralek.1956 minister 2014-01-29T00:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ MarianJurecka.1981 minister 2021-12-17T11:00:00 2022-01-03T12:00:00 government government.VladaCR.1628
CZ MarianJurecka.1981 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ MarianJurecka.1981 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ MarieBenesova.1948 minister 2019-04-30T12:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ MarieBenesova.1948 minister 2013-07-10T11:00:00 2014-01-29T14:00:00 government government.VladaCR.1103
CZ MartinBaxa.1975 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ MartinKupka.1975 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ MartinStropnicky.1956 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ MartinStropnicky.1956 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ MartinStropnicky.1956 minister 1998-01-02T00:00:00 1998-07-21T00:00:00 government government.VladaCR.149
CZ MichaelaMarksova.1969 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ MichalSalomoun.1974 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ MilanChovanec.1970 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ MilanUrban.1958 minister 2005-04-25T17:00:00 2006-08-16T16:00:00 government government.VladaCR.740
CZ MilanUrban.1958 minister 2004-08-04T11:00:00 2005-04-25T09:00:00 government government.VladaCR.731
CZ MilanUrban.1958 minister 2003-03-20T00:00:00 2004-08-04T11:00:00 government government.VladaCR.603
CZ MiroslavKalousek.1960 minister 2010-07-13T00:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ MiroslavKalousek.1960 minister 2007-01-09T11:00:00 2009-05-08T16:00:00 government government.VladaCR.849
CZ PavelBlazek.1969 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ PavelBlazek.1969 minister 2012-07-03T00:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ PetrBendl.1966 minister 2011-10-06T00:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ PetrBendl.1966 minister 2009-01-23T11:00:00 2009-05-08T16:00:00 government government.VladaCR.849
CZ PetrFiala.1964 minister 2012-05-02T10:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ PetrGazdik.1974 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ RichardBrabec.1966 minister 2018-06-27T09:00:00 2021-12-17T11:00:00 government government.VladaCR.1494
CZ RichardBrabec.1966 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ RichardBrabec.1966 minister 2014-01-29T14:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ RobertPelikan.1979 minister 2017-12-13T14:00:00 2018-06-27T00:00:00 government government.VladaCR.1338
CZ RobertPelikan.1979 minister 2015-03-12T12:00:00 2017-12-13T00:00:00 government government.VladaCR.1164
CZ TatanaMala.1981 minister 2018-06-27T09:00:00 2018-07-10T17:00:00 government government.VladaCR.1494
CZ TomasJanPodivinsky.1969 minister 2013-07-10T11:00:00 2014-01-29T14:00:00 government government.VladaCR.1103
CZ VeraJourova.1964 minister 2014-01-29T14:00:00 2014-10-03T12:00:00 government government.VladaCR.1164
CZ VitRakusan.1978 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ VitezslavJandak.1947 minister 2005-08-17T13:00:00 2006-08-16T16:00:00 government government.VladaCR.740
CZ VlastimilValek.1960 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ ZbynekStanjura.1964 minister 2021-12-17T11:00:00 - government government.VladaCR.1628
CZ ZbynekStanjura.1964 minister 2012-12-12T15:00:00 2013-07-10T11:00:00 government government.VladaCR.951
CZ ZdenekNekula.1970 minister 2022-01-03T12:00:00 - government government.VladaCR.1628
89 changes: 89 additions & 0 deletions Data/Metadata/ParlaMint_ministers-DK.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,89 @@
Country PersonID Role From To Ref. Ana.
DK SamuelsenAnders minister - - - -
DK VilhelmsenAnnette minister - - - -
DK KragAstrid minister - - - -
DK KiærBenedikte minister - - - -
DK EngelbrechtBenny minister - - - -
DK HaarderBertel minister - - - -
DK HornbechBirtheRønn minister - - - -
DK CorydonBjarne minister - - - -
DK MikkelsenBrian minister - - - -
DK ChristensenCarina minister - - - -
DK HansenCarsten minister - - - -
DK SahlMadsenCharlotte minister - - - -
DK BachChristianFriis minister - - - -
DK AntoriniChristine minister - - - -
DK FrederiksenClausHjort minister - - - -
DK HedegaardConnie minister - - - -
DK JørgensenDan minister - - - -
DK NørbyEllenTrane minister - - - -
DK LarsenEsbenLunde minister - - - -
DK HansenEvaKjer minister - - - -
DK BechGitteLillelund minister - - - -
DK SchmidtHansChristian minister - - - -
DK SanderHelge minister - - - -
DK KristensenHenrikDam minister - - - -
DK HøeghHenrik minister - - - -
DK LarsenHenrikSass minister - - - -
DK NielsenHolgerK minister - - - -
DK AukenIda minister - - - -
DK StøjbergInger minister - - - -
DK NielsenJakobAxel minister - - - -
DK EllemannJensenJakob minister - - - -
DK KofodJeppe minister - - - -
DK DahlJonas minister - - - -
DK LarsenJørnNeergaard minister - - - -
DK MogensenJoy minister - - - -
DK DybvadKaare minister - - - -
DK EllemannKaren minister - - - -
DK HækkerupKaren minister - - - -
DK LauritzenKarsten minister - - - -
DK BrosbølKirsten minister - - - -
DK JensenKristian minister - - - -
DK BarfoedLars minister - - - -
DK LilleholtLarsChristian minister - - - -
DK WermelinLea minister - - - -
DK EspersenLene minister - - - -
DK FriisLykke minister - - - -
DK HeunickeMagnus minister - - - -
DK MercadoMai minister - - - -
DK SareenManu minister - - - -
DK VestagerMargrethe minister - - - -
DK JelvedMarianne minister - - - -
DK LidegaardMartin minister - - - -
DK TesfayeMattias minister - - - -
DK RiisagerMerete minister - - - -
DK BockMette minister - - - -
DK FrederiksenMette minister - - - -
DK GjerskovMette minister - - - -
DK JensenMogens minister - - - -
DK BødskovMorten minister - - - -
DK ØstergaardMorten minister - - - -
DK HækkerupNick minister - - - -
DK WammenNicolai minister - - - -
DK SohnOle minister - - - -
DK RosenkrantzTheilPernille minister - - - -
DK MøllerPerStig minister - - - -
DK ChristensenPeter minister - - - -
DK ThomsenPeterHummelgaard minister - - - -
DK KjærsgaardPia minister - - - -
DK DyhrPiaOlsen minister - - - -
DK PetersenRasmusHelveg minister - - - -
DK JarlovRasmus minister - - - -
DK PrehnRasmus minister - - - -
DK AmmitzbøllSimonEmil minister - - - -
DK KollerupSimon minister - - - -
DK NielsenSofieCarsten minister - - - -
DK LøhdeSophie minister - - - -
DK GadeSøren minister - - - -
DK PoulsenSørenPape minister - - - -
DK PindSøren minister - - - -
DK PedersenThorMöger minister - - - -
DK FrankThyra minister - - - -
DK NedergaardTina minister - - - -
DK AhlersTommy minister - - - -
DK BramsenTrine minister - - - -
DK PoulsenTroelsLund minister - - - -
DK ElbækUffe minister - - - -
DK TørnæsUlla minister - - - -
DK SøvndalVilly minister - - - -
2 changes: 2 additions & 0 deletions Data/Metadata/ParlaMint_ministers-ES.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
Country PersonID Role From To Ref. Ana.
ES - minister - - -
25 changes: 25 additions & 0 deletions Data/Metadata/ParlaMint_ministers-FR.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
Country PersonID Role From To Ref. Ana.
FR PA1872 minister 2017-06-22 2020-07-06 PO729976 -
FR PA1872 minister 2020-07-07 - PO773374 -
FR PA227076 minister 2017-06-22 2018-10-16 PO730004 -
FR PA227076 minister 2018-10-17 2020-07-06 PO759779 -
FR PA227076 minister 2020-07-07 - PO773390 -
FR PA331481 minister 2017-06-22 2020-07-06 PO729982 -
FR PA331481 minister 2020-07-07 - PO773380 -
FR PA332 minister 2020-07-07 - PO773394 -
FR PA335758 minister 2018-10-17 2020-07-06 PO759785 -
FR PA337633 minister 2017-06-22 2020-07-06 PO730017 -
FR PA337633 minister 2020-07-07 - PO773398 -
FR PA415452 minister 2018-10-17 2020-07-06 PO759789 -
FR PA415482 minister 2017-06-22 2018-10-16 PO729978 -
FR PA605131 minister 2018-10-17 2020-07-06 PO759777 -
FR PA607395 minister 2017-06-22 2018-10-16 PO730006 -
FR PA607846 minister 2017-06-22 2020-07-06 PO730011 -
FR PA607846 minister 2020-07-07 - PO773384 -
FR PA609520 minister 2020-07-07 - PO773376 -
FR PA642788 minister 2020-07-07 - PO773396 -
FR PA642788 minister 2020-02-17 2020-07-06 PO770470 -
FR PA643210 minister 2018-10-17 2020-07-06 PO759797 -
FR PA643210 minister 2020-07-07 - PO773388 -
FR PA719938 minister 2018-10-17 2020-07-06 PO759793 -
FR PA721670 minister 2020-07-07 - PO773404 -
Loading

2 comments on commit dbdd38f

@TomazErjavec
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@matyaskopp, I wrote Scripts/ministers-tei2tsv.xsl to generate TSV files on minsters from the info currenlty in the corpus and Scripts/ministers-tsv2tei.xsl to insert TSV data into a corpus. Could you pls. have a look to confirm that this is what we want? Some notes:

  • We have corpora (BG, CZ, DK, FR, GB, IS, IT, NL) that already contain minister information, but each one a bit differently. The differences are esp. great in how they encode ministries, e.g. BG as text content of affiliation, FR as organisations (but with role 'government', not 'ministry'), IS as categories in taxonomy. Before we generate the TSVs for real, we should unify how ministries are encoded (even if they are not obligatory). So, another bunch of issues...
  • The tei2tsv script takes as input the ParlaMint corpus root file, and from that all the ParlaMint-XX corpus root files that are XIncluded, and outputs the TSV files, one per corpus, in the Data/Metadata directory. If there are no minister affiliations in the corpus, it makes a file with one template content line.
  • The tsv2tei script throws away all existing minister affiliations in the corpus, and inserts the ones from the TSV; I think this makes sense, as merging the two is probably impossible.
  • Of course it is not necessary for all corpora to use these scripts, if they want to insert directly in TEI, as they did in ParlaMint I, they can.

@matyaskopp
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@TomazErjavec I think it is an excellent foundation for ministry inclusion.

I like CZ encoding because it respects the encoding of affiliation of MPs with parliamentary organisation:

<affiliation role="member" ref="#parliamentOrg" ana="#termEvent" ... />
<affiliation role="minister" ref="#governmentOrg" ana="#governmentEvent" ... />

But I also like the taxonomy that SI introduced:

<affiliation role="minister" ref="#governmentOrg" ana="#ministryOf... " ... />

So I think that we should reconsider using other attributes than ana (#80) and use combination of CZ and SI encoding:

<affiliation role="member" ref="#parliamentOrg" corresp="#termEvent" ... />
<affiliation role="minister" ref="#governmentOrg" corresp="#governmentEvent" ana="#ministryOf...  ... />

where the ana attribute is optional.

And for the FR case, it's a question of how they are planning to encode the current term... they also have an organisation of Prime Minister, which I don't mind. Still, it is a question of how a single-person organisation should be encoded.

Please sign in to comment.