Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

¿De que habla el Telediario esta semana/mes? #93

Open
dcabo opened this issue Feb 25, 2020 · 0 comments
Open

¿De que habla el Telediario esta semana/mes? #93

dcabo opened this issue Feb 25, 2020 · 0 comments

Comments

@dcabo
Copy link
Member

dcabo commented Feb 25, 2020

De forma similar a lo que hace ProPublica con el Congreso, What Congress Talked About The Week of X, podríamos mostrar lo relevante de esta semana/mes en el Telediario.

ProPublica explica la parte de NLP aquí, pero otra opción es usar los propios agregadores de Elastic, en concreto el de significanttext.

No es exactamente lo mismo, pero esto compara los resultados que mencionan "PSOE" con el corpus general. No he tenido tiempo de cambiarlo para que compare esta semana con el corpus previo:

GET _search
{
    "query": {
      "bool": {
        "must": {
          "simple_query_string": {
            "query": "PSOE",
            "fields": ["text"],
            "default_operator": "AND"
          }
        },
        "filter": [
          {
            "range": {
              "programme_date": {
                "gte": "2019-11-01",
                "lte": "2019-11-31"
              }
            }
          }
        ]
      }
    },
    "size": 100,
    "aggregations" : {
        "my_sample" : {
            "sampler" : {
                "shard_size" : 100000
            },
            "aggregations": {
                "keywords" : {
                    "significant_text" : { "field" : "text" }
                }
            }
        }
    }
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant