Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/add scapacra bt #536

Merged
merged 131 commits into from
Nov 5, 2023
Merged

Feature/add scapacra bt #536

merged 131 commits into from
Nov 5, 2023

Conversation

ManAnRuck
Copy link
Member

No description provided.

ulfgebhardt and others added 30 commits November 5, 2023 19:14
@ulfgebhardt
Initial commit
3caa986
First version of an DocumentEvaluator which provides information from…
60341bf 
… a Plenarprotokoll via xPath.
@ulfgebhardt
fixed security issue(?), implemented nodemon
bc459bc
Presentation of the importer model concept with plant-uml project files.
1a9c70b
@ManAnRuck
add package.json
91f2f20
Add package-lock.json to .gitignore
1611111
Remove console debug message, unused imports and uncommented code lines
662bf32
Integration of unit testing framework chai/mocha
5b8539a 
- Adapting scripts
- Writing some basic unit test
Formating JSON schema files
004ec06
Improve folder structure
9dd4329
Implemented importer structure (see doc)
7bfdd79 
- add abstract ProtocolScraperConfiguration and two implementations
- add PlenarProtocolBrowser as IBrowser implementation
- add parser implementation (wrapper of existing evaluation classes)
- add unit tests
BugFix: Page counter was not incremented
424868e
Add abstract class BundestagListBrowser to generalize the list browsing.
b84dab7
BugFixes: Browser paging was buggy
05d58aa
Indroduce async await concept
8d267d6 
- Improved code for async calls
- Example.ts contains an standardized scraper call (see doc)
Remaining async refactoring done
0c8f3b7
Join Scraper, IBrowser and IParser into one file (Importer.ts)
7caf1d0
Remove external browser URL setting. URL strongly depends to the brow…
f7fad4e 
…ser implementation itself.
Include scapacra library
2e182a7
Migration from Example.js to index.js
f5304ff
Move index.ts to src folder
e2ee02a
@ulfgebhardt
first implementation of deputy scraper
a2801cd
@ulfgebhardt
cleanup
7d48ef3
@ulfgebhardt
more cleanup
cc55855
BugFix: Added missing URL import. Error while runtime.
3d164fa
Code adaptions due to the API changes in scapacra
f6ecd19
@ulfgebhardt
cleanup for production
0f251bf
@ulfgebhardt
referenced scapacra 1.0.0 instead of master
f0db883
@ulfgebhardt
corrected package name, included prepare script, version bump
8b43568
@ulfgebhardt
adjusted compile options to not include test & run.ts
d4880b9
Manuel Ruck and others added 28 commits November 5, 2023 19:15
Fix conference week regex
eeccb9e 
Signed-off-by: Manuel Ruck <[email protected]>
fix named polls
ceac5e0 
Signed-off-by: Manuel Ruck <[email protected]>
upgrade version
1fe8107 
Signed-off-by: Manuel Ruck <[email protected]>
v1.0.33
fa50873
chore(updates): 📦 update packages
a1a6ce8 
Signed-off-by: Manuel Ruck <[email protected]>
@ulfgebhardt
Initial commit
ea464b1
Added importer structure and xml document evaluator helper
3e4baa1
Adaptions for packing and publishing
45713a0
@ulfgebhardt
fix build by including "prepare" to let the package build its dist fo…
87e1e89 
…lder on include
@ulfgebhardt
remove watch flag
8357502
Added IDataPackage (Data + Metadata)
4fdace4
Basic description of scapacra
2ccdde1
Include UML diagrams into the documentation
742b7e7
Import UML diagrams as svg
ecac9aa
@ulfgebhardt
rename package to publish it to npm - v 1.0.2 since npm is the worst …
5696de1 
…tool you can imagine
@ulfgebhardt
missing v1.0.2 version - thanks npm
c72507b
@ulfgebhardt
allow custom error handlers on xmldom parsing
1e9def8
@ulfgebhardt
- separated all classes and interfaces into files
0eeb822 
- Use AsyncIteratableIterator class instead of IteratableIterator
- renamed IScraperConfiguration to IScraper
@ulfgebhardt
version 1.0.4
8526825
@ulfgebhardt
apply jannik fix, refactored interfaces to allow any Meta Data, remov…
5a110b3 
…ed Datatype, defined datapackage container instead to address memory issues
@ulfgebhardt
v1.0.5
666e2fe
@ulfgebhardt
made callback async and wait for it
6427c77
@ulfgebhardt
v1.0.6
bef1ee4
chore(cleanup): 🧹 remove yarn.lock files
5903869 
Signed-off-by: Manuel Ruck <[email protected]>
fix: 🐛 fix scapacra build
e6454e2 
Signed-off-by: Manuel Ruck <[email protected]>
fix: 🐛 fix scapacra-bt build
6b73754 
Signed-off-by: Manuel Ruck <[email protected]>
chore(packages): 📦 update packages
e9a96aa 
Signed-off-by: Manuel Ruck <[email protected]>
fix: 🐛 setting up dayjs out of loops
2e66186 
#535
@ManAnRuck ManAnRuck merged commit 88c3333 into master Nov 5, 2023
10 checks passed
@ManAnRuck ManAnRuck deleted the feature/add-scapacra-bt branch November 5, 2023 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ManAnRuck @ulfgebhardt