Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev #52

Merged
merged 65 commits into from
Nov 3, 2024
Merged

Dev #52

Changes from 1 commit
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
0860248
updating the eco gleaner config
valentinedwv Aug 23, 2023
e9a5334
safe update treafik labels for v2.10
valentinedwv Aug 25, 2023
48b1f07
62 dev wait and logs (#69)
valentinedwv Sep 8, 2023
f69f52f
add run configurations
valentinedwv Sep 21, 2023
ff6710c
commiting. blocker on https://github.com/gleanerio/gleaner/issues/236…
valentinedwv Oct 12, 2023
a1e627b
Fix for bad serialization (#82)
valentinedwv Oct 12, 2023
879a826
Ecrr dev (#76)
valentinedwv Oct 12, 2023
e83faed
Lowering concurrency to two to prevent crashes
valentinedwv Oct 17, 2023
8828bf1
Fix path
valentinedwv Oct 27, 2023
b435a5e
update dependency
valentinedwv Nov 3, 2023
a206dda
Remove seperate requirements_code.txt
valentinedwv Nov 3, 2023
a9222b9
Weekly tasks (#88)
valentinedwv Nov 8, 2023
4998721
doc updates.
valentinedwv Nov 8, 2023
49843bf
update ecrr code
valentinedwv Nov 8, 2023
a68402a
copy and edit env file
valentinedwv Nov 8, 2023
347c225
Trafik labels for multi deployment on same server (#90)
valentinedwv Nov 9, 2023
76e7469
remove extra compse env from local
valentinedwv Nov 9, 2023
5fdd0e8
Updating the documentation.
valentinedwv Jan 5, 2024
0c17db9
added pangaea; upgraded earthcube utilities (#93)
ylyangtw Jan 8, 2024
d0fe4d7
fixed sitemap url for nitrogen
ylyangtw Jan 9, 2024
9ace3a2
87 add about page report to scheduler (#94)
ylyangtw Jan 19, 2024
86a52ce
update ec utility version
ylyangtw Mar 1, 2024
64cbaf1
Update compose_project.yaml
ylyangtw Mar 1, 2024
df03f96
Update compose_project_eco_override.yaml
ylyangtw Mar 1, 2024
569e7c2
Fix configuration issues (#97)
valentinedwv Mar 2, 2024
e733db2
rename TENNANT to TENANT
valentinedwv Mar 4, 2024
1144e47
update output types
valentinedwv Mar 4, 2024
342c049
update gleaner and nabu configs
ylyangtw Mar 14, 2024
1963420
Update earthcube_utilities in requirements.txt
valentinedwv Mar 21, 2024
2ef9fbd
Update requirements.txt
valentinedwv Mar 21, 2024
e4afb89
update gleaner and nabu configs
ylyangtw May 13, 2024
d6ceedd
update configs: add usgsrc4cast
ylyangtw May 20, 2024
2e96df6
update configs
ylyangtw May 20, 2024
581cdca
update config: add osmc
ylyangtw Jun 14, 2024
aa8a3f8
update configs
ylyangtw Jun 24, 2024
edbb4f0
Update readme
valentinedwv Jun 24, 2024
d4fb221
Merge branch 'dev' of https://github.com/earthcube/scheduler into dev
valentinedwv Jun 24, 2024
5ca6e58
Update contanerize.yaml
valentinedwv Jun 24, 2024
8706fce
Update requirements.txt
ylyangtw Jul 1, 2024
8f4774e
Dev 101 ingest sources wf (#115)
valentinedwv Jul 1, 2024
24ef449
fix ecrr
valentinedwv Jul 2, 2024
02d0600
fix ecrr
valentinedwv Jul 2, 2024
ac53af7
fix ecrr. this is what one gets for standardizing the naming pattern ;)
valentinedwv Jul 2, 2024
76e2ed6
concurrency
valentinedwv Jul 2, 2024
a96dea0
allow dagster.yaml to be retrieved from a docker config (#122)
valentinedwv Jul 2, 2024
e545561
graph report not returning missing graphs
valentinedwv Jul 2, 2024
c8f3f56
pip install requirements.txt ran twice
valentinedwv Jul 2, 2024
0553ad1
Bad indent relases will get loaded to all tenants
valentinedwv Jul 5, 2024
ac008e6
Bad indent relases will get loaded to all tenants
valentinedwv Jul 5, 2024
6e0c498
update the documentation.
valentinedwv Jul 8, 2024
c1f7253
#126 fix issues with when multiple materializations happen in a senso…
valentinedwv Jul 9, 2024
789b381
correct report name to fetch "load_report_graph.json"
valentinedwv Jul 14, 2024
53ecd1f
portainer now compliaing about build
valentinedwv Jul 14, 2024
50fbe8d
fix names in loadstats
valentinedwv Jul 15, 2024
bb17ad6
set pirorities #130
valentinedwv Aug 5, 2024
54d4042
check sitemaps #132, #133 (#134)
valentinedwv Aug 9, 2024
e853cf3
add geochemistry_custom
ylyangtw Sep 3, 2024
f7b875b
Update compose_project.yaml
ylyangtw Sep 3, 2024
2248232
Cleanup documentation
valentinedwv Sep 5, 2024
2cddc33
add stats reports to tenant (#152)
ylyangtw Oct 11, 2024
45dd1aa
Merge pull request #49 from earthcube/dev
fils Oct 24, 2024
1807e22
Update requirements.txt
ylyangtw Oct 29, 2024
b92833e
Merge pull request #50 from earthcube/point-earthcubeutilities-to-dev
ylyangtw Oct 29, 2024
8d158b0
Update requirements.txt (#154)
ylyangtw Oct 29, 2024
9ee0855
Merge pull request #51 from earthcube/dev
fils Nov 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add geochemistry_custom
ylyangtw committed Sep 3, 2024
commit e853cf3b4d04067881163311932284b03b1d21c3
19 changes: 19 additions & 0 deletions dagster/implnets/configs/eco/gleanerconfig.yaml
Original file line number Diff line number Diff line change
@@ -1349,3 +1349,22 @@ sources:
fixcontextoption: 0
acceptcontenttype: application/ld+json, text/html
jsonprofile: application/ld+json
- sourcetype: sitemap
name: geochemistry_custom
logo:
url: https://oss.geocodes.ncsa.illinois.edu/decoder/sitemaps/geochemistry_sitemap.xml
headless: false
pid: https://catalogue.odis.org/view/343
propername: Geochemistry Custom Datasets
domain: https://obis.org
active: true
credentialsfile: ""
other: {}
headlesswait: -1
delay: 0
identifierpath: ""
apipagelimit: 0
identifiertype: identifiersha
fixcontextoption: 0
acceptcontenttype: application/ld+json, text/html
jsonprofile: application/ld+json
1 change: 1 addition & 0 deletions dagster/implnets/configs/eco/nabuconfig.yaml
Original file line number Diff line number Diff line change
@@ -60,6 +60,7 @@ objects:
- summoned/vera4cast
- summoned/osmc
- summoned/obis
- summoned/geochemistry_custom
- prov/aquadocs
- prov/bcodmo
- prov/cchdo