CKAN 2.11 and official base image support

[BWibo]

• Support CKAN v2.11
• Support the official CKAN base images based on Debian bookwork
  • ckan/ckan-base:2.11, ckan/ckan-base:2.11.0

[BWibo]

@MarijaKnezevic
Shall this be handled now, with the currently used extensions, or shall we wait until the sddi CKAN extension is ready?
There is a good change that ckanext-spatial will be working with the new base image. So I think we should try now.

[MarijaKnezevic]

@BWibo
The update will be done with a “new” list of plugins, since the SDDI “master” plugin is ready. I already sent a list of plugins to @ilchebedelovski which should be integraded.
The ckanext-spatial will be used from community and our additional requirements are defined in "master" plugin.

I think that in any case it will not be possible to update to CKAN 2.11 with the “old” list of plugins (list which we used for v2.1.2 becasue some of the plugins do not workig with 2.11 (e.g. ckanext-password-policy).

Let me know if I can help with preparation with the like the list of plugins as likehere or if we should do this at the end.

[BWibo]

Is there a reasonable subset of plugins, that are compatible with CKAN 2.11, that we can start with?
It would be great, if you could create an overview of compatible plugins here.
Just copy the table from README.md in here and hhighlight what we can already try out.

[MarijaKnezevic]

The following plugins have been tested with CKAN 2.11 installed from source on the Ubuntu machine.
Here the table for sddi-base image:

Extension	Version	sddi-base	Description
ckanext-hierarchy	abb4e2d	✔️	Allows to organize organizations and groups in a hierarchy tree (nested groups/orgs).
ckanext-relation-sddi	1.1.0	✔️	Enables to create and visualize different types of relations (realated_to, depends_on, part_of) between catalog entries.
ckanext-spatial	8a00a2b	✔️	Enables geospatial capabilities to CKAN instance.
ckanext-scheming	27035f4	✔️	Configure and share CKAN dataset metadata forms.
ckanext-geoview	v0.2.2	✔️	Configure and share CKAN dataset metadata forms.
ckanext-datesearch	1.1.0	✔️	Provides the ability to search for datasets according to a given time frame. The search includes all datasets, in which the time of validity overlaps in at least one second with the search time frame.
ckanext-scheme-sddi	0.0.1	✔️	This plugin is extending CKAN schema definition, validation, and custom field support accordingly to SDDI needs.
ckanext-theme-sddi	0.0.1	✔️	This plugin is customizing the look of SDDI CKAN instance with theme management capabilities for improved branding and user needs.
ckanext-heroslideradmin	4b60e00	✔️	CKAN extension that enables the management of a hero slider on your CKAN site, allowing for dynamic display of featured content and improved visual engagement.
ckanext-clamav	a1d23ac	✔️	CKAN extension that integrates ClamAV antivirus scanning to ensure the security of uploaded files by automatically checking them for malware.
ckanext-fortify	bda5d12	✔️	CKAN extension that enhances data security and access control by providing robust authentication and authorization features for managing user permissions and roles. In SDDI context is used for management of password policy requirements.
ckanext-security	80dc1d6	✔️	CKAN extension that enhances data access control. In the SDDI context, context is used to define the maximum number of failed logon attempts and to automatically log off after a period of inactivity.
ckanext-dcat	v2.0.0	✔️	Allow CKAN to expose and consume metadata from other catalogs using RDF documents serialized using DCAT.

Updates and changes to plugins and the way in which this should be done are discussed with the CKAN developer.

[MarijaKnezevic]

Here are settings which I used for my ckan.ini.

The plugins must have following order:
ckan.plugins = text_view activity webpage_view datastore hierarchy_display hierarchy_form relation spatial_metadata spatial_query datesearch scheme_sddi theme_sddi scheming_datasets geo_view geojson_view wmts_view shp_view fortify security heroslideradmin dcat clamav

Additional settings from my ckan.ini which could be usefful:

> # Spatial Settings ########################################################## 
> ckanext.spatial.search_backend = solr-bbox 
> ckanext.spatial.use_postgis_sorting=true 
> ckan.spatial.srid = 4326 
> ckanext.spatial.common_map.type = custom 
> ckanext.spatial.common_map.custom.url = https://b.tiles.mapbox.com/styles/v1/mapbox/satellite-streets-v11/tiles/{z}/{x}/{y}?access_token=pk.eyJ1Ijoid2RlaWdlbGUiLCJhIjoiY2tiNWxhNmRxMHF0cTJ0bzI4Zjhua2JmZSJ9.UMGtDXPfs2z2Smc1N0p9Qw 
> ckanext.spatial.common_map.attribution = Tiles by <a href="http://mapbox.com">MapBox</a>

## Scheming ##########################################################
scheming.dataset_schemas = ckanext.scheme_sddi:sddi_dataset.yaml
scheming.presets = ckanext.scheming:presets.json ckanext.scheme_sddi:sddi_presets.json
scheming.dataset_fallback = false
ckanext.dathere_theme.column_count = 4

## SDDI security ##########################################################
ckanext.security.redis.host = 127.0.0.1
ckanext.security.redis.port = 6379
ckanext.security.redis.db = 1

ckanext.security.lock_timeout = 900
ckanext.security.login_max_count = 3
ckanext.security.brute_force_key = user_name
ckanext.security.disable_password_reset_override = true

ckanext.security.enable_totp = false

## Fortify Settings ########################################################## 
ckan.fortify.enable_password_policy = True 
ckan.fortify.password_policy.min_length = 12

The PERMANENT_SESSION_LIFETIME was changed as following:

# the users are logged out after 10 min 
PERMANENT_SESSION_LIFETIME = 600

Please note that some plugins may require additional settings when it comes to working with Docker.

[BWibo]

Thx for the pluginlist and configs.

Regarding the plugins not using a release version:

• Is there a specific reason why using e.g. the latest commit to master?
• Did you test them with the latest release version, e.g. 2.1.1 for ckanext-spatial,

[MarijaKnezevic]

By reviewing commits from the main branch, I saw that there is a relatively recent one from July 9th about supporting CKAN 2.11 and because of that I assumed that the latest release is not supporting CKAN 2.11.
I didn't checked it with latest releases since the releases are from Nov 2023. The same reason is for all community plugins, as the last releases are from 2023.

[MarijaKnezevic]

I just saw that some of the plugins recently published latest release. I'll check if they work with SDDI CKAN 2.11 and update the table.