Difference between revisions of "CKAN Administration"
(Fix instructions for changing number of background workers) |
(Add link to Data Dictionaries page) |
||
Line 4: | Line 4: | ||
A few samples (to eventually migrate over): | A few samples (to eventually migrate over): | ||
* [https://github.com/WPRDC/data-guide/blob/master/docs/PublishingCKAN.md Our documentation for publishers on publishing data on the WPRDC] | * [https://github.com/WPRDC/data-guide/blob/master/docs/PublishingCKAN.md Our documentation for publishers on publishing data on the WPRDC] | ||
* [https://github.com/WPRDC/data-guide/blob/master/docs/data_dictionaries.md How to create data dictionaries] | * [https://github.com/WPRDC/data-guide/blob/master/docs/data_dictionaries.md How to create data dictionaries] ==> [[Data Dictionaries]] | ||
* [https://github.com/WPRDC/data-guide/blob/master/docs/metadata_extras.md Some of our standard extra metadata fields] | * [https://github.com/WPRDC/data-guide/blob/master/docs/metadata_extras.md Some of our standard extra metadata fields] | ||
Revision as of 20:41, 8 March 2022
Changes that can be made through the frontend
There's a lot of documentation on publishing data on our CKAN portal here.
A few samples (to eventually migrate over):
- Our documentation for publishers on publishing data on the WPRDC
- How to create data dictionaries ==> Data Dictionaries
- Some of our standard extra metadata fields
Changes that can be made through the backend
Configuring the CKAN server
(The contents of this section were initially taken from the ORIENTATION
file in /home/ubuntu
on the CKAN production server.)
- The main CKAN config file is at
/etc/ckan/default/production.ini
- To monitor HTTP requests in real-time:
> tail -f /var/log/nginx/access.log
- Service-worker activity (like the Express Loader uploading files to the datastore and background geocoding) can be found in:
/var/log/ckan-worker.log
- Edit templates here (changes to templates should show up when reloading the relevant web pages):
/usr/lib/ckan/default/src/ckanext-wprdctheme/ckanext/wprdc/templates
templates/terms.html
is the source for the pop-up version of the Terms of Use. There appears to be no template linked to the "Terms" hyperlink.
- Create a file
templates/foo.html
and then run> sudo service supervisor restart
and THEN loaddata.wprdc.org/foo.html
in your browser, and the page will be there.
- Presumably
data.wprdc.org/foo/
can be populated by creating a file attemplates/foo/index.html
.
Managing the CKAN server
- To restart the Express Loader:
> sudo supervisorctl restart ckan-worker:*
- To edit the background worker configuration (including increasing the number of background workers),
- Edit the config file:
> vi /etc/supervisor/conf.d/supervisor-ckan-worker.conf
- Tell Supervisor to use the new configuration:
> sudo supervisorctl reread
- Update the deployed configuration to start the desired number of workers:
> sudo supervisorctl update
- Edit the config file:
- Activate the virtual environment that lets you run
paster
commands:> . /usr/lib/ckan/default/bin/activate
Adding/changing departments of publishers
To add or change the departments belonging to a particular publisher organization edit the dataset_schema.json
file: > vi /usr/lib/ckan/default/src/ckanext-scheming/ckanext/scheming/dataset_schema.json
Then run > sudo service apache2 reload
The extra tricky part about this one is that our GitHub repository that includes this JSON file is installed in a different directory: /usr/lib/ckan/default/src/ckanext-wprdctheme/
but changes to the files in that directory (and subdirectories) do nothing.
Other changes
Using CKAN metadata instead of local caches
To avoid keeping local databases about datasets (for instance, when writing code to track some aspect of datasets), store such information (such as the last time an ETL job was run on a given package) in the 'extras' metadata field of the CKAN package, as much as possible. This stores information in a centralized location so ETL jobs can be run from multiple computers without any other coordination. The extras metadata fields are cataloged on the CKAN Metadata page.
Hacky workaround for adding new users to publishers
In additional to adding the users to the organizations through the CKAN front-end, you also have to add them to groups, using this URL: [1]