Command-line interface¶

./manage.py --help

Commands¶

Orchestrate and evaluate all jobs and tasks.

./manage.py manageprocess

For each publication, call data_registry.process_manager.process()
For each complete job whose temporary data isn’t to be preserved or already deleted:
- Wipe all intermediate output of non-final tasks
- Mark the job as having deleted its temporary data

In production, this command runs every few minutes.

Note

Start each worker before publishing messages with the manageprocess command.

Tip

Set the LOG_LEVEL environment variable to DEBUG to see log messages about message processing. For example:

env LOG_LEVEL=DEBUG ./manage.py flattener

Export JSON files from compiled collections in Kingfisher Process.

./manage.py exporter

Deletes files in the export directory before processing.
Uses a lockfile to determine whether the processing of a job is in-progress.
Acknowledges the messages after creating the lockfile, but before exporting files.

The lockfile is not deleted if an unhandled exception occurs.

Convert JSON files to Excel and CSV files.

./manage.py flattener

Does not delete files in the export directory before processing.
Uses a lockfile to determine whether the processing of a file is in-progress.
Acknowledges the messages before the Splitter pattern and before converting files.

The lockfile is not deleted if an unhandled exception occurs.

Delete export directories.

./manage.py wiper