diff --git a/admin-manual/installation-setup/customization/scaling-archivematica.rst b/admin-manual/installation-setup/customization/scaling-archivematica.rst index 02321687..5e84f75c 100644 --- a/admin-manual/installation-setup/customization/scaling-archivematica.rst +++ b/admin-manual/installation-setup/customization/scaling-archivematica.rst @@ -393,13 +393,6 @@ Some of the default preservation action rules can take considerable processing time and resources. We have found the following rules useful to change in some cases. -**Turn off default characterization rule:** `FITS`_ is used to characterise files -that don't have a recognised file format. Executing this rule takes processing -time and adds raw output to the METS file that can be low value for some -formats. For example, in scientific datasets with large numbers of generic text -files, or binary files created by instruments in scientific experiments, the -output can be verbose without being useful. - **Reduce number of image characterization rules:** Archivematica has rules defined for all image and audio-visual formats to use ExifTool, Mediainfo and ffprobe for characterisation. Using multiple tools ensures as much @@ -432,5 +425,4 @@ to create (and check) than the alternatives (e.g. SHA-256). .. _Archivematica user forum: https://groups.google.com/forum/#!forum/archivematica .. _Dashboard: https://github.com/artefactual/archivematica/tree/6ead2083f7bdd8b10ca76d41a7bff9c5aee23eb3/src/dashboard/install .. _benchmarking: https://www.itforarchivists.com/siegfried/benchmarks -.. _FITS: https://projects.iq.harvard.edu/fits/home .. _Database is locked: https://docs.djangoproject.com/en/1.8/ref/databases/#database-is-locked-errors diff --git a/admin-manual/installation-setup/installation/installation.rst b/admin-manual/installation-setup/installation/installation.rst index 735e9ecc..4f2d373d 100644 --- a/admin-manual/installation-setup/installation/installation.rst +++ b/admin-manual/installation-setup/installation/installation.rst @@ -85,7 +85,7 @@ information, see :ref:`Advanced `. the Percona and MariaDB alternatives. Some of the tools run by Archivematica require Java to be - installed (primarily Elasticsearch and fits). On Ubuntu 22.04, Open JDK 8 + installed (primarily Elasticsearch). On Ubuntu 22.04, Open JDK 8 is used, but Open JDK 11 is the default. It is possible to use Oracle Java 8 instead. diff --git a/admin-manual/installation-setup/installation/scripts/am-jammy-deb.sh b/admin-manual/installation-setup/installation/scripts/am-jammy-deb.sh index f1e50ba2..70aa157d 100644 --- a/admin-manual/installation-setup/installation/scripts/am-jammy-deb.sh +++ b/admin-manual/installation-setup/installation/scripts/am-jammy-deb.sh @@ -50,8 +50,6 @@ sudo service archivematica-mcp-client restart sudo service archivematica-storage-service start sudo service archivematica-dashboard restart sudo service nginx restart -sudo systemctl enable fits-nailgun -sudo service fits-nailgun start sudo ufw allow 22/tcp sudo ufw allow 80/tcp diff --git a/admin-manual/installation-setup/installation/scripts/am-rocky-rpm.sh b/admin-manual/installation-setup/installation/scripts/am-rocky-rpm.sh index 62bd1ba0..2508a17a 100644 --- a/admin-manual/installation-setup/installation/scripts/am-rocky-rpm.sh +++ b/admin-manual/installation-setup/installation/scripts/am-rocky-rpm.sh @@ -100,8 +100,6 @@ sudo -u root sed -i 's/^Example//g' /etc/clamd.d/scan.conf sudo -u root systemctl enable archivematica-mcp-client sudo -u root systemctl start archivematica-mcp-client -sudo -u root systemctl enable fits-nailgun -sudo -u root systemctl start fits-nailgun sudo -u root systemctl enable clamd@scan sudo -u root systemctl start clamd@scan sudo -u root systemctl restart archivematica-dashboard diff --git a/admin-manual/maintenance/maintenance.rst b/admin-manual/maintenance/maintenance.rst index 6e7d5a49..f27c3c5d 100644 --- a/admin-manual/maintenance/maintenance.rst +++ b/admin-manual/maintenance/maintenance.rst @@ -502,7 +502,6 @@ Other services that Archivematica depends on are: * ElasticSearch * Gearman * MySQL (Ubuntu) or MariaDB (Rocky Linux) - * Nailgun * Nginx Each service can be started/stopped/restarted with: diff --git a/getting-started/overview/external-tools.rst b/getting-started/overview/external-tools.rst index e193fcbb..f4278676 100644 --- a/getting-started/overview/external-tools.rst +++ b/getting-started/overview/external-tools.rst @@ -66,12 +66,6 @@ to identify the file formats of digital objects. **License**: `Apache License Version 2.0`_ -`File Information Tool Set (FITS)`_ -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ -File format identification and validation software integration tool. - -**License**: `GNU Lesser General Public License`_ - `Gearman`_ ^^^^^^^^^^ Gearman provides a generic application framework to farm out work to other @@ -120,12 +114,6 @@ data for video and audio files. **License**: `BSD (2-clause)`_ -`Nailgun`_ -^^^^^^^^^^ -A client, protocol, and server for running Java programs from the command line. - -**License**: `Apache License Version 2.0`_ - `NFS-common`_ ^^^^^^^^^^^^^ Network File System Access - allows access to files on network storage devices. @@ -203,7 +191,6 @@ The Unarchiver is an archive unpacker program. .. _ExifTool: https://exiftool.org/index.html .. _FFmpeg: http://ffmpeg.org/ .. _fido: https://github.com/openpreserve/fido/ -.. _File Information Tool Set (FITS): https://projects.iq.harvard.edu/fits .. _Gearman: http://gearman.org/ .. _Ghostscript: https://www.ghostscript.com/ .. _GNU Affero General Public License (AGPL): https://www.gnu.org/licenses/agpl-3.0.en.html @@ -219,7 +206,6 @@ The Unarchiver is an archive unpacker program. .. _JHOVE: https://github.com/openpreserve/jhove .. _MediaConch: https://mediaarea.net/MediaConch .. _MediaInfo: https://mediaarea.net/en/MediaInfo -.. _Nailgun: https://github.com/facebook/nailgun .. _NFS-common: https://linux-nfs.org .. _p7zip: http://p7zip.sourceforge.net/ .. _Python-lxml: https://lxml.de/ diff --git a/getting-started/troubleshooting/error-handling.rst b/getting-started/troubleshooting/error-handling.rst index a0c087f1..02bfcac1 100644 --- a/getting-started/troubleshooting/error-handling.rst +++ b/getting-started/troubleshooting/error-handling.rst @@ -178,9 +178,9 @@ The user may choose to continue processing the SIP despite any normalization errors. The user may choose to redo normalization, as well. For instance, if -the user chose to normalize based on FITS-JHOVE results and experienced +the user chose to normalize based on one tool's results and experienced failures, the user may wish to redo normalization and choose to normalize -based on FITS-DROID results instead. +based on another tool's results instead. .. figure:: images/Normdropdown-10.* :align: center @@ -269,10 +269,9 @@ Other common error behaviours Below is a list of common errors that, like normalization, will produce an error report but will not fail the transfer. -#. Characterize and extract metadata: if FITS processing fails, the +#. Characterize and extract metadata: if the characterization tool fails, the micro-service will fail and the transfer will continue processing. - Similarly, if a tool within FITS fails, like JHOVE, you will see the pink - error bar but be able to continue processing. + You will see the pink error bar but be able to continue processing. #. Remove thumbs.db file: if Archivematica is unable to remove a thumbs.db file, the microservice will fail and the SIP will continue processing. diff --git a/user-manual/preservation/preservation-planning.rst b/user-manual/preservation/preservation-planning.rst index 86f6b4c1..6bf4b14c 100644 --- a/user-manual/preservation/preservation-planning.rst +++ b/user-manual/preservation/preservation-planning.rst @@ -178,10 +178,9 @@ Tools ^^^^^ Archivematica acts as a wrapper for many open source tools used to carry out -preservation actions. These include digital preservation specific tools like -`FITS`_, used for extracting technical metadata from files, as well as tools for -handling different file formats like `Inkscape`_, which is a design program used -to handle vector images. +preservation actions. These include digital preservation specific tools (such as +those to carry out file format identification and characterization) as well as +generalist tools used for actions such as normalization. The full list of tools can be accessed in the left-hand sidebar by selecting **Tools** under the *Format policy registry* heading. @@ -503,13 +502,11 @@ Archivematica has four characterization tools available upon installation. Which tool will run on a given file depends on the type of file, as determined by the identification tool. -The default characterization tool is FITS; it will be used if no specific -characterization rule exists for the file being scanned. It is possible to -create new default characterization commands, which can either replace FITS or -run alongside it on every file. +It is possible to create new default characterization commands, which can run +on every file. Depending on the type of the file being scanned, one or more of these tools may -be called instead of FITS. +be called. * `FFprobe `_, a characterization tool built on top of the same core as FFmpeg, the normalization software used by Archivematica. @@ -539,9 +536,8 @@ For more information about writing a command, see :ref:`Writing commands Characterization rules ^^^^^^^^^^^^^^^^^^^^^^ -A characterization rule must be created to connect a characterizatio command to -a particular format. Note that formats that do not have a rule will be -characterized by FITS by default. +A characterization rule must be created to connect a characterization command to +a particular format. For more information about creating a rule, see :ref:`Changing rules ` above. @@ -1087,7 +1083,6 @@ You do not need to create rules for verification. .. _Ghostscript: https://www.ghostscript.com/ .. _ps2pdf: https://www.ps2pdf.com/ .. _Archivematica issues repo: https://github.com/archivematica/Issues -.. _FITS: https://projects.iq.harvard.edu/fits/home .. _JHOVE: https://openpreservation.org/products/jhove/ .. _MediaConch documentation: https://mediaarea.net/MediaConch/Documentation/HowToUse .. _MediaConchOnline: https://mediaarea.net/MediaConchOnline/ diff --git a/user-manual/transfer/forensic.rst b/user-manual/transfer/forensic.rst index 59eb2b01..c03cf7c7 100644 --- a/user-manual/transfer/forensic.rst +++ b/user-manual/transfer/forensic.rst @@ -45,11 +45,8 @@ in the processing configuration by setting the *Extract packages* job to "No". If you would like to extract forensic image formats anyway, you can set the *Extract packages* job to "Yes". We recommend testing this at scale to ensure -that it is a viable workflow for your deployment. One scalability option that -can help to mitigate the processing load caused by extraction is turning off -`FITS`_, which is the default characterization tool that will run on every -extracted file. For more information, see :ref:`Preservation Action Rules -` on the Scalability page. +that it is a viable workflow for your deployment. For more information, see +:ref:`Preservation Action Rules ` on the Scalability page. Delete packages after extraction ++++++++++++++++++++++++++++++++ @@ -160,5 +157,4 @@ desired, by using the backlog arrangement functionality in Archivematica. .. _Bulk Extractor: https://github.com/simsong/bulk_extractor/wiki -.. _FITS: https://projects.iq.harvard.edu/fits/home .. _fiwalk: https://forensicswiki.xyz/wiki/index.php?title=Fiwalk