A new version of the nxs-data-anonymizer instrument, version 1.4.0, has been released. This tool is designed for anonymous dumping of databases in PostgreSQL and MySQL/Mariadb/Percona. It allows for data anonymization based on Sprig library templates and functions. One of the key features is the ability to fill in values for other columns within the same row. Users can utilize the tool through unexplored channels (PIPE) on the command line and redirect the dump from the original database directly to the target database with the necessary transformations. The nxs-data-anonymizer is written in Go and distributed under the Apache License 2.0.
Less than a year after the initial release of version 1.0.0, the following new features have been added to the tool:
- Added the function of filters for working with NULL values.
- Implemented the command -l/-log-format, allowing users to choose the logistics format (json or plain).
- Introduced an anonymization process that displays data on the progress of the operation through specified intervals.
- It is now possible in version 1.4.0 to set field values using external commands by adding “Type: Command” to the column. For example: filters: some_table_name: columns: some_column_name: type: command value: /path/to/command/or/script.sh. If the column specifies “type: command”, the value in the field will be interpreted as the file path to the command, which will be executed each time for that field. Additional environment variables will be available during the command execution:
- envvartable = {table_name}: contains the name of the filtered table
- envvarcolumn_{column_name} = {column_value}: contains all the columns and their values (before replacement) for the current filtered line. The command STDOUT is considered the new value of the filtered field.