What's new in 10.5.1
ArcGIS Data Store 10.5.1 disables incremental backups of relational data stores by default to save disk space, expands the functionality of the backupdatastore and restoredatastore utilities, and includes a new tool to replace the SSL certificate used when communicating from the Data Store Configuration wizard or between ArcGIS Data Store machines and other ArcGIS Enterprise components.
Incremental backups disabled by default
In previous releases, incremental backups were automatically created for relational data stores. Relational data stores you create beginning with ArcGIS Data Store 10.5.1 will have incremental backups disabled by default.
If you upgrade to ArcGIS Data Store 10.5.1, incremental backups will remain enabled for your relational data store.
Note that your relational data store must have incremental backups enabled for you to use the webgisdr utility to create backups or replicate your ArcGIS Enterprise deployment to another machine. If you intend to use this utility with your newly created 10.5.1 relational data store or you want the ability to recover your relational data store to a specific point in time, use the changedbproperties utility to enable point-in-time recovery. If you do not require point-in-time recovery or the webgisdr utility in your upgraded relational data store, you can use the changedbproperties utility to disable point-in-time recovery.
Backupdatastore utility expanded to allow moving between versions
In previous releases, you needed to use the exportmanageddb utility if you wanted to restore a relational data store to an ArcGIS Data Store installation on another operating system or to a different ArcGIS Data Store version. At 10.5.1, this functionality is included when you create a backup using the backupdatastore utility, and the exportmanageddb utility is now deprecated. When you restore, even if you are moving between operating system or ArcGIS Data Store versions, use the restoredatastore utility. The importmanageddb utility is also now deprecated.
Improved functionality when restoring spatiotemporal big data stores after hardware failure
If one or more of the machines in your spatiotemporal big data store fails, you have to restore to a new machine. Most spatiotemporal big data stores contain multiple machines and large amounts of data, so restoring all the data to a single new machine would fail. At 10.5.1, the restoredatastore utility has a new operation—--loaddata. For most spatiotemporal big data stores, you will set this operation to false and create the first new spatiotemporal big data store machine for recovery without loading data. This allows you to configure more machines in your spatiotemporal big data store to accommodate all the data in the backup file, and run the restoredatastore utility again with the --loaddata operation set to true to restore all the data. See Recover a data store for more information.
New utility to update SSL certificate
The utility has been added to allow those organizations that require all web communication be authenticated using an SSL certificate from a certifying authority to replace the self-signed SSL certificate used to communicate with ArcGIS Data Store.
What's new in 10.5
ArcGIS Data Store 10.5 makes it easier to configure and manage each type of data store. It includes an expanded configuration wizard, the ability to back up and restore all data store types, safeguards against data loss due to insufficient disk space, and improvements to several utilities.
Configure specific data store types
Different data store types serve different purposes. You configure different types of data stores depending on the functionality you need and the clients you will use. The Data Store Configuration wizard has changed at 10.5 to make this process simpler and more apparent. Now you specify which type of data store to create and register with your GIS Server site. You can choose to configure a relational, tile cache, or spatiotemporal big data store.
In previous releases, the wizard always configured both a relational and tile cache data store, and it could not be used to create a spatiotemporal big data store.
Back up and restore all types of data stores
Automatic and manual backups are now possible for all data store types. Use the new configurebackuplocation utility to configure a shared network location for each data store. You must configure a shared network location for spatiotemporal big data store backups using the register operation of the configurebackuplocation utility. Use the configurebackuplocation utility with the change operation to specify a shared network location for tile cache and relational data store backups.
Once you've set a backup location, you can use the backupdatastore utility to create a manual backup of relational, tile cache, or spatiotemporal big data stores. When run on a relational data store, the backupdatastore utility creates a full backup.
As with previous releases, automatic backups are created for relational data stores by default. For tile cache and spatiotemporal big data stores, you can now run the updatebackupschedule utility to set a backup schedule after you've set a shared network backup location for these data stores.
The first spatiotemporal big data store backup created manually or automatically is a full backup. Since spatiotemporal big data stores can be very large, subsequent backups create a backup file containing only the changes since the initial full backup.
Similarly, the first time a manual or automatic backup is created for a tile cache data store, backup copies are made of all existing tile cache data store databases. Subsequent manual or automatic backups create backup copies of any tile cache data store databases created since the last time a backup was created.
The restoredatastore utility has also been expanded to allow you to restore any data store type for which you have backup files.
Read-only mode for relational data stores
If the machine on which you created your relational data store runs out of disk space, the data store becomes unusable and you can lose data. This is more likely to happen if you do not follow the recommended practice of configuring relational data store automatic backups to be created in a remote, shared directory, but it can also happen if your data store grows very large or you created the relational data store on a machine with little free disk space.
To prevent the loss of data, the primary relational data store is placed in read-only mode when the disk space of the machine on which it is running drops below a specific size. By default, that size is 1024 MB, but you can change it using the changedbproperties utility with the disk-threshold-readonly operation. Once in read-only mode, clients will not be able to complete operations—such as publishing hosted feature layers—that would result in data being copied to the relational data store.
Prior to its being placed in read-only mode, warnings appear in the log files of the hosting server indicating that relational data store disk space is getting low. By default, these messages begin appearing in the logs when the primary relational data store machine reaches 10 GB of remaining space. ArcGIS Data Store checks the disk size every hour; consequently, messages are logged hourly.
When the remaining disk space drops below 1024 MB or the size you specified using the changedbproperties utility, the relational data store is placed in read-only mode.
Once you have added disk space to the primary data store machine, run the changedatastoremode utility to set the relational data store back to read/write mode, and run the updatebackupschedule utility to reestablish automatic backups for the relational data store.
You can also use the changedatastoremode utility to place the primary relational data store in read-only mode while you perform maintenance tasks on the machine.
The describedatastore utility returns an additional line of information when run on the primary relational data store machine to indicate whether the data store is in read-only or read/write mode.
Disk space monitoring for tile cache and spatiotemporal big data stores
ArcGIS Data Store also monitors the remaining disk space on tile cache and spatiotemporal big data store machines. When remaining disk space drops below 10 GB, warnings are logged to let you know that you need to add disk space. Once the disk space on the data store drops below 1024 MB, the data store shuts down to avoid data loss.
Once you have added disk space to the data store machine, you can either restart the ArcGIS Data Store service on that machine (if there is only one type of data store installed on the machine), or sign in to the ArcGIS Server Administrator Directory for the hosting server and use the start REST function to restart the tile cache or spatiotemporal big data store machine.
Changes to ArcGIS Data Store command utilities
Most of the changes made to command utilities were done to improve administration of all three types of data stores.
As part of the improvements to clarify and simplify administration of different data store types, new options were added to the unregisterdatastore and removemachine utilities to allow you to specify which type of data store you want to unregister or remove. This is useful if you have more than one type of data store installed on the same machine—you can unregister, for example, the tile cache data store without unregistering the relational data store. Similarly, you can remove one spatiotemporal big data store machine without affecting any other data stores.
The backupdatastore, restoredatastore, and updatebackupschedule utilities can now be used with all three types of data stores. As a result, the syntax for each utility has changed.
Since you can now create a backup of all data store types, the listbackups utility can return information on backups made for each type of data store.
The output from the describedatastore utility has been expanded and modified to better represent information for each type of data store.
The listmanageduser utility now returns the user name and password for the data owner for all three types of data stores.
The following changes have been made to the changedbproperties utility:
- You can now specify which data store type to configure when you run the changedbproperties utility.
- The disk-threshold-readonly operation was added to allow you to control when your relational data store machine is placed in read-only mode due to disk space size constraints.
- Two options specific to spatiotemporal big data stores were renamed: the reallocation option is now rebalance and the max-allocation-off option is now max-rebalance-off. These new names more accurately reflect the action the spatiotemporal big data store is taking when these properties are set.
The new changedatastoremode utility allows you to place a relational data store in a read-only state and put it back in a read-write state when you are ready to allow clients to write data to, or edit data in, the relational data store again.
The changebackuplocation utility has been deprecated. Although the changebackuplocation utility is still present to allow existing scripts to function, you should now use the configurebackuplocation utility instead.