Add a data store item

There are several types of user-maintained data stores you can reference from your organization by adding a data store item. Each one requires you to provide different information, and each is used for a different purpose.

Note:

Even though you add the data store to the portal, this process registers the data store with federated servers. Therefore, every machine in each federated ArcGIS Server site must be configured to access the database, folder, or cloud storage location.

If the user-maintained data store is already registered with one or more of the portal's federated ArcGIS Server sites—for example, you registered the data store in ArcGIS Pro 2.4 or an earlier release or ArcGIS Server Manager—do not use these steps to add the data store item. Instead, talk to your organization administrator about creating a data store item from an existing registered data store.

The following sections describe how to add each type of data store. Use the links below to access instructions to add the user-maintained data store type you need.

• Folder
• Database (includes databases, enterprise geodatabases, and cloud data warehouses)
• Cloud storage
• Big data file share
• NoSQL database

Add a folder data store item

To publish layers from files in a shared folder, add a folder data store item.

1. To add a folder as a data store, ensure the folder functions as a network file share (NFS) location.

   For more information on making data sources accessible, see Controlling access to data published from data store items.

2. Open the portal and sign in.

   You must sign in as a member who has privileges to create content and register data stores.

3. From the My Content tab of the Content page, click New item and click Data store.
4. Choose Folder for the type of data store item to create and click Next.
5. Type the path to the folder.
6. Provide information for your data sources.

   If the ArcGIS clients used to publish the data will access data in one folder but the federated ArcGIS Server sites need to access a copy of the data in a second folder, you must provide information for both data sources.

   • If the publishing clients and the federated servers will access data in the same shared folder, leave the default setting, Same as publisher folder path.
   • If you have duplicated the data in two different file shares and want clients and the ArcGIS Server sites to reference different file shares, choose New path under Server folder path, and type the path to the second file share.
7. Click Next to choose the ArcGIS Server sites with which this data store will be registered.
8. Select the ArcGIS GIS Server and ArcGIS Image Server sites with which you want to register this data store. If you are unsure which sites fill these roles, contact your ArcGIS Server administrator.

   You can only select a site if the status is normal, which means the site can connect to the data source.

   Note:

   If this data store is already registered with a federated server—for example, you registered with one of the federated servers in ArcGIS Server Manager—you cannot select that federated server from the list. If you do, you'll receive an error.

9. Click Next.
10. Type a title for the data store item.

    This is the name of the item that will appear in the portal and ArcGIS Pro.

11. Optionally, type tags that describe the item.

    Separate the terms with commas (for example, Federal land is considered one tag; Federal, land is considered two tags).

    As you type, you can select any of the suggested tags that appear; suggestions are generated from tags you have added previously.

12. Choose the folder in My Content where you want to store the data store item.
13. Click Add data store.

If you added a folder data store, share the data store item with groups whose members need to create imagery layers.

Add a database data store item

To publish map image and feature layers from database content or publish map image layers from cloud data warehouse content accessed through a database connection file (.sde), add a database data store item. If the data is stored in a database or enterprise geodatabase, you, as the owner of the database data store item, can also publish map image and feature layers in bulk from the data store item in the portal.

1. To add a database data store, you must first create a database connection file (.sde file) connecting to a supported database or cloud data warehouse. Connect using credentials for an account or user that has access to the data you need and the required permissions on the data. You must save the credentials with the connection file. You cannot use an .odc file.

   For more information on making data sources accessible, see Controlling access to data published from data store items.

2. Open the portal and sign in.

   You must sign in as a member who has privileges to create content and register data stores.

3. From the My Content tab of the Content page, click New item and click Data store.
4. Choose the Database data store type.
5. Click Next to configure the connection to the source data.
6. Click Choose File and browse to the database connection file (.sde) that accesses the database, enterprise geodatabase, or cloud data warehouse that you want to register.
7. Provide information for your data sources.

   In most cases, the clients used to publish layers from this registered data store will use the same location as the ArcGIS Server site. However, if your ArcGIS client will access data in one database but the federated ArcGIS Server sites need to access a copy of the data in a second database, you must provide information for both data sources.

   • If your clients and the federated servers will access data in the same database or geodatabase, leave the default setting, Same as publisher database connection.
   • If you have duplicated the data in two enterprise geodatabases and want clients and the ArcGIS Server sites to reference different geodatabases, choose New connection under Server database connection (.sde file), and choose the database connection file that the federated ArcGIS Server sites will use to connect to the data in the other geodatabase.
8. Click Next to choose the ArcGIS Server sites with which this data store will be registered.
9. Select the ArcGIS GIS Server sites with which you want to register this data store. If you are unsure which sites fill these roles, contact your ArcGIS Server administrator.

   You can only select a site if the status is normal, which means the site can connect to the data source.

   Note:

   If this data store is already registered with a federated server—for example, you registered with one of the federated servers in ArcGIS Server Manager—you cannot select that federated server from the list. If you do, you'll receive an error.

10. Click Next.
11. Type a title for the data store item.

    This is the name of the item that will appear in the portal and ArcGIS Pro.

12. Optionally, type tags that describe the item.

    Separate the terms with commas (for example, Federal land is considered one tag; Federal, land is considered two tags).

    As you type, you can select any of the suggested tags that appear; suggestions are generated from tags you have added previously.

13. Choose the folder in My Content where you want to store the data store item.
14. Click Add data store.

If you added a database data store item and chose a federated ArcGIS GIS Server site to register it with, you can publish map image and feature layers for all the feature classes accessible through this data store item and publish table layers for all the tables accessible through this data store item as long as the data store does not access a cloud data warehouse. If members of your organization will be publishing data from this database connection in ArcGIS Pro, share the data store item with a group to which those members belong. This allows these members to publish data using the same database credentials to any of the federated servers you specified in step 13.

Add a cloud data store item

Add a cloud data store item to publish imagery layers from image files in a cloud storage location and to publish scene, tile, or vector tile layers that reference content in a cloud storage location.

1. To add a cloud store, you must have an account with a supported cloud storage provider, and the cloud storage location must exist.

   For more information on making data sources accessible, see Controlling access to data published from data store items.

2. Open the portal and sign in.

   You must sign in as a member who has privileges to create content and register data stores.

3. From the My Content tab of the Content page, click New item and click Data store.
4. Choose Cloud for the type of data store item to create.
5. Click Next to configure the connection to the source data.
6. Choose a cloud storage provider and specify credentials to connect.

   The information you must specify varies by provider type.

   Note:

   To connect to a private cloud, choose Custom from the Region drop-down menu and type or paste the URL to access the private cloud in the Private URL field.

   • Amazon S3

     Provide the following to connect to an Amazon Simple Storage Service (S3) bucket or an S3 compatible bucket:

     • Choose a credential type: either use an IAM role or an access key. If you use an access key, you must provide the access key ID and corresponding secret access key you obtained from your Amazon Web Services (AWS) account.
     • Choose the region where the bucket exists and type the name of the bucket.
     • To register a subfolder in the bucket, type the path to the folder.

   • Google Cloud Storage

     Provide the following to connect to a Google Cloud bucket:

     • Provide the access key ID and corresponding secret access key you obtained from your Google Cloud account.
     • To register a subfolder in the bucket, type the path to the folder.

   • Microsoft Azure Storage

     Provide the following to connect to a Microsoft Azure Blob storage location:

     • Provide the name of your Microsoft Azure and the account key to access it.
     • Choose the Azure environment where the storage location exists.
     • Provide the name of the Blob storage container.
     • To register a subfolder in the storage container, type the path to the folder.

   • Alibaba Cloud Storage

     Provide the following to connect to an Alibaba Cloud Object Storage Service (OSS) bucket:

     • Provide the access key ID and corresponding secret access key you obtained from your Alibaba account.
     • Choose the region where the bucket exists and type the name of the bucket.
     • To register a subfolder in the bucket, type the path to the folder.

7. Click Next to choose the ArcGIS Server sites with which this data store will be registered.
8. Select the ArcGIS GIS Server and ArcGIS Image Server sites with which you want to register this data store. If you are unsure which sites fill these roles, contact your ArcGIS Server administrator.

   You can only select a site if the status is normal, which means the site can connect to the data source.

   Note:

   If this data store is already registered with a federated server—for example, you registered with one of the federated servers in ArcGIS Server Manager—you cannot select that federated server from the list. If you do, you'll receive an error.

9. Click Next.
10. Type a title for the data store item.

    This is the name of the item that will appear in the portal and ArcGIS Pro.

11. Optionally, type tags that describe the item.

    Separate the terms with commas (for example, Federal land is considered one tag; Federal, land is considered two tags).

    As you type, you can select any of the suggested tags that appear; suggestions are generated from tags you have added previously.

12. Choose the folder in My Content where you want to store the data store item.
13. Click Add data store.

Share the data store item with groups whose members need to create imagery layers.

Add a big data file share

When you create a big data file share data store, it creates an associated big data file share item in your organization. Use the associated big data file share item to access data to use as input to or to store output data generated from GeoAnalytics Tools.

1. To add a big data file share, you must have an existing file share location or a storage location in the cloud that contains your data. See Get started with big data file shares for instructions.

   For more information on making data sources accessible, see Controlling access to data published from data store items.

2. Open the portal and sign in.

   You must sign in as a member who has privileges to create content and register data stores.

3. From the My Content tab of the Content page, click New item and click Data store.
4. Choose Big data file share for the data store type.

   This option is available only if the portal has a GeoAnalytics Server configured.

5. Click Next to configure the connection to the source data.
6. To connect to a big data file share, type the path to a shared folder or access an Apache Hadoop Distributed File System (HDFS) directory or Apache Hive metastore database by providing the appropriate information to connect to the storage location.

   Alternatively, you can choose an existing cloud store or create a cloud store by choosing the storage provider and credentials to access it. Whether you use an existing cloud store or create one, only Microsoft Azure Blob storage, Amazon Simple Storage Service (S3) buckets, or S3 compatible buckets are supported.

7. Provide information for your data source.

   The information you provide varies by the source. See Get started with big data file shares for instructions.

8. Click Next to choose the ArcGIS Server site with which this data store will be registered.

   Big data file shares can only be registered with the portal's ArcGIS GeoAnalytics Server site.

   You can only select a site if the status is normal, which means the site can connect to the data source.

9. Click Next.
10. Type a title for the data store item.
11. Optionally, type tags that describe the item.

    Separate the terms with commas (for example, Federal land is considered one tag; Federal, land is considered two tags).

    As you type, you can select any of the suggested tags that appear; suggestions are generated from tags you have added previously.

12. Choose the folder in My Content where you want to store the data store item.
13. Click Add data store.

When you create a big data file share data store, two or three items are created in your organization—a big data file share item, a big data file share data store item, and—if you used a cloud store—a cloud data store item. These items are interdependent, but you will only interact with the big data file share item unless you have to delete the items.

Add a NoSQL database

To store a knowledge graph in a supported NoSQL database that you control, you must add a NoSQL data store item to the portal and register it with the portal's Knowledge Server site.

You need one NoSQL database per knowledge graph that you create in ArcGIS Pro. The settings you use when creating the knowledge graph determine whether the NoSQL database can contain data before you create the data store item or whether it has to be empty. See Considerations for Neo4j databases used as NoSQL data stores and the ArcGIS Knowledge Server system requirements for more information.

1. Open the portal and sign in.

   You must sign in as a member who has privileges to create content and register data stores.

2. From the My Content tab of the Content page, click New item and click Data store.
3. Choose NoSQL and click Next.

   This option is only present if the portal has a Knowledge Server configured.

4. Leave Neo4j selected and click Next.
5. Provide the connection URI and authentication information to connect to the Neo4j instance and database and click Next.

   See Neo4j Java driver documentation for connection requirements.

6. Click Next to choose the ArcGIS Server site with which this data store will be registered.

   NoSQL data stores can only be registered with the portal's ArcGIS Knowledge Server site.

   You can only select a site if the status is normal, which means the site can connect to the data source.

7. Click Next.
8. Type a title for the data store item.

   This is the name of the item that will appear in the portal and ArcGIS Pro.

9. Optionally, type tags that describe the item.

   Separate the terms with commas (for example, Federal land is considered one tag; Federal, land is considered two tags).

   As you type, you can select any of the suggested tags that appear; suggestions are generated from tags you have added previously.

10. If the organization administrator has configured content categories, click Assign Category and select up to 20 categories to help people find the item.

    You can also use the Filter categories box to narrow the list of categories.

11. Choose the folder in My Content where you want to store the data store item.
12. Click Add data store.

A data store item is created in your content.

Share the data store item with groups whose members will create a knowledge graph in ArcGIS Pro.