Create a storage database

To organize your data, first you need to set up a database. You only need to create this database once. After that, you'll apply delta data updates to your database to keep your data current.

Depending on your capacity, you can do this task at two separate points in time:

• Use the sample data and the table schema to set up a storage database while you wait for your historical data.

  OR

• Once you receive and sort the parquet files that contain your historical data, you can use them with the table schema to set up a storage database.

You can find the sample data after you log into the Support Hub.

Create your storage database

Have your database administrator set up a storage database. While you can use non-relational databases, we recommend that you set up a relational database, such as an SQL database, which allows you to use SQL statements to search and organize your data.

To create your database, follow these steps:

1. Create an empty database table with the correct headers for each parquet naming convention. These naming conventions are described by the table name, such as lookup, releases, or test cases. Use the schema Excel document to help define your header names.

2. When you create an empty database, you should define a primary key, which captures any errors that occur when you apply operations.

   Here's an example of a schema you might use for the lookup table. The logic in this example depends on the use of primary keys in the database.

   lookup_table_dtypes = {
     'id': int,
     'lookupvalue':str,
     'lookuptypeid':int,
     'clientid':'Int64',
     'projectid':'Int64',
     'systemvalue': bool,
     'position':'Int64',
     'operation':str,
   }
   

3. Now, you can use our sample data to check that your schema is correct. Or, you can import your historical data from the parquet files directly into the table.

What's next

Take a look at our table schemas, which will help you set up your database.