Defining Fields in a NoSQL Database

The Fields tab displays the field and its type as defined in the NoSQL DB/Schema file.

  1. On the Fields Tab, click Regenerate.
    This generates the aggregated data based on the first 50 records. The data is displayed in the following format: Fieldname(datatype).
    Note: If the schema file is browsed, the fields are generated using the schema file and the table or view is bypassed. To reset the schema file, click Clear.
    Note: While reading data from a Couchbase DB, the key of each record is also read. This key is stored as a part of the record using an added _id field at the time of regenerating the fields, and is also included in the data sent to the next stage. If the record already has an _id field, then this would be overwritten with the added _id field at the time of regenerating the fields.
  2. To modify the name and type of a field, highlight the field, and click Modify.
  3. In the Name field, choose the field you want to add or type the name of the field.
  4. In the Type field, you can leave the data type as string if you do not intend to perform any mathematical operations with the data. However, if you intend to perform these kinds of operations, select an appropriate data type. This will convert the string data from the file to a data type that will enable the proper manipulation of the data in the dataflow.
    The stage supports the following data types:
    double
    A numeric data type that contains both negative and positive double precision numbers between 2-1074 and (2-2-52)×21023. In E notation, the range of values is -1.79769313486232E+308 to 1.79769313486232E+308.
    float
    A numeric data type that contains both negative and positive single precision numbers between 2-149 and (2-223)×2127. In E notation, the range of values -3.402823E+38 to 3.402823E+38.
    integer
    A numeric data type that contains both negative and positive whole numbers between -231 (-2,147,483,648) and 231-1 (2,147,483,647).
    long
    A numeric data type that contains both negative and positive whole numbers between -263 (-9,223,372,036,854,775,808) and 263-1 (9,223,372,036,854,775,807).
    string
    A sequence of characters.
  5. You can also add fields that are not present in the table or schema file. Click Add to add a new field. To remove a field, click Remove.
    Note: You can only add a new field under the List type.
  6. Click OK.