Creating an Index

The write to search index stage allows you to select the fields you want to be stored and indexed from your input source.
To create an index, perform these steps:
  1. On the Write to Search Index Options page, select the Create Index button in the Index field.
    You see a Create Index panel on the right corner of the page.
  2. In the Index name field, enter a unique name for the index.
    Note: You must enter the name of the index as alphanumeric only, for example, xyz123 or xyz, and it must not contain any special characters. Also, it is mandatory to enter a name. If you do not enter a name, you cannot create an index.
  3. To select the fields you want to store and index from your input source, go to the Fields table and do as follows:
    Note: It is mandatory to index and store at least one field. You can store and index the same field, or you can index one field and choose to store a different field to create an index.
    1. (Optional) Use Filter to selectively add the fields you want to index from the input source.
    2. (Optional) In the Field name, if you want to change the name of the field, enter the new name.
      Note: You must enter the field name as alphanumeric only. Make a note that you cannot change the Stage field name and is disabled for your use.
    3. Select the field Type - double, float, integer, long, or string.
    4. To store the field, select the Store checkbox.
    5. To add the field to the index for search query, select the Index checkbox.
      You see that the Analyzer is enabled.
    6. In the Analyzer field, select one of these analyzers you want to use to index the field:
      Analyzer Description
      Danish It supports Danish-language indexes and type-ahead services. It also supports many stop words and removes articles such as "at," "and," and "a" to shrink the index size and increase performance.
      Dutch It supports Dutch-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Finnish It supports Finnish-language indexes and type-ahead services. It also supports many stop words and removes articles such as "is," "and," and "of" to shrink the index size and increase performance.
      French It supports French-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      German It supports German-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Hindi It supports Hindi-language indexes and type-ahead services. It also supports many stop words and removes articles such as "by," "and," and "a" to shrink the index size and increase performance.
      Hungarian It supports Hungarian-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Italian It supports Italian-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Keyword It creates a single token from a stream of data and keeps it as is. For example, the string 'XYZ Software' would be returned as just one token 'XYZ Software.' For a comparison of Standard and Keyword analyzers, see Standard and Keyword Analyzer.
      Norwegian It supports Norwegian-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Portugese It supports Portuguese-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Russian It supports Russian-language indexes and type-ahead services. It also supports many stop words and removes articles such as "and," "I," and "you" to shrink the index size and increase performance.
      Spanish It supports Spanish-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Standard It provides a grammar based tokenizer that contains a superset of the Whitespace and Stop Word analyzers. It understands English punctuation for breaking down words, knows words to ignore (via the Stop Word Analyzer), and performs case-insensitive searching technically by conducting lowercase comparisons. For example, the string 'XYZ Software' would be returned as two tokens: 'XYZ,' and 'Software.' For a comparison of Standard and Keyword analyzers, see Standard and Keyword Analyzer.
      StopWord It removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Swedish It supports Swedish-language indexes and type-ahead services. It also supports many stop words and removes articles such as "the," "and," and "a" to shrink the index size and increase performance.
      Whitespace It separates tokens with whitespace. Somewhat of a subset of the Standard Analyzer in that it understands word breaks in English text based on spaces and line breaks.
      Note: The Analyzer is enabled only if you choose to index the field. Also, it is mandatory to select the analyzer for each index field.
  4. Select a key field from the Key field drop-down list on the basis of which you want to Write mode: Delete or Update or append the records. See the example below.

    In case of Create or overwrite mode, the Key field needs to be unique for Elastic search indexes (used in a distributed environment). The table below explains the indexing behavior if the Key field is non-unique for Elastic search index.

    Write mode Key field Elastic search index

    Create or Overwrite

    Duplicate records with same Key field All duplicate records with the same Key field are overwritten.
    Update or Append Duplicate records with same Key field Duplicates are overwritten.
    Note: You see a key field in the drop-down list only if you choose to index the field from the Fields table.
  5. Select Create.
    The index you create appears on the Index drop-down list on the Write to Search Index Options page.