Imports

Scheduled Import Definition

A scheduled import uses a Dabble view anchored by a Unique Key for timed updates of generated fields.

In IDT, the primary scheduled imports flatten tree information into the City Entries as well as generate a Location field suitable for use in Google Maps or in Dabble Map views while continuing to manage demographic information in a highly normalized form.

For example, consider a data source for idealclinical (a mindsong application under development) - FDA Device Approval Data. This federally managed site publishes Applicants, demographic data & the status of their device approvals as follows:

City
State or Country Code

There are on the order of 50,000 devices with FDA approval and 100s more are published each month where "ID" can be either the state of Idaho or the country Indonesia. There is no way to know whether the 2nd field is a State or a Country without consulting the first field:

City: Tanjung Morawa, Sumut
State or Country Code: ID

Under the rules of IDT, idealclinical administrators cleanse data on the way in by dropping the city into a geography field and letting Dabble compute all matching entries in the Container Tree.  In the above example, it soon becomes apparent that ...

Tanjung Morawa is a city and SUMUT is an abbreviation referring to the province of Sumatera Utara which is Indonesian for North Sumatra.

The service engineer creates a container node for Sumatera Utara:

Entry Status: Alias
Designation: Province
Abbrev: SUMUT
Primary Nav: North Sumatra, INDONESIA

From now on, the Alias can be used as a cleansing rule for cities that come into the system.

The Scheduled Import provides the mapped, fully qualified information to consumers through the MY Nation, My Province fields without any need for understanding the subtleties above.

With demographic data subtleties like the one above are typical.

IDT Pull Into State Scheduled Import

Export pullintostate view

  • As CSV File
  • Copy URL

Import Data into Geography

  • Import from Website
  • Paste URL
  • Update entries using MS.SOURCEKEY
  • Map Fields:
    • Export Myself : My State
    • Export Parent: My Nation
    • Export Grandparent: My Kingdom
  • Finish

Import Data

  • Make Schedule
    • Nations - Weekly
    • States - Daily
    • Cities - Hourly

 

 

 

Next Page