What's new in Enigma Public


November 30

Viewing a dataset’s history

Enigma Public’s new History feature displays a list of all previous snapshots for a dataset. You can view each snapshot to see the version of the dataset that was “current” as of that date and time.

September 18

New look for the UI

Enigma Public has a sleeker and more streamlined interface, with a greater emphasis on searching. The navigation bar has been redone to make the Docs, Projects, and About links are more visible and accessible. The site is now mobile-friendly and responsive. In mobile view, use the icon to toggle the dataset inspector.

May 31

The data viewer’s Statistics pane now lets you filter the dataset rows using the Frequency Rank items (for columns of type string only). In the example below, clicking Starbucks will display rows where the Business Name is Starbucks. This is the same as using the column filter and searching for Starbucks.

May 1

Filtering search results

You can now filter search results by collection, by dataset size, and by the date the datasets were last updated. For details, see Filtering search results.

‘search_filter’ API parameter is now ‘filter’

The search_filter parameter on the GET /collections/, GET /datasets/, GET /datasets/{id}/snapshots/, and GET /dataset_summary endpoints has been changed to filter (the functionality is the same). The old search_filter label will continue to work, but you should update any Enigma Public API clients that use this parameter.

March 28

Browsing by tag

You can now browse datasets by descriptive tag from the left navigation pane of the data browser (click “See more” within the pane to view the full list of available tags). Tags provide a alternative way to explore what’s available on Enigma Public. You can still browse the collection hierarchy using the list of collections displayed below Tags in the left browse pane.

Serial IDs

Snapshots brought into Enigma Public recently include an “Enigma Serial ID” column that’s displayed in the data viewer.

The Enigma serial ID is numeric identifier added by Enigma (not part of the source dataset) that’s unique for each row within the snapshot. You can use it in conjunction with the snapshot UUID to uniquely identify any record stored in Enigma Public.

The Enigma Public API GET /datasets/{id}, GET /snapshots/{id}, GET /datasets/{id}/snapshots/{id}, and GET /export/{id} endpoints now have an include_serialids parameter that lets you specify whether or not to include serial IDs in the returned data. Serial IDs are always included when you export data using the Export button.

Viewing earlier versions of a dataset

You can now view datasets as they existed “as of” a previous point in time. For details, see Viewing a dataset as of a previous time.

The Enigma Public API can now return rows from any earlier snapshot if you set row_limit > 0 on the GET /snapshots/{id} endpoint. Previous versions of Enigma Public could only return rows from the current snapshot. To get the UUIDs for all snapshots associated with a particular dataset, use GET /datasets/{id}/snapshots/.

Location-based searching

The Enigma Public API now supports location-based searching on snapshots that include location information in a supported geo_point or geo_shape format. See Location-based searches for details. Most Enigma Public datasets do not yet include location information in the required format – this is something we’ll be working on adding in the future.

Dataset summary information

The API’s new GET /dataset_summary endpoint returns aggregated summaries of all datasets that match the specified filters (if any).

Returning datasets based on row count

The GET /datasets/ endpoint includes two new parameters for searching based on the dataset size:

  • min_row_count returns only datasets with at least the specified number of rows.
  • max_row_count returns only datasets with less than the specified number of rows.

March 10

The data viewer now includes a Visualize in Tableau button that displays information about using the Enigma Public Web Data Connector to import the current dataset into Tableau. You’ll need to install Tableau Public (free) or Tableau Desktop on your computer to use this feature.

March 1

This release includes the following enhancements for Enigma Public API users:

The mode parameter on GET /collections/, GET /datasets/, GET /datasets/{id}, GET /datasets/{id}/snapshots/{id}, GET /snapshots/{id}, and GET /export/{id} lets you specify phrase as a value. A new phrase_distance parameter on each of these endpoints lets you specify the search distance. For example:

  • If you specify query=sovereign%20country and phrase_distance=0, the two words must be next to each other and in the same order.
  • If you specify query=sovereign%20country and phrase_distance=1, the query also matches “sovereign island country”.
Sorting and filtering datasets

You can now use the sort parameter on the GET /datasets/ endpoint to sort the returned datasets by created_at, data_updated_at, or schema_updated_at. See GET /datasets/ for details.

The search_filter parameter on the GET /datasets/ endpoint now lets you locate datasets that were created before or after the date you specify. See GET /datasets/ for details.


December 29

The dataset inspector now includes separate tabs for lineage metadata (which may include links to the source data as well as details of when the dataset was last updated) and field information. For details, see Selecting a dataset and Viewing a dataset.

The star icon lets you save the dataset to a personal collection.

December 8

When you’re signed into Enigma Public, you’ll see our newest datasets featured at the top of the home page.

The dataset viewer now supports filtered exports. If you applied any filters to the dataset, you can choose to download the full dataset or the current filtered view. For more information about exports, see Downloading data.

When using the search bar, you’ll now see the number of metadata hits as well as the number of data hits displayed on the search results page. For more information about searching, see Searching for information.

If you’re an Enigma Public API user, you can now use the search_filter parameter on the GET /datasets/ endpoint to locate datasets that have been updated since the date you specify. See GET /datasets/ for details.

Additionally, you can download filtered exports using the query parameter on the GET /export/{id} endpoint.

November 3

We’ve further enhanced the search bar so you can now search within collections. Start typing any part of the collection name and you’ll see a list of matching collections you can choose from. If you leave this field empty, you’ll search all collections. There’s also a new “Search Within Collection” button that prefills the search field with the name of the current collection. For more information, see Searching for information.

A new feature in the data viewer lets you right-click on a cell to filter data or launch a global search based on the cell value. The filtering option performs column filtering, and the search option searches all of Enigma Public. For details, see Filtering and searching on a cell value.

October 4

We’ve enhanced the search bar so you can search data only, metadata only, or both. Click the folder button and choose the option you want. For more information, see Searching for information.

We’ve also introduced a completely updated data table viewer with improved filtering options. The viewer displays row numbers so you can reference a specific row, and the tabs on the left let you switch easily between the dataset inspector and the fields view. Additionally, you can copy data from one or more cells by selecting the cells and then pressing Ctrl-C (PC) or Command-C (Mac). The filtering options are now easily accessible above the data table. For more information, see Viewing a dataset.