The Datasheet Editor

The DARIAH-DE Datasheet Editor is accessible at https://geobrowser.de.dariah.eu/edit or by clicking “Datasheet Editor” on Geo-Browser. The Geo-Browser is documented in the tutorial DARIAH-DE Geo-Browser.

Further information on the Geo-Browser and Datasheet Editor you can find at DARIAH-DE Portal.

What’s new in version 3.6?

Note

With the current version 3.6 of the DARIAH-DE Geo-Browser and Datasheet Editor some changes took place mainly affecting authentication, authorization, and accessibility:

AAI (Authentication & Authorization): With version 3.6 of Geo-Browser and Datasheet Editor the DARIAH-DE OwnStorage is used to store your datasets! That makes the usage of the Geo-Browser and Datasheet Editor more secure, and you can work on your datasets privately until your dataset is complete and working, and then you can share it with the world. To store your datasets to the DARIAH-DE OwnStorage, you will have to log in (authenticate) via the DARIAH AAI using your DARIAH account or an eduGAIN federation account. Internally the Geo-Browser and Datasheet Editor are using the DARIAH-DE PDP and OAuth2 tokens for authorization.

Accessibility: The datasets stored in the OwnStorage are only accessible to the owners at first. Only they can read, write, delete, and share each of the datasets.

Sharing and unsharing: If you want to share your datasets, you can do so using the Datasheet Editor’s “Manage your data“ box. The dataset shown in the table view will then become available for everyone to read. You can unshare the dataset any time you like. Sharing to and editing with a specific group of people is not yet possible.

Identifiers and references: The look of the dataset’s IDs have slightly been changed: instead of 721203 the IDs now look like EAEA0-7A23-E68F-EBC2-0. The storages URL host and path of “old“ datasets stays https://geobrowser.de.dariah.eu/storage/. The new host and path of datasets will now be https://cdstar.de.dariah.eu/dariah/.

URLs: With the ID of your dataset and depending on the dataset’s shared status you now can

  1. directly access your shared datasets in the DARIAH-DE OwnStorage: https://cdstar.de.dariah.eu/dariah/EAEA0-4DE9-607F-349C-0. This URL is used for storing and sharing a dataset. A shared dataset can be downloaded using this URL.
  2. access and edit your datasets in the Datasheet Editor: https://geobrowser.de.dariah.eu/edit?id=EAEA0-4DE9-607F-349C-0. This is the link to the Datasheet Editor and your dataset to be edited.
  3. view your dataset in the Geo-Browser if you are the owner of a private dataset or dataset has been shared: https://geobrowser.de.dariah.eu?csv1=https://cdstar.de.dariah.eu/dariah/EAEA0-4DE9-607F-349C-0.

Old dataset references: All your „old“ dataset references will still be readable via their old URLs, such as https://geobrowser.de.dariah.eu/storage/721203. If you want to edit an old dataset, you could just migrate it to the OwnStorage and then edit it and share it if you want it to be publicly available:

  1. Just call an old URL for editing with the Datasheet Editor including an old dataset storage ID, such as https://geobrowser.de.dariah.eu/edit?id=721203.
  2. The old dataset is loaded and displayed read-only in the table view. You now can (i) download the old dataset as a CSV file using the download button, or (ii) create a new dataset automatically in the DARIAH-DE OwnStorage by clicking “Create new datasheet“. The newly created dataset will contain your old data and you then can edit and share it. The old dataset will not be touched.

GUI documentation

How does it work?

In the Manage your data section you can either create a new datasheet or import a local CSV file from your local drives. You can edit your new datasheet and copy’n’paste data from Excel, Calc, or Numbers. Your dataset will be stored to the DARIAH-DE OwnStorage and can be referenced by ID and URL. It will at first only be available to you for editing. Sharing and unsharing your data with everyone is possible whenever you like, please use the share and unshare dataset buttons. You can also download and delete your dataset.

From the place name in the “Address“ fields of your datasheet you can automatically Add geocoordinates using the Getty Thesaurus of Geographical Names, just click on geolocation completion. You can fine-tune your places and coordinates by using the Place selection, Map selection, and Map search sections.

If completed, you can View your dataset by opening it with the Geo-Browser.

Create or import your data

The first option after calling the website is to either create a new datasheet or to import an existing datasheet. By clicking “Create a new datasheet”, a new document is generated. By clicking “Durchsuchen...” (German) or “Browse...“ (English), a CSV file from the local storage can be loaded into the datasheet.

_images/1-datasheet-login.png

Fig. 1: Login to the Datasheet Editor

After clicking on “Create a new datasheet“ or “Durchsuchen...“ / “Browse...“, you will be redirected to the DARIAH-DE log-in, the DARIAH AAI (Authentication & Authorization Infrastructure).

_images/2-datasheet-dariah-login.png

Fig. 2: Login to the Datasheet Editor with your DARIAH account

Here, you have to log in with your DARIAH account or an eduGAIN federation account. Internally the Geo-Browser and Datasheet Editor are using the DARIAH-DE PDP and OAuth2 tokens for authorization.

_images/3-pdp-grant.png

Fig. 3: Confirm storage access permissions

You are then asked to grant the application access to your DARIAH-DE Storage. This will only be asked if you use the OwnStorage from Geo-Browser or Datasheet Editor the first time.

_images/4-datasheet-editor-start.png

Fig. 4: Datasheet Editor’s start page

The creation of your datasheet can now begin back on the Datasheet Editor’s start page.

_images/5-datasheet-created.png

Fig. 5: New datasheet created

After logging in, a green window with the title “New datasheet created!” opens at the top of the Datasheet Editor. The new datasheet has now an own ID in the DARIAH-DE OwnStorage, with which the sheet can be retrieved again. By using the DARIAH-DE OwnStorage to store your datasets, you can work on a dataset privately until it is complete and working, and then you can share it with the world.

_images/6-insert-column.png

Fig. 6: Insert new column

By right-clicking on a cell in the datasheet, a row above (“Insert row above”) or below (“Insert row below”) can be inserted. Rows can be removed via “Remove row” and columns via “Remove column”. Columns can be inserted as well either to the left (“Insert column on the left”) or right (“Insert column on the right”). Thus it is possible to create new categories in the datasheet if additional information on the locations is to be saved. Categories can also be altered in the Datasheet Editor.

Find the coordinates for the places in your datasheet

To enter a location directly into the Datasheet Editor, the longitude and latitude must be known to display the place in the Geo-Browser. If these data are not already known, the tools on the website “Add geocoordinates“, “Place selection“ and “Map selection“ can be used to find them. By clicking “Geolocation completion“ in the “Add geocoordinates“ box, the fields “Longitude“, “Latitude“ and “GettyID“ are added automatically for all locations listed in the “Address“ field of the datasheet. These locations will also be listed in the “Place selection“ box.

_images/7-geolocation-completion.png

Fig. 7: Using geolocation completion

The Getty Thesaurus of Geographic Names (TGN) is used for searching locations. With TGN larger locations are found, smaller locations are not always found. If the location is not the desired one, in the “Place selection“ box you can click on the arrow next to the location name to open a drop-down menu with a list of other locations with the same name (if existing). After choosing the correct location from this list, you can click “Set“ right to the drop-down menu to fill in the corresponding fields “Longitude“, “Latitude“ and “GettyID“ in the datasheet.

To find places and coordinates for “Place selection“ the method “exact-match“ of the DARIAH-DE Normdata Services is being used, that accesses the Thesaurus of Geographical Names (Getty). If more than one entry is being found, the coordinates of the first match are put into the table. To choose another set of coordinates, you can do so by choosing another place and then click on the “Set“ button on the right. Please note, that only the coordinates of the chosen place for „Address“ are changes, and not the content of the „Address“ field itself!

If the desired location is not listed in the drop-down menu, you can click on the “Map“ field next to it. By this, the location will be entered in the “Map selection“ box, both above and below the world map. Below the world map you can find the search options TGN, OpenStreetMap (OSM) and GeoNames. OSM often also finds smaller locations, which TGN does not find. With OSM it is also possible to find streets and street numbers. By clicking the “Set“ field above the world map, the fields “Longitude“ and “Latitude“ will be updated in the datasheet for the correponding location. Caution: the location entered in the text field above the world map has to be spelled in the same way as the location in the “Address“ field of the datasheet!

_images/8-manual-search.png

Fig. 8: Manual place and map selection

Another option is to drag the flag in the “Map selection“ box with the mouse, hereby the longitude and latitude can be determined with more precision. By zooming into the map, it’s possible to see streets more precisely. You can also search “manually“ for the places in the datasheet within the “Map selection“ box. But by searching locations via OSM or GeoNames in the “Map selection“ box, GettyIDs will not be given.

_images/9-current-table-view.png

Fig. 9: Completed table view

DARIAH-DE OwnStorage

The datasets stored in the OwnStorage are accessible to you only at first. You can read, write, delete, and share each of your datasets.

_images/10-share-dataset.png

Fig. 10: Share your dataset with the world

If you want to share your datasets, you can do so by clicking on “Share dataset“ in the “Manage your data“ box. The dataset shown in the table view will then become available for everyone to read, editing the dataset will still only be possible by you. You can unshare the dataset any time you like. You can also delete your dataset by clicking “Delete dataset“ in the “Manage your data“ box. Sharing to and editing with a specific group of people is not yet possible.

_images/11-shared-dataset.png

Fig. 11: Dataset has been shared

_images/12-create-new-dataset-in-table-view.png

Fig. 12: Create new dataset from table view

If you click on “Create new dataset“ in table view, you can do so, your currently displayed is not being deleted and can be viewed again by its ID or URL.

Access your data

When a new datasheet is created, an ID from the DARIAH-DE OwnStorage Service is assigned to the file. The datasheet can be retrieved again with the ID.

_images/14-search-for-local-csv-files.png

Fig. 13: Import local CSV files

By clicking “Download datasheet“ in the “Manage your data“ box, the file can be downloaded as a CSV file and stored in the local storage. Furthermore, the storage ID is shown, and the complete URL can be copied to the clipboard. Using this URL the file can be addressed directly.

_images/15-delete-dataset.png

Fig. 14: Deleting a dataset

You can also delete your dataset by clicking “Delete dataset“ in the “Manage your data“ box.

_images/16-open-with-geo-browser.png

Fig. 15: Open your dataset with the Geo-Browser

With this action the data from the datasheet can be opened in Geo-Browser. The entered locations are shown as points on the world map. The data is also shown below the world map in a list. If you shared your data, everyone is able to see it in the Geo-Browser. Otherwise, only you can see it.

_images/17-how-to-fill-the-table.png

Fig. 16: Help is on the way – How to fill the table

As soon as you make an entry in your datasheet, it will be saved (autosave always on). In the datasheet the following data can be entered:

Name enables you to name your data point. Places have to be entered in the “Address“ field, so “Name“ can be used to display the name of an event or a name that would not be recognized as Address.

Address identifies the place and is used to add the values for the “Longitude“ and “Latitude“ fields via “Geolocation completion“.

Description is used to display any additional data.

Longitude can be filled in by “Geolocation completion“ or manually entered and uses decimal geographic coordinates. Existing coordinates will not be overwritten by “Geolocation completion“.

Latitude can be filled in by “Geolocation completion“ or manually entered and uses decimal geographic coordinates. Existing coordinates will not be overwritten by “Geolocation completion“.

TimeStamp is used to store the date of an entry. Some examples of entries for this field would be 1970, 1970-12, 1970-12-10, and 1970-12-10T20:15:00. For more information on accepted date and time formats please have a look at xsd:date, xsd:dateTime, xsd:gYear, and xsdGYearMonth types.

TimeSpan:begin and TimeSpan:end can be used to convey a timespan. Some examples of entries for this field would also be 1970, 1970-12, 1970-12-10, and 1970-12-10T20:15:00. For more information on accepted date and time formats please have a look at xsd:date, xsd:dateTime, xsd:gYear, and xsdGYearMonth types.

GettyID is used for the exact identification of TGN locations and is automatically filled in using the Getty Thesaurus of Geographic Names via “Geolocation completion“. An existing GettyID will not be overwritten by “Geolocation completion“.

The description of these variables can also be found in the Datasheet Editor by clicking on the “How to fill the table“ button right to the datasheet. It is not required to enter all data to create a datasheet.

New vs. old datasets in the Datasheet Editor

The look of the dataset’s IDs has slightly changed: instead of 721203 the IDs now look like EAEA0-7A23-E68F-EBC2-0. The storages URL host and path of “old“ datasets stays as it always has been: https://geobrowser.de.dariah.eu/storage/, new hostname and path of datasets now will be https://cdstar.de.dariah.eu/dariah/.

All your old dataset references (CSV and KML files) will still be readable via their old URLs, such as https://geobrowser.de.dariah.eu/storage/721203. If you do not want to edit an old dataset, just leave it as it is. Otherwise, you could just store it to the OwnStorage. Then edit it and share it if you want it to be publicly available.

Migrating an old dataset to the OwnStorage

How it works:

  1. Just request an old URL for editing with the Datasheet Editor including an old dataset storage ID, such as https://geobrowser.de.dariah.eu/edit?id=721203.
  2. The old dataset is loaded and displayed read-only in the table view. You now can (i) download the old dataset as a CSV file using the download button, or (ii) create a new dataset automatically in the DARIAH-DE OwnStorage by clicking “Create new datasheet“ in the “Manage your data“ box. The newly created dataset will contain your old data and you then can edit and share it. The old dataset will not be touched.
  3. An example of a migrated and already shared dataset you can see here: https://geobrowser.de.dariah.eu/edit?id=EAEA0-D088-5071-4C39-0.

Open with Geo-Browser

With this action the data from the datasheet can be opened in Geo-Browser. The entered locations are shown as points on the world map. The data is also shown below the world map in a list. If you shared your data, everyone is able to see it in the Geo-Browser. Otherwise, only you can see it.

The Geo-Browser documentation you can find here: DARIAH-DE Geo-Browser.

Versions and Releases

The current version of the DARIAH-DE Datasheet Editor is always accessible at https://geobrowser.de.dariah.eu/edit. The current version is Release version 3.6. We try to keep new versions compatible with older ones. The version of the Datasheet Editor that is currently being developed is accessible via https://geobrowser.de.dariah.eu/beta/edit.