New generations of globally aggregating search engines – for (chemical) data.

Chemists have long been familiar with search engines that aspire to index a large proportion of the chemical literature. Think for example the old-generation (and commercial) SciFinder (Scholar) and Reaxys or those that arrived in the 1990s in the online era such as the non-commercial Pubchem or ChemSpider (there are more). But you may not be as familiar with the latest generation of global search engines and here I will focus on three relatively new ones that specialise specifically in tracking down data rather than just publications.

I will illustrate first using a regular or non-advanced search. The keyword will be obtusallene, which is selected largely because it is a relatively unique string which is likely to result in fewer false positives. It is a family of marine alkaloids containing, unusually, bromine and /or chlorine[cite]10.1021/acs.joc.6b02008[/cite] and the citation here is to a journal article describing some of its chemistry. But what if you want to find data associated with such molecules?

  1. DataCite (the name gives a clue) specialises in finding data. It was launched ten years ago and has been rapidly expanding its index since. A regular search can be formulated using the string

    As these three advanced queries imply, there are many more ways of constraining the search, which I will describe at a later time.

  2. A more recent introduction is DataSetSearch from Google.
    • https://datasetsearch.research.google.com/search?query=obtusallene (20 hits). Google cites as its sources DataCite itself and the specific repository Figshare (for this search query). 
    • Which leaves a slight mystery. Whilst there is considerable overlap between the DataCite and Google searches, the latter should clearly be potentially a superset of the former, but in fact it is slightly less comprehensive (by at least 5 hits).
  3. My third new engine is OpenAIRE (a European project supporting Open Science). It is also the search engine provided by Zenodo.
    • https://explore.openaire.eu/search/find?keyword=obtusallene (20 hits on research data, 6 hits on publications, 5 hits on “other research products” and zero hits on “software”).
    • Which introduces not just data but other concepts associated with “research objects”, clearly more useful than data alone. One of these may well shortly be Instruments (as eg used to acquire data) and another is e.g. the software used to analyze the data.

I think these new-generation search engines specialising in data have lots of exciting potential. They are still maturing and I hope we will see some interesting new capabilities emerge which we have not had before.


All are on-line nowadays, but engines such as SciFinder had two previous existences, from about 1980 as CAS online using merely a terminal interface, and prior to that as printed copies to be searched manually.

One Response to “New generations of globally aggregating search engines – for (chemical) data.”

  1. Henry Rzepa says:

    A well-hidden secret for some search engines at least is what is rather intimidatingly referred to as advanced search Thus with Google, you have https://www.google.com/advanced_search and also search operators (described at https://support.google.com/websearch/answer/2466433 ) which enhance the regular searches for websites. This has been joined by http://www.google.com/advanced_image_search (for images) where you can control fields such as Size, Aspect ratio, Color, Type (face, animated, etc.), Site or domain, Filetype, SafeSearch, Usage rights (find images that you have permission to use). Some of this latter category also might come in useful for data.

    I have asked Google if such an advanced version of their data search https://datasetsearch.research.google.com might exist, to match the equivalent searches possible at DataCite.

Leave a Reply