Statistics

Standards Add

DDI (Data Documentation Initiative) Edit

A widely used, international standard for describing data from the social, behavioral, and economic sciences. Two versions of the standard are currently maintained in parallel:

  • DDI Codebook (or DDI version 2) is the simpler of the two, and intended for documenting simple survey data for exchange or archiving. Version 2.5 was released in January 2014.
  • DDI Lifecycle (or DDI version 3) is richer and may be used to document datasets at each stage of their lifecycle from conceptualization through to publication and reuse. It is modular and extensible. Version 3.2 was published in March 2014.

Both versions are XML-based and defined using XML Schemas. They were developed and are maintained by the DDI Alliance.

Open Standard for Particle-Mesh Data (openPMD) Edit

OpenPMD provides naming and attribute conventions that allow the exchange of particle and mesh based data from scientific simulations and experiments. The primary goal is to define a minimal set/kernel of meta information that enables the sharing and exchange of data to achieve

  • portability between various applications and differing algorithms;
  • a unified open-access description for scientific data (publishing and archiving);
  • a unified description for post-processing, visualization and analysis.

OpenPMD suits any kind of hierarchical, self-describing data format, such as, but not limited to ADIOS1 (BP3), ADIOS2 (BP4), HDF5, JSON, and XML.

RDF Data Cube Vocabulary Edit

The standard provides a means to publish multi-dimensional data, such as statistics, on the web in such a way that it can be linked to related data sets and concepts using the W3C RDF (Resource Description Framework) standard. The model underpinning the Data Cube vocabulary is compatible with the cube model that underlies SDMX (Statistical Data and Metadata eXchange), an ISO standard for exchanging and sharing statistical data and metadata among organizations.

SDMX (Statistical Data and Metadata Exchange) Edit

A set of common technical and statistical standards and guidelines to be used for the efficient exchange and sharing of statistical data and metadata.

Sponsoring institutions include BIS, ECB, EUROSTAT, IMF, OECD, UN, and the World Bank. Technical Specification 2.1 was amended in May 2012.

Extensions Add

GESMES/TS (Generic Statistical Message for Time Series) Edit

An extension of SDMX used to exchange statistical data and metadata.

GSIM (Generic Statistical Information Model) Edit

A reference framework that provides a common terminology acroos and between statistical organisations; aligns with DDI and SDMX.

Tools Add

DDI Tools Edit

The Data Documentaion Initiative website's list of tools to implement the DDI standard.

DDI on Rails Edit

Server-side software for building a data portal, with a particular focus on survey datasets. It uses DDI to provide access to the data at the level of concepts and variables. For an example of it in use, see the SOEPinfo data portal.

Istat SDMX Framework Project Edit

A suite of tools for managing data and metadata in SDMX.

Linked Data Cubes Explorer Edit

The Linked Data Cubes Explorer allows for the analysis of statistical datasets using the RDF Cube Vocabulary.

SDMX Editor Edit

A simple tool for managing and accessing statistical metadata, using the SDMX framework.

SDMX Mapping Assistant Edit

A tool to facilitate the mapping between the structural metadata provided by an SDMX-ML Data Structure Definition and those that reside in a database of a dissemination environment.

SDMX Tool Repository Edit

A list of software tools supporting the SDMX standard.

Use Cases Add

DDI Projects Edit

The Data Documentation Initiative website's list of projects adopting or encouraging DDI as a standard.

DDI Use Case Literature Edit

Links to DDI 3 use case papers, which were the outcomes of a workshop held at the Schloss Dagstuhl - Leibniz Center for Informatics in Wadern, Germany, November 2-6, 2009.

Eurostat Edit

The statistical office of the European Union, which implementats SDMX in a number of projects.

ICPSR (Inter-university Consortium for Political and Social Research) Edit

A data archive providing leadership and training in data access, curation, and methods of analysis for the social science research community; all metadata conforms to the DDI standard.

The Institution for Social and Policy Studies (ISPS) Data Archive Edit

Provides members of the scholarly community with access to files associated with scholarly studies for the purpose of replication, for all studies conducted by ISPS-affiliated researchers. ISPS metadata records conform to DDI requirements and include a minimal set of Dublin Core metadata elements.

List of RDF Data Cube Vocabulary Implementations Edit

W3C Government Linked Data list of implementations of the RDF Data Cube Vocabulary.

SDMX Implementations Edit

The SDMX website's list of current and planned practical implimentations from national and international organisations.