Combined and Normalized GHEITI Data

JohnSnowLabs

Files Size Format Created Updated License Source
2 39kB csv zip 2 weeks ago John Snow Labs Standard License John Snow Labs Natural Resource Governance Institute (NRGI)
Download

Data Files

File Description Size Last changed Download Other formats
combined-and-normalized-gheiti-data-csv [csv] 49kB combined-and-normalized-gheiti-data-csv [csv] combined-and-normalized-gheiti-data-csv [json] (100kB)
combined-and-normalized-gheiti-data_zip [zip] Compressed versions of dataset. Includes normalized CSV and JSON data with original data and datapackage.json. 16kB combined-and-normalized-gheiti-data_zip [zip]

combined-and-normalized-gheiti-data-csv  

This is a preview version. There might be more data in the original version.

Field information

Field Name Order Type (Format) Description
Company_Name 1 string Referes to the name of the company included in this study.
Year 2 date (%Y-%m-%d) Refers to the year when the revenue is generated.
Revenue_Commodity 3 string Referes to the specific commodity for which the revenue is generated. It includes Silver, Gold, Diamond, Bauxite, Limestone, Manganese and Oil.
Commodity_Code 4 string Indicates the Codes for Comapny/Year/Commodity combination.
Company_ID 5 string Refers to identity of different companies.
Data_File_Name 6 string Refers to the name of the data file in which the data related to several sectors is present.
Gfs_Code 7 string Indicates the revenue code by the Government Finance Statistics (GFS).
Gfs_Name 8 string Indicates the revenue name by the Government Finance Statistics (GFS)
Measurement_Value 9 number Indicates the value of the measure used to analyze data.

combined-and-normalized-gheiti-data_zip  

This is a preview version. There might be more data in the original version.

Read me

Import into your tool

If you are using R here's how to get the data you want quickly loaded:

install.packages("jsonlite")
library("jsonlite")

json_file <- "http://datahub.io/JohnSnowLabs/combined-and-normalized-gheiti-data/datapackage.json"
json_data <- fromJSON(paste(readLines(json_file), collapse=""))

# access csv file by the index starting from 1
path_to_file = json_data$resources$path[1][1]
data <- read.csv(url(path_to_file))
print(data)

In order to work with Data Packages in Pandas you need to install the Frictionless Data data package library and the pandas extension:

pip install datapackage
pip install jsontableschema-pandas

To get the data run following code:

import datapackage

data_url = "http://datahub.io/JohnSnowLabs/combined-and-normalized-gheiti-data/datapackage.json"

# to load Data Package into storage
storage = datapackage.push_datapackage(data_url, 'pandas')

# data frames available (corresponding to data files in original dataset)
storage.buckets

# you can access datasets inside storage, e.g. the first one:
storage[storage.buckets[0]]

For Python, first install the `datapackage` library (all the datasets on DataHub are Data Packages):

pip install datapackage

To get Data Package into your Python environment, run following code:

from datapackage import Package

package = Package('http://datahub.io/JohnSnowLabs/combined-and-normalized-gheiti-data/datapackage.json')

# get list of resources:
resources = package.descriptor['resources']
resourceList = [resources[x]['name'] for x in range(0, len(resources))]
print(resourceList)

data = package.resources[0].read()
print(data)

If you are using JavaScript, please, follow instructions below:

Install data.js module using npm:

  $ npm install data.js

Once the package is installed, use the following code snippet:

const {Dataset} = require('data.js')

const path = 'http://datahub.io/JohnSnowLabs/combined-and-normalized-gheiti-data/datapackage.json'

// We're using self-invoking function here as we want to use async-await syntax:
(async () => {
  const dataset = await Dataset.load(path)

  // Get the first data file in this dataset
  const file = dataset.resources[0]
  // Get a raw stream
  const stream = await file.stream()
  // entire file as a buffer (be careful with large files!)
  const buffer = await file.buffer
})()

Install the datapackage library created specially for Ruby language using gem:

gem install datapackage

Now get the dataset and read the data:

require 'datapackage'

path = 'http://datahub.io/JohnSnowLabs/combined-and-normalized-gheiti-data/datapackage.json'

package = DataPackage::Package.new(path)
# So package variable contains metadata. You can see it:
puts package

# Read data itself:
resource = package.resources[0]
data = resource.read
puts data
Datapackage.json