MITQDCtoCTConversion
MITQDCtoCTConversion is to convert the harvested MIT DSpace records on September of 2015 into the developed Common Terminology (CT).
MIT library cooperated in providing metadata records and provided the way we harvested their 358017 DSpace QDC records via OAI-PMH. We harvested again DSpace QDC records in xml form on September of 2015. The element/term usage of their records is analyzed on January of 2016 and CT SKOS crosswalk is developed based on the analyzed usage on March of 2016. And August of 2016, MITQDCtoCTConversion is developed. This version may be modified by feedback and/or comments of metadata experts of MIT library.
MITQDCtoCTConversion Conversion Rates
The measured total Match rates of 358017 records in the folder, C:\Python27\metadata\MIT are the below:
The number of total Statement= 7343157
Converted rate= 100.0
exactMatch rate= 89.4742955925
narrowMatch rate= 10.5257044075
broadMatch rate= 0.0
noConverted rate= 0.0
Not converted Element Names are {}
Findings
- Few records have no url identifiers that makes access available online. Thus, MITQDCtoCTConversion program generates url identifier for these records with header:identifier starting with ‘oai:dspace.mit.edu’.
- The deleted records stated in header are not converted.
An Example Original Record in xml form
<?xml version=”1.0″ encoding=”UTF-8″?>
<OAI-PMH xsi:schemaLocation=”http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns=”http://www.openarchives.org/OAI/2.0/”><responseDate>2015-09-16T20:04:05Z</responseDate><request set=”hdl_1721.1_34009″ verb=”ListRecords” metadataPrefix=”qdc”>http://dspace.mit.edu/oai/request</request><ListRecords>
<metadata><dcterms:dateAccepted xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>2009-04-03T17:02:05Z</dcterms:dateAccepted><dcterms:available xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>2009-04-03T17:02:05Z</dcterms:available><dcterms:issued xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>2000</dcterms:issued><dc:identifier xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dc=”http://purl.org/dc/elements/1.1/”>2000-001</dc:identifier><dc:identifier xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dc=”http://purl.org/dc/elements/1.1/” type=”dcterms:URI”>http://hdl.handle.net/1721.1/44965</dc:identifier><dcterms:abstract xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>The opportunities for retail electricity competition to provide new value-added services to retail electricity consumers are discussed. The physical attributes of electricity supply make many of the traditional “convenience services” provided by retailers in other industries irrelevant in electricity. In addition, these attributes provide a low-cost way for electricity consumers to buy directly in the wholesale market. In this way, retail consumers can receive the commodity price related benefits of competitive generation markets without incurring large increases in advertising, promotion and customer service costs. Electric distribution companies (UDCs) can easily provide a Basic Electricity Service (BES) that makes it possible for all consumers to buy commodity electricity in competitive wholesale electricity markets at the spot market price. The availability of BES is especially important for residential and small commercial customers for whom few new retail value-added services are evident. BES also provides an excellent competitive benchmark against which consumers can compare the value added associated with competitive supply offers from competing Electricity Service Providers (ESPs), helps to protect residential and small commercial customers from exploitation by ESPs, and mitigates wasteful expenditures on marketing and promotion by rent-seeking ESPs that will increase prices.</dcterms:abstract><dcterms:abstract xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>(cont.) The availability of BES helps to channel ESP competitive efforts toward providing value added services such as real time metering and control, energy management contracts, risk hedging and forward contracting, green power and other services. This is the strategy that the most successful ESPs are pursuing. A successful retail competition program can have additional social benefits by helping to improve the performance of wholesale markets. However, efforts to use creamy “shopping credits” to subsidize ESPs are misguided, raising both efficiency and equity concerns. The success of retail competition should be judged by the new value added services it brings to the system, not by the number of customers who switch to ESPs from BES and similar default services. Regulators who focus on retail switching statistics and who are subsidizing customer switching are likely to be making residential consumers worse off than they would be if BES had been made available to them by their UDC.</dcterms:abstract><dcterms:extent xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dcterms=”http://purl.org/dc/terms/”>57 p</dcterms:extent><dc:publisher xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dc=”http://purl.org/dc/elements/1.1/”>MIT Center for Energy and Environmental Policy Research</dc:publisher><dc:title xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dc=”http://purl.org/dc/elements/1.1/”>Why do we need electricity retailers?; or, can you get it cheaper wholesale?</dc:title><dc:type xml:lang=”en_US” xsi:schemaLocation=”http://purl.org/dc/terms/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dcterms.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2006/01/06/dc.xsd” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xmlns:dc=”http://purl.org/dc/elements/1.1/”>Working Paper</dc:type></metadata>
</record>
Converted CT record in rdf/xml form by MITQDCtoCTConversion
<rdf:RDF
xmlns:rdf=”http://www.w3.org/1999/02/22-rdf-syntax-ns#”
xmlns:ct=”http://www.ct.iopdl.org/1.2/”>
<ct:identifier ct:source=”DSpace@MIT”/>
<ct:identifier>oai:dspace.mit.edu:1721.1/44965</ct:identifier>
<ct:identifier ct:collection=”(setSpec)hdl_1721.1_34010″/>
<ct:identifier>2000-001</ct:identifier>
<ct:identifier ct:uri=”http://hdl.handle.net/1721.1/44965″/>
<ct:date>(datestamp)2009-04-04T06:01:41Z</ct:date>
<ct:date ct:dateOther=”(dateAccepted)2009-04-03T17:02:05Z”/>
<ct:date ct:available=”2009-04-03T17:02:05Z”/>
<ct:date ct:issued=”2000″/>
<ct:description ct:abstract=”The opportunities for retail electricity competition to provide new value-added services to retail electricity consumers are discussed. The physical attributes of electricity supply make many of the traditional “convenience services” provided by retailers in other industries irrelevant in electricity. In addition, these attributes provide a low-cost way for electricity consumers to buy directly in the wholesale market. In this way, retail consumers can receive the commodity price related benefits of competitive generation markets without incurring large increases in advertising, promotion and customer service costs. Electric distribution companies (UDCs) can easily provide a Basic Electricity Service (BES) that makes it possible for all consumers to buy commodity electricity in competitive wholesale electricity markets at the spot market price. The availability of BES is especially important for residential and small commercial customers for whom few new retail value-added services are evident. BES also provides an excellent competitive benchmark against which consumers can compare the value added associated with competitive supply offers from competing Electricity Service Providers (ESPs), helps to protect residential and small commercial customers from exploitation by ESPs, and mitigates wasteful expenditures on marketing and promotion by rent-seeking ESPs that will increase prices.”/>
<ct:description ct:abstract=”(cont.) The availability of BES helps to channel ESP competitive efforts toward providing value added services such as real time metering and control, energy management contracts, risk hedging and forward contracting, green power and other services. This is the strategy that the most successful ESPs are pursuing. A successful retail competition program can have additional social benefits by helping to improve the performance of wholesale markets. However, efforts to use creamy “shopping credits” to subsidize ESPs are misguided, raising both efficiency and equity concerns. The success of retail competition should be judged by the new value added services it brings to the system, not by the number of customers who switch to ESPs from BES and similar default services. Regulators who focus on retail switching statistics and who are subsidizing customer switching are likely to be making residential consumers worse off than they would be if BES had been made available to them by their UDC.”/>
<ct:format ct:extent=”57 p”/>
<ct:publisher>MIT Center for Energy and Environmental Policy Research</ct:publisher>
<ct:title>Why do we need electricity retailers?; or, can you get it cheaper wholesale?</ct:title>
<ct:typeGenre>Working Paper</ct:typeGenre>
</rdf:Description>