Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt

Learn about the different access points and formats to the data HTRC provides, as well as the various affordances and limitations of each method. Your research project will largely dictate which method is best suited for your needs.  

...

HTRC provides access to data from the HathiTrust corpus in several forms across its suite of tools and services for computational text analysis. Data is periodically synced from HathiTrust, but not all HTRC tools and services are updated on the same schedule. Additionally, copyright, user agreements, and security concerns impact data availability and format. 

  • HTRC algorithms and HTRC Data Capsules are capable of analyzing the entire HathiTrust corpus, and additionally make use of each volume’s MARC bibliographic and METS metadata. Both the HTRC algorithms and Capsule-environments draw from the HTRC Data API described below.

  • The HTRC makes available also two datasets, the HTRC Extracted Features Dataset and a dataset of Word Frequencies in English Language Literature, 1700-1922. HTRC Extracted Features includes metadata and extracted page-level data (words and word counts) for 15.7 million volumes.

  • HathiTrust+Bookworm visualizes data for 15.7 million volumes.

...

...

HTRC

...

Data API

This table outlines the differences between the HTRC Data API and HathiTrust Data API. As a researcher-accessible service, describes the HTRC Data API functions within the HTRC Data Capsules environment.



 

HTRC Data API

HathiTrust Data API

purposeto provide access to HathiTrust text data within an HTRC Data Capsule AND to serve high-performance large-scale algorithms and programs (not publicly-accessible)
to provide public users some volume retrieval capabilities
data availableentire HathiTrust corpus
public domain volumes not digitized by Google
useIn-capsule via the HTRC Workset Toolkit
Get more information from HathiTrust
throttling enforcementno
yes
securityJWT
OAuth
bulk retrieval of volumesyes
up to 10,000 volumes
metadata available
METS
METS
, MARC