hfhub

hfhub is a minimal port of huggingface_hub that allows downloading files from Hugging Face Hub and caching them with the same structure used in the original implementation.

Installation

hfhub can be installed from CRAN with:

install.packages("hfhub")

You can install the development version of hfhub like so:

# remotes::install_github("mlverse/hfhub")
install.packages("hfhub", repos = c('https://mlverse.r-universe.dev', 'https://cloud.r-project.org'))

Example

hub_download can be used to download and cache a file from any Hugging Face Hub repository. It returns a path to the file.

library(hfhub)
path <- hub_download("gpt2", "config.json")
str(jsonlite::fromJSON(path))

Authentication

You can set the HUGGING_FACE_HUB_TOKEN (or HF_TOKEN) environment variable with the value of a token obtained in the Access Token section of the Hugging Face account setting page. This will allow you to download private files from Hugging Face Hub.