Struct Huggingface 

pub struct Huggingface { /* private fields */ }

Huggingface’s API support. This service will visit the Huggingface API to access the Huggingface File System. Currently, we only support the model and dataset types of repositories, and operations are limited to reading and listing/stating.

Huggingface doesn’t host official HTTP API docs. Detailed HTTP request API information can be found on the huggingface_hub Source Code.

Capabilities

This service can be used to:

• stat
• read
• write
• create_dir
• delete
• copy
• rename
• list
• presign
• blocking

Configurations

• repo_type: The type of the repository.
• repo_id: The id of the repository.
• revision: The revision of the repository.
• root: Set the work directory for backend.
• token: The token for accessing the repository.

Refer to HuggingfaceBuilder’s public API docs for more information.

Examples

Via Builder

use std::sync::Arc;

use anyhow::Result;
use opendal::services::Huggingface;
use opendal::Operator;

#[tokio::main]
async fn main() -> Result<()> {
    // Create Huggingface backend builder
    let mut builder = Huggingface::default()
        // set the type of Huggingface repository
        .repo_type("dataset")
        // set the id of Huggingface repository
        .repo_id("databricks/databricks-dolly-15k")
        // set the revision of Huggingface repository
        .revision("main")
        // set the root for Huggingface, all operations will happen under this root
        .root("/path/to/dir")
        // set the token for accessing the repository
        .token("access_token");

    let op: Operator = Operator::new(builder)?.finish();

    Ok(())
}

Implementations

impl HuggingfaceBuilder

pub fn repo_type(self, repo_type: &str) -> Self

Available on crate feature services-huggingface only.

Set repo type of this backend. Default is model.

Available values:

• model
• dataset

Currently, only models and datasets are supported. Reference

pub fn repo_id(self, repo_id: &str) -> Self

Available on crate feature services-huggingface only.

Set repo id of this backend. This is required.

Repo id consists of the account name and the repository name.

For example, model’s repo id looks like:

• meta-llama/Llama-2-7b

Dataset’s repo id looks like:

• databricks/databricks-dolly-15k

pub fn revision(self, revision: &str) -> Self

Available on crate feature services-huggingface only.

Set revision of this backend. Default is main.

Revision can be a branch name or a commit hash.

For example, revision can be:

• main
• 1d0c4eb

pub fn root(self, root: &str) -> Self

Available on crate feature services-huggingface only.

Set root of this backend.

All operations will happen under this root.

pub fn token(self, token: &str) -> Self

Available on crate feature services-huggingface only.

Set the token of this backend.

This is optional.

Trait Implementations

impl Builder for HuggingfaceBuilder

Available on crate feature services-huggingface only.

fn build(self) -> Result<impl Access>

Build a HuggingfaceBackend.

type Config = HuggingfaceConfig

Associated configuration for this builder.

impl Clone for HuggingfaceBuilder

Available on crate feature services-huggingface only.

fn clone(&self) -> HuggingfaceBuilder

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HuggingfaceBuilder

Available on crate feature services-huggingface only.

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for HuggingfaceBuilder

Available on crate feature services-huggingface only.

fn default() -> HuggingfaceBuilder

Returns the “default value” for a type.