huggingface / huggingface/candle

candle-datasets ssl

Open
#3,687 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Hello all, I'm trying to use the functionality to download data sets of candle-datasets.

```
[package]
name = "pytorch-tutorial"
version = "0.1.0"
edition = "2024"

[dependencies]
candle-core = { version = "0.10.2", features = ["metal"] }
candle-datasets = "0.10.2"
candle-nn = { version = "0.10.2", features = ["metal"] }
hf-hub = "0.5.0"
openssl-sys = { version = "0.9.117", features = ["vendored"] }
serde = "1.0.228"
serde_json = "1.0.150"
tokenizers = "0.23.1"
```

```
use candle_core::{DType, Device, Result, Tensor};
use candle_datasets::vision::fashion_mnist;
use candle_nn::{Embedding, Module, VarBuilder};
use serde::Deserialize;

fn main() {
println!("Hello, world!");
let candle_datasets::vision::Dataset {
train_images,
train_labels,
test_images,
test_labels,
..
} = fashion_mnist::load().unwrap();

println!("{:?}", train_images.shape());

}
```

I get this back when I run the program:
```
Hello, world!

thread 'main' (13041993) panicked at src/main.rs:14:31:
called `Result::unwrap()` on an `Err` value: Api error: request error: https://huggingface.co/datasets/zalando-datasets/fashion_mnist/resolve/refs%2Fconvert%2Fparquet/fashion_mnist/test/0000.parquet: Connection Failed: tls connection init failed: invalid peer certificate: UnknownIssuer
```

Adding my enterprise ssl certs to the macOS Keychain and to the homebrew openssl installation seem to have no effect. Is there anyway to disable ssl for downlpoad?

Thank you

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the failure from src/main.rs by running the fashion_mnist::load() entry point with the dependency versions shown. Trace the TLS setup used for the Hugging Face dataset request and determine how enterprise certificates are expected to be handled. Done means the download works with the reported certificate environment, or the supported limitation and configuration are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data, networking, security
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.