Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

-AI > Open Source LLM details > Flashcards

Open Source LLM details Flashcards

1
Q

What is safetensors?

A

a file format that safely stores tensors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Speed of safetensors vs .ckpt?

A

some people say safetensors is faster

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what is (/was) pre july 2023 the standard way to save PyTorch models when using the Hugging Face Transformers library?

A

pytorch_model.bin

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

how much faster is safetensors.torch.load_file than torch.load_file

A

76x on CPU and 2x on GPU

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

how does pytorch transform its models to/from disk?

A

well it writes the raw bytes of the tensors to disk and then uses pickle to serialize/deserialize other metadata/Python Object data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

difference between GGUF and safetensors

A

safetensors can only be run on GPU

How well did you know this?
1
Not at all
2
3
4
5
Perfectly

-AI (32 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions