Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
SoraWatermarkRemover
Log In
Sign Up
nicholasKluge
/
Harmless-RewardModel
like
1
Text Classification
Transformers
Safetensors
nicholasKluge/harmless-aira-dataset
Anthropic/hh-rlhf
English
roberta
reward model
alignment
preference model
RLHF
Carbon Emissions
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
5d2556a
Harmless-RewardModel
1.51 GB
1 contributor
History:
6 commits
nicholasKluge
Upload hh_rlhf_eval.parquet
5d2556a
verified
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
LICENSE
Safe
10.8 kB
Upload LICENSE
over 1 year ago
README.md
8.27 kB
Create README.md
over 1 year ago
config.json
780 Bytes
Upload folder using huggingface_hub
over 1 year ago
emissions.csv
Safe
770 Bytes
Upload emissions.csv with huggingface_hub
over 1 year ago
hh_rlhf_eval.parquet
9.41 MB
xet
Upload hh_rlhf_eval.parquet
over 1 year ago
merges.txt
Safe
456 kB
Upload folder using huggingface_hub
over 1 year ago
model.safetensors
499 MB
xet
Upload folder using huggingface_hub
over 1 year ago
optimizer.pt
pickle
Detected Pickle imports (3)
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
What is a pickle import?
997 MB
xet
Upload folder using huggingface_hub
over 1 year ago
rng_state.pth
pickle
Detected Pickle imports (7)
"_codecs.encode"
,
"collections.OrderedDict"
,
"numpy.core.multiarray._reconstruct"
,
"numpy.dtype"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.ByteStorage"
,
"numpy.ndarray"
How to fix it?
14.2 kB
xet
Upload folder using huggingface_hub
over 1 year ago
scheduler.pt
pickle
Pickle imports
No problematic imports detected
What is a pickle import?
1.06 kB
xet
Upload folder using huggingface_hub
over 1 year ago
special_tokens_map.json
Safe
280 Bytes
Upload folder using huggingface_hub
over 1 year ago
tokenizer.json
Safe
2.11 MB
Upload folder using huggingface_hub
over 1 year ago
tokenizer_config.json
Safe
1.22 kB
Upload folder using huggingface_hub
over 1 year ago
trainer_state.json
Safe
4.93 kB
Upload folder using huggingface_hub
over 1 year ago
training_args.bin
pickle
Detected Pickle imports (9)
"transformers.trainer_utils.SchedulerType"
,
"transformers.training_args.OptimizerNames"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.HubStrategy"
,
"torch.device"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.training_args.TrainingArguments"
,
"accelerate.state.PartialState"
How to fix it?
5.11 kB
xet
Upload folder using huggingface_hub
over 1 year ago
vocab.json
Safe
798 kB
Upload folder using huggingface_hub
over 1 year ago
