Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
akjindal53244 's Collections
Preference Datasets
Reasoning Papers
Arithmo: Mathematical Reasoning
Important Datasets
⛈️ Llama-3.1 Storm Models

Preference Datasets

updated Jul 29, 2025

Collection of preference datasets

Upvote
-

  • openbmb/UltraInteract_pair

    Viewer • Updated Apr 5, 2024 • 220k • 2.58k • 110

  • Skywork/Skywork-Reward-Preference-80K-v0.2

    Viewer • Updated Oct 25, 2024 • 77k • 1.3k • 66

  • nvidia/HelpSteer3

    Viewer • Updated Nov 16, 2025 • 133k • 9.57k • 110

  • BAAI/Infinity-Preference

    Viewer • Updated Aug 30, 2024 • 59.4k • 290 • 81

  • allenai/tulu-3-pref-personas-instruction-following

    Viewer • Updated Nov 21, 2024 • 19.9k • 573 • 15

  • HumanLLMs/Human-Like-DPO-Dataset

    Viewer • Updated Jan 15 • 10.9k • 896 • 257
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs