Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

shadowrock-io
/
Nemotron-3-Embed-8B-Community-MLX-4bit

Sentence Similarity
MLX
Safetensors
ministral3
apple-silicon
embeddings
text-embeddings
feature-extraction
retrieval
semantic-search
rag
mteb
nemotron
quantized
4-bit precision
information-retrieval
dense-retrieval
vector-search
matryoshka
arxiv:2502.13595
Eval Results (legacy)
Model card Files Files and versions
xet
Community

Instructions to use shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir Nemotron-3-Embed-8B-Community-MLX-4bit shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
  • Atomic Chat
Nemotron-3-Embed-8B-Community-MLX-4bit / scripts
8.01 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 3 commits
mattbusi's picture
mattbusi
CI sync from nemotron-embed-quant @ 8ce22703
47270e3 verified about 2 months ago
  • convert_8b.py
    4.26 kB
    CI sync from nemotron-embed-quant @ 8ce22703 about 2 months ago
  • eval_8b.py
    3.76 kB
    CI sync from nemotron-embed-quant @ 8ce22703 about 2 months ago