How to use mobilint/whisper-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="mobilint/whisper-small", trust_remote_code=True)
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("mobilint/whisper-small", trust_remote_code=True, dtype="auto")
How to use mobilint/whisper-small with Mobilint:
# pip install mblt-model-zoo from mblt_model_zoo.vision import MBLT_Engine model = MBLT_Engine( model_cls="whisper-small", model_type="DEFAULT", model_path="", core_mode="global8", ) try: image = model.preprocess("path/to/image.jpg") output = model(image) result = model.postprocess(output) finally: model.dispose()
This repository provides a model compiled and optimized for Mobilint NPU hardware.The model is packaged for deployment on Mobilint’s acceleration stack and is intended to be used within that environment.
Files info
Base model
