GGUF Available in NexaSDK (only). Here's how to run it locally.

#81
by alanzhuly - opened

GGUF Available in NexaSDK (only). Here's how to run it locally:

Model Card: https://huggingface.co/NexaAI/DeepSeek-OCR-GGUF

Quickstart

  1. Install NexaSDK

  2. Run the model locally with one line of code:

    nexa infer NexaAI/DeepSeek-OCR-GGUF
    
  3. Then drag your image to terminal or type into the image path

case 1 : extract text

<your-image-path> Free OCR.

case 2 : extract bounding box

<your-image-path> <|grounding|>Convert the document to markdown. 

Note: If the model fails to run, install the latest Vulkan driver for Windows

Hi, this is interesting. Would like to learn more, How can I containerize this?

My end goal - to deploy to Azure Container App

( I already checked this - https://docs.nexa.ai/nexa-sdk-docker/quickstart )

Sign up or log in to comment