I’d like something to describe images for me and also recognise any text contained in them. I’ve tried llama3. 2-vision, llava and minicpm-v but they all get the text recognition laughably wrong.

Or maybe I should lay my image recognition dreams to rest with my measly 8 GB RAM card.

Edit: gemma3:4b is even worse than the others. It doesn’t even find the text and hallucinates others.

  • Boomkop3@reddthat.comEnglish
    3·
    12 hours ago

    Perhaps a multi stage approach is a better idea? Find a model that’s exclusively for optical character recognition, then feed it’s output into an llm

    • Björn TantauOPAEnglish
      2·
      11 hours ago

      Why didn’t I think of this? granite3.2-vision seems to do the trick, even though it doesn’t know the German letter ß. But I can live without that.

      Thanks!

      • Boomkop3@reddthat.comEnglish
        1·
        4 hours ago

        I can’t you why you didn’t. But I can tell you a trick to come up with better ideas: force yourself to come up with 10 ideas, no matter how stupid. Then only filter them once you’re done.

        This causes you to take less mental shortcuts. And you end up with better results (usually) at the cost of more mental effort/energy