I want to extract and process the metadata from PNG images and the first line of .safetensors files for LLM’s and LoRA’s. I could spend ages farting around with sed or awk but formats of files are constantly changing. I’d like a faster way to see a summary of training and a few other details when they are available.

  • Hammerheart@programming.dev
    link
    fedilink
    arrow-up
    6
    ·
    4 months ago

    What are some goos resources for learning jq? I really struggle when it comes to nested keys/values which obviously limits my ability to use it.

    • timbuck2themoon@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 months ago

      Online json parser. Throw in some data and then structure a query.

      It’ll keep updating the results as you tweak your query. A simple search will probably give you twenty that’ll work. I can’t remember what i normally use off the top of my head.

      • Hammerheart@programming.dev
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        4 months ago

        I have perused it, but its both so dense and so broad that its not that helpful unless i know exactly what I’m looking for. I have also tried info and tldr. I actually like tldr the most,. although the exhaustiveness of the man pages must be admired. I dont find it to be the best teacher.

    • Beej Jorgensen@lemmy.sdf.org
      link
      fedilink
      arrow-up
      3
      ·
      4 months ago

      I hate to do this, but AI chatbots are typically pretty good at giving examples for things like this and you can learn from it.