I want to extract and process the metadata from PNG images and the first line of .safetensors files for LLM’s and LoRA’s. I could spend ages farting around with sed or awk but formats of files are constantly changing. I’d like a faster way to see a summary of training and a few other details when they are available.

  • ᗺark dor@infosec.pub
    link
    fedilink
    arrow-up
    4
    ·
    edit-2
    7 months ago

    Pipe to jless first to pick out targets then jq

    If it is a small file and I want to do edits then use Yq to send it to Yaml and back again

    Looking at whether duckdb is a better approach especially for querying, bulk transforms, python