Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

  • binaryqueen@programming.devOP
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    This is the model:

    {
      "data" : [
        {
          "context_window" : 4096,
          "created" : 1719792000,
          "id" : "apple-foundationmodel",
          "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
          "object" : "model",
          "owned_by" : "apple",
          "supported_parameters" : [
            "temperature",
            "max_tokens",
            "seed",
            "stream",
            "tools",
            "tool_choice",
            "response_format",
            "x_context_strategy",
            "x_context_max_turns",
            "x_context_output_reserve"
          ],
          "unsupported_parameters" : [
            "logprobs",
            "n",
            "stop",
            "presence_penalty",
            "frequency_penalty"
          ]
        }
      ],
      "object" : "list"
    }
    

    and I’m running it on a MacBook Air M4 16 GB. “Apfel” (the CLI tool) is kinda a wrapper around it and exposes an OpenAI compatible API.

      • binaryqueen@programming.devOP
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air

        • CallMeAl (like Alan)@piefed.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          That’s a really neat and fun project!

          I have a back DSLite that I got the new OS cart for and I’ve been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking.

          You should certainly keep doing projects like this and sharing them. I’m glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project.