1. Forum
  2. Newsgroups
  3. comp.sys.raspberry-pi

  • Project to train image generator (LORA?) on networked Pi

    From Carl Fink@carlf@panix.com to comp.sys.raspberry-pi on Tue Dec 24 15:35:14 2024
    From Newsgroup: comp.sys.raspberry-pi

    I'm interested in playing with this, but I'm not interested in paying $3000
    for a high-end nVidia NPU. It seems to be in principle possible to split the task into smaller subtasks that could be distributed to a Beowulf-style Pi cluster. Several enclosures exist that let you connect multiple Compute
    Modules over a high-speed bus, I hear.

    I have minimal experience with Raspberry Pi (not zero, but minimal). I have none with setting up Beowulf clusters, and none with decomposing machine learning tasks and distributing them among processors. Thus, I wonder if
    there might be an existing project I could learn from and maybe even
    eventually contribute to, even if only as a tester.

    Thanks.
    --
    Carl Fink carl@finknetwork.com
    https://reasonablyliterate.com https://nitpicking.com
    If you want to make a point, somebody will take the point and stab you with it.
    -Kenne Estes
    --- Synchronet 3.20a-Linux NewsLink 1.114
  • From Dennis@dennis@none.none to comp.sys.raspberry-pi on Tue Dec 24 12:51:13 2024
    From Newsgroup: comp.sys.raspberry-pi

    On 12/24/24 09:35, Carl Fink wrote:
    I'm interested in playing with this, but I'm not interested in paying $3000 for a high-end nVidia NPU. It seems to be in principle possible to split the task into smaller subtasks that could be distributed to a Beowulf-style Pi cluster. Several enclosures exist that let you connect multiple Compute Modules over a high-speed bus, I hear.

    I have minimal experience with Raspberry Pi (not zero, but minimal). I have none with setting up Beowulf clusters, and none with decomposing machine learning tasks and distributing them among processors. Thus, I wonder if there might be an existing project I could learn from and maybe even eventually contribute to, even if only as a tester.

    Thanks.
    There were some projects that used multiple PIs. From a cost and
    complexity standpoint they were more "because we can" rather than
    practical. A multicore AMD or INTEL processor would be a better option.
    If you skip the high power GPU the system cost is lower. Also the MPI
    cluster code is "off the shelf" for those processors.

    https://mpitutorial.com/tutorials/mpi-hello-world/
    --- Synchronet 3.20a-Linux NewsLink 1.114
  • From Carl Fink@carlf@panix.com to comp.sys.raspberry-pi on Fri Dec 27 14:40:09 2024
    From Newsgroup: comp.sys.raspberry-pi

    On 2024-12-24, Dennis <dennis@none.none> wrote:

    There were some projects that used multiple PIs. From a cost and
    complexity standpoint they were more "because we can" rather than
    practical. A multicore AMD or INTEL processor would be a better option.
    If you skip the high power GPU the system cost is lower. Also the MPI cluster code is "off the shelf" for those processors.

    https://mpitutorial.com/tutorials/mpi-hello-world/

    Thank you.
    --
    Carl Fink carl@finknetwork.com
    https://reasonablyliterate.com https://nitpicking.com
    If you want to make a point, somebody will take the point and stab you with it.
    -Kenne Estes
    --- Synchronet 3.20a-Linux NewsLink 1.114