Discussions

• 1 You must be logged in to vote

  📊

  vLLM can do this.

  entrepeneur4lyf started Aug 3, 2024 in Results · Closed

  

  

  1
• 1 You must be logged in to vote

  📊

  1x Raspberry Pi 4B 8 GB + 7x Raspberry Pi 4B 4 GB + Mercusys MS108G Switch [Llama 2 7B/13B and Llama 3 8B]

  EntusiastaIApy started Jul 23, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  n2d-highmem-16 + 3 x n2d-highmem-8, Google Cloud [Llama 3.1 405B Q40]

  b4rtaz started Jul 31, 2024 in Results

  

  

  0
• 3 You must be logged in to vote

  📊

  Raspberry Pi 4B 8 GB + TP-Link LS1008G Switch [Llama 2 7B/13B/70B]

  b4rtaz started Jan 21, 2024 in Results

  

  

  2
• 2 You must be logged in to vote

  📊

  Turing RK1 [Llama 2 7B]

  b4rtaz started Mar 11, 2024 in Results

  

  

  

  

  2
• 1 You must be logged in to vote

  📊

  [Root] Ryzen 3600, [Worker1] Ryzen 3600, [Network] 1 Gigabit

  DifferentialityDevelopment started May 8, 2024 in Results

  

  

  

  

  24
• 3 You must be logged in to vote

  📊

  Want access to a larger Raspberry Pi cluster?

  Stevenic started May 21, 2024 in Results

  

  

  1
• 2 You must be logged in to vote

  📊

  4 x Raspberry Pi 5 8GB + TP-Link LS1008G Switch [Llama 3 8B Q40]

  b4rtaz started Apr 28, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  4 x Raspberry Pi 5 8GB + TP-Link LS1008G Switch [Llama 2 7B Q40]

  b4rtaz started Apr 28, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  4 x Raspberry Pi 5 8GB [Mixtral 8x7B]

  b4rtaz started Apr 25, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  4 x n2d-standard-16 (16 vCPU, 64 GB RAM) [Grok-1]

  b4rtaz started Apr 17, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  1x/ 2x/ 4x RPI 5 8gb Llama 7b/13b

  serralva-ruben started Mar 30, 2024 in Results

  

  

  3
• 1 You must be logged in to vote

  📊

  X86 VM + NVIDIA Jetson Nano 4GB + 1Gbps Switch [Llama 2 7B/13B]

  JiangShanCode started Mar 7, 2024 in Results

  

  

  8
• 2 You must be logged in to vote

  📊

  4x VM c3d-highcpu-30 (30 vCPU, 15 core, 59 GB memory) [Llama 2 7B/13B/70B]

  b4rtaz started Jan 28, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  2x VM c3d-highcpu-90 (90 vCPU, 45 core, 177 GB memory) [Llama 2 7B]

  b4rtaz started Jan 25, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  2x VM c3d-standard-16 (16 vCPU, 8 core, 64 GB memory) [Llama 2 7B]

  b4rtaz started Jan 24, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  1x Intel Xeon CPU E5-2696 v3 ($50.00, 18c/36t AVX2) 96 GB + Arista DCS 7050QX-32S (40 Gbp/s) [Llama 2 70B]

  spyd3rweb started Jan 26, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  8x Intel Xeon E3-1246 v3 ($25.00, 4c/8t AVX2) 8/16 GB + Arista DCS 7050QX-32S (40 Gbp/s) [Llama 2 70B]

  spyd3rweb started Jan 25, 2024 in Results

  

  

  2