mistralai/Mistral-Medium-3.5-128B
128B • Updated • 9.49k • 227
Stas Mayorov
SCOtest
·
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
mistralai/Mistral-Medium-3.5-128B liked a model 2 days ago
prism-ml/Ternary-Bonsai-8B-gguf liked a model 4 days ago
Qwen/Qwen3.6-27BOrganizations
None yet
liked a
model 1 day ago
liked a
model 2 days ago
liked a
model 4 days ago
liked a
model 8 days ago
liked 2
models 11 days ago
liked a
model 16 days ago
liked 2
models 20 days ago
liked 5
models 2 months ago
Qwen/Qwen3.5-397B-A17B
Image-Text-to-Text • 403B • Updated • 511k • • 1.47k
Qwen/Qwen3.5-122B-A10B
Image-Text-to-Text • 125B • Updated • 991k • • 534
Qwen/Qwen3.5-35B-A3B
Image-Text-to-Text • 36B • Updated • 3.63M • • 1.41k
Qwen/Qwen3.5-27B
Image-Text-to-Text • 28B • Updated • 3.29M • • 966
Nanbeige/Nanbeige4.1-3B
Text Generation • 4B • Updated • 233k • • 1.1k
upvoted an article 2 months ago
Article
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
- +4
•
505
reacted to kostakoff's post with 👍 3 months ago
Post
3350
My home lab for AI models - llmlaba v1
After I began learning MLOps I realized that I needed some kind of home lab, there are a lot of GPUs that I need to learn how to set up and test.
So I spent some time to do a researching which platform I could buy or build.
My requirements ware:
- Limited budget
- Power supply 1 kW or higher
- Few PCIe slots to be able to install more than one gpu
- Zero maintenance cost, I don't want spend a lot of time or money to maintain lab hardware, except for the GPUs
I chose the Intel Mac Pro 7.1:
- Prices on eBay acceptable
- Excelent cooling
- 1.4 kW power supply
- 7 PCIe slots
- Zero maintenance: I don't need to do anything with the Mac Pro hardware; it just works
- Classic UEFI boot loader
It requires a bit of OS preparation:
1. Install Ubuntu 24.04 (it works with the general PC ISO image)
2. Set up T2 drivers
3. Install t2fanrd to manually manage fans (/etc/t2fand.conf) https://wiki.t2linux.org/guides/fan/
4. Fix PCIe BAR: add pci=realloc to GRUB_CMDLINE_LINUX_DEFAULT so the Linux kernel will properly initializes server GPUs without Graphics Output Protocol
5. Install NVIDIA GPU driver:
And it works!
I was able to run server-grade Nvidia Tesla P100 (required DIY air duct), and consumer Nvidia Titan X, Titan V, GTX 1080 cards on the old Mac Pro 7.1 - even three in parallel.
llmlaba
After I began learning MLOps I realized that I needed some kind of home lab, there are a lot of GPUs that I need to learn how to set up and test.
So I spent some time to do a researching which platform I could buy or build.
My requirements ware:
- Limited budget
- Power supply 1 kW or higher
- Few PCIe slots to be able to install more than one gpu
- Zero maintenance cost, I don't want spend a lot of time or money to maintain lab hardware, except for the GPUs
I chose the Intel Mac Pro 7.1:
- Prices on eBay acceptable
- Excelent cooling
- 1.4 kW power supply
- 7 PCIe slots
- Zero maintenance: I don't need to do anything with the Mac Pro hardware; it just works
- Classic UEFI boot loader
It requires a bit of OS preparation:
1. Install Ubuntu 24.04 (it works with the general PC ISO image)
2. Set up T2 drivers
sudo apt install -y dkms linux-headers-$(uname -r) applesmc-t2 apple-bce lm-sensors3. Install t2fanrd to manually manage fans (/etc/t2fand.conf) https://wiki.t2linux.org/guides/fan/
4. Fix PCIe BAR: add pci=realloc to GRUB_CMDLINE_LINUX_DEFAULT so the Linux kernel will properly initializes server GPUs without Graphics Output Protocol
5. Install NVIDIA GPU driver:
sudo apt install nvidia-driver-570And it works!
I was able to run server-grade Nvidia Tesla P100 (required DIY air duct), and consumer Nvidia Titan X, Titan V, GTX 1080 cards on the old Mac Pro 7.1 - even three in parallel.
- 3 replies
upvoted a paper 3 months ago
liked 2
models 3 months ago
liked a
model 4 months ago
