VirtualizationHowto
VirtualizationHowto
  • Видео 158
  • Просмотров 4 314 736
Local LLM with Ollama, LLAMA3 and LM Studio // Private AI Server
Forget using public generative AI resources like ChatGPT. Use local large language models (LLMs) instead which allows you to create a private AI server. In the video, we step through setting up a private AI server in Windows Subsystem for Linux and a few hacks that need to happen so that your API can be accessible to the open source frontend called Open WebUI.
Written post on the steps: www.virtualizationhowto.com/2024/06/local-llm-model-in-private-ai-server-in-wsl/
Ollama download: ollama.com/download
LM Studio: lmstudio.ai/
★ Subscribe to the channel: ruclips.net/channel/UCrxcWtpd1IGHG9RbD_9380A
★ My blog: www.virtualizationhowto.com
★ Twitter: vspinmaster
★ LinkedIn: www.linkedin....
Просмотров: 4 720

Видео

Nutanix vs VMware in 2024
Просмотров 5 тыс.2 дня назад
It is the battle of the titans in the virtualization world - Nutanix vs VMware. Up until recently, most were fine with running VMware vSphere in their home lab and production environments. However, with the Broadcom buyout, many organizations are seeing a 10-15x increase in their VMware pricing. Nutanix has emerged as a very desirable platform with the enterprise polish many companies are looki...
Minisforum NAB6 Lite Mini PC Review // Home Lab Server
Просмотров 5 тыс.14 дней назад
A detailed look at the Minisforum NAB6 Lite mini PC specifically as a home lab server, running virtual machines and containers. The NAB6 Lite has a nice set of features and hardware, including dual Intel 2.5G network adapters, making it compatible with both VMware and Proxmox. We also discuss the possibilities of using this with something like VMware Workstation Pro, now that VMware by Broadcom...
BEST Server Monitoring with TICK stack setup for FREE!
Просмотров 22 тыс.21 день назад
The TICK stack is an app stack that contains containers that can collect, monitor, and visualize monitoring data in a time series database. We are going to look at server monitoring with a TICK stack and Grafana and see how you can install, configure, and start monitoring your environment. Write up of TICK Stack with Docker compose example here: www.virtualizationhowto.com/2024/05/tick-stack-wi...
Proxmox vs ESXi in 2024
Просмотров 15 тыс.Месяц назад
With all of the changes on the virtualization front, many are evaluating their options in 2024. Two of the major players are Proxmox and VMware ESXi. However, with the Broadcom shakeup and price increases, many are looking seriously at Proxmox. We compare Proxmox vs ESXi across many different fronts, including installation, interface, network, storage, clustering, migration, backup solutions, a...
Top 5 Mini PCs for Home Server in early 2024
Просмотров 22 тыс.Месяц назад
Mini PCs are a great platform for running a home lab environment. We take a look at the top 5 mini PCs that I have tested for home lab in early to mid 2024 and see which options I would pick. I have a write up on top mini PCs here: www.virtualizationhowto.com/2024/02/top-5-mini-pcs-for-home-server-in-early-2024/ Check out the VHT forums to get your questions answered: www.virtualizationhowto.co...
VMware Workstation Pro and Fusion Now Free for Personal Use!
Просмотров 86 тыс.Месяц назад
There is major news coming from VMware by Broadcom today. They have decided to release VMware Workstation Pro and Fusion Pro for free. This is evidently to allow more to use the Workstation hypervisor apps for personal use. We explore this announcement and how you can download and install the new free for personal use VMware Workstation Pro. My written write up of the announcement: www.virtuali...
MiniPC vs Servers in the Home Lab in 2024
Просмотров 22 тыс.Месяц назад
Mini PCs have exploded in popularity over the past few years used as home lab servers. Explore the differences between mini PCs and enterprise servers. We look at processing power, hybrid CPUs, power consumption, server racks, noise, and generally what to expect with both. Check out the written blog post covering the topic here: www.virtualizationhowto.com/2023/08/mini-pc-vs-server-best-home-la...
Trigkey S7 Pro Review runs VMware and Proxmox perfectly // Home Lab Server
Просмотров 14 тыс.2 месяца назад
If you are looking for a great mini PC for a home lab server that is capable of running both VMware ESXi and Proxmox, the Trigkey S7 Pro is a great little mini PC. It sports the Ryzen 7 7840HS processor, DDR5 memory, (2) M.2 slots, and an Intel 2.5G network adapter. Check out my review of the unit, including specs, unboxing, installation, pros, cons, and comparisons with other mini PCs like the...
Best Docker Containers in 2024
Просмотров 89 тыс.2 месяца назад
Docker containers provide an easy way to run your self-hosted applications in a home lab environment. With Docker and Docker Compose, you can easily spin up multiple applications and stacks of apps to service your self-hosted needed. We look at the top Docker containers in 2024! You can find code examples for all Docker Containers covered here: www.virtualizationhowto.com/2024/03/best-docker-co...
VMware Host Client Beta // Bringing back the desktop app
Просмотров 9 тыс.2 месяца назад
In a recent VMware community blog post a new VMware Host Client Beta was announced. However one of the standout pieces of information in the blog was the new beta client is a "desktop application"! Are we going back to the days of the old vSphere Client written in C#? We take a quick look at this news and what it may mean. Official VMware community blog: blogs.vmware.com/code/2024/04/05/the-bet...
Proxmox 10 tweaks you need to know
Просмотров 36 тыс.2 месяца назад
Many are experimenting with Proxmox in their home lab and even in production environments. We take a look at the top 10 Proxmox tweaks in 2024 that you may want to implement. Latest video covering the new VMware ESXi Import utility: ruclips.net/video/H1t6hxCoiZw/видео.html Video showing Ceph configuration - ruclips.net/video/-qk_P9SKYK4/видео.html Blog post covering Proxmox SDN - www.virtualiza...
New Proxmox Import Wizard for Migrating VMware ESXi VMs
Просмотров 38 тыс.2 месяца назад
Proxmox has recently released a new Proxmox VMware ESXi virtual machine migration wizard. In this video, we will look at the installation of the import VMware ESXi wizard and see how this new tool works and actually migrate a virtual machine from a test VMware ESXi environment. This is a game changer for those who want to pivot their lab environment from running on VMware to running on top of P...
Nutanix Community Edition Home Lab - Is it good?
Просмотров 25 тыс.2 месяца назад
Nutanix Community Edition is a free solution that you can download and run in your home lab on your own hardware. Is it a good fit for home lab environments? Are there any limitations to note with the solution? View my written writeup covering Nutanix Community Edition for Home Lab: www.virtualizationhowto.com/2024/01/nutanix-community-edition-for-home-lab/ Check out the VHT forums to get your ...
Best Free Hypervisors in 2024
Просмотров 85 тыс.3 месяца назад
As we deal with the death of the VMware ESXi free edition, in this video we look at the best free hypervisor solutions now that VMware ESXi free edition is dead. Check out the written write up of this video here: www.virtualizationhowto.com/2024/02/best-free-hypervisors-now-that-vmware-esxi-free-edition-is-dead/ Check out the VHT forums to get your questions answered: www.virtualizationhowto.co...
Proxmox Update No Subscription Repository Configuration for Home Lab
Просмотров 14 тыс.3 месяца назад
Proxmox Update No Subscription Repository Configuration for Home Lab
Firewalla Gold SE Review: Is it a Good Firewall for home lab?
Просмотров 8 тыс.3 месяца назад
Firewalla Gold SE Review: Is it a Good Firewall for home lab?
Best Virtualization Projects in 2024 for the Home Lab
Просмотров 14 тыс.4 месяца назад
Best Virtualization Projects in 2024 for the Home Lab
GMKtek Nucbox M5: Perfect Mid-tier Home Server in 2024?
Просмотров 9 тыс.4 месяца назад
GMKtek Nucbox M5: Perfect Mid-tier Home Server in 2024?
Minisforum MS-01 Review: Almost Perfect Home Lab Server
Просмотров 21 тыс.4 месяца назад
Minisforum MS-01 Review: Almost Perfect Home Lab Server
Beelink SEi12 Core i7 Review as a Home Server
Просмотров 6 тыс.5 месяцев назад
Beelink SEi12 Core i7 Review as a Home Server
Proxmox VLAN Configuration: Linux Bridge Tagging, Management IP, and Virtual Machines
Просмотров 53 тыс.6 месяцев назад
Proxmox VLAN Configuration: Linux Bridge Tagging, Management IP, and Virtual Machines
AcePC Picobox N100 MiniPC: Can it run VMware ESXi?
Просмотров 4,4 тыс.7 месяцев назад
AcePC Picobox N100 MiniPC: Can it run VMware ESXi?
Connect Kubernetes to your Synology NAS NFS share
Просмотров 4,6 тыс.7 месяцев назад
Connect Kubernetes to your Synology NAS NFS share
Acemagic AD15 Mini PC Review as Proxmox Home Lab Server
Просмотров 4 тыс.8 месяцев назад
Acemagic AD15 Mini PC Review as Proxmox Home Lab Server
ESXi Mini PC Server with the GMKtek Nucbox K10
Просмотров 10 тыс.8 месяцев назад
ESXi Mini PC Server with the GMKtek Nucbox K10
Beelink SER5 - Ryzen 7 Mini PC Home Server
Просмотров 36 тыс.9 месяцев назад
Beelink SER5 - Ryzen 7 Mini PC Home Server
Beelink EQ12 Pro: Low Power High Core Home Server!
Просмотров 22 тыс.9 месяцев назад
Beelink EQ12 Pro: Low Power High Core Home Server!
Proxmox Mini Server: Beelink Mini PC S12 Pro
Просмотров 35 тыс.9 месяцев назад
Proxmox Mini Server: Beelink Mini PC S12 Pro
Mini PC vs Server for running virtual machines
Просмотров 37 тыс.9 месяцев назад
Mini PC vs Server for running virtual machines

Комментарии

  • @ukaszszura3714
    @ukaszszura3714 День назад

    Hi Anyone know where to get esxi-arm-ISO now?

  • @fermatdad
    @fermatdad 2 дня назад

    Thank you for the helpful tutorial.

  • @EhtizanVideoEditor007
    @EhtizanVideoEditor007 2 дня назад

    Hey VirtualizationHowto, I just watched your video and I must say that it was really informative and well-made. I was wondering if I could help you edit your videos and repurpose your long videos into highly engaging shorts? I can also make high CTR thumbnails for your channel

  • @playdoh1975
    @playdoh1975 2 дня назад

    An enterprise server in iraq??? Damn what’s that like?? Lol 😂😂😂 speech to text is so much fun… 🤭

  • @JasonsLabVideos
    @JasonsLabVideos 3 дня назад

    Brandon :). thanks so much for this, i'm just diving into Proxmox on my Protectli VP6650 box and its pretty sweet. I will have to link your video in my video i make !! Thanks again sir !

  • @fernandavln38
    @fernandavln38 3 дня назад

    Good guide.

  • @gerry2345
    @gerry2345 3 дня назад

    I like this vid. Good information on proxmox.

  • @timeobserver8220
    @timeobserver8220 3 дня назад

    Is there anything with onboard integrated transcoding and 2x m2 with 2x 2.5 sata?

  • @aiwa501
    @aiwa501 4 дня назад

    Thank you!

  • @IleniaQuintero
    @IleniaQuintero 5 дней назад

    Hello, I was looking at your video channel. We may be helping a company that uses secure images to increase supply chain security and help cloud native development. Would you be willing to help try their software, make a video, and help show devs how to use their tools? This is not an offer, but just to start a conversation about your willingness to take on sponsorship. Please provide me with your email if you are interested. You'd have a chance to look at their technology and decide if it's the type of software that you'd be interested in covering in your channel.

  • @soyabean911
    @soyabean911 5 дней назад

    Great video. I'd never heard of XCP-NG before. Could you possibly do a video on some of the best Open Source Solutions for managing KVM Hypervisors please? I may be about to inherit a lot of Red Hat based KVM servers and need a vCenter style tool to manage them. I come from a VMware background. I have heard about oVirt and Cockpit but am unsure if they're vCenter style or need to be run locallaly on each KVM server. Thanks!

  • @SametKaratas-db1xu
    @SametKaratas-db1xu 5 дней назад

    Uptime Kuma may work on Windows Server

  • @user-nh4kg2zj2q
    @user-nh4kg2zj2q 5 дней назад

    Nobody explained how to install ollama and run it in properite way ، it should be step's ، is docker important to install before ollama? I tried to install ollama alone and it doesn't installed completely!! I don't know why

    • @kironlau
      @kironlau 4 дня назад

      1. you should mention what is your os 2. read the official documentation 3. if you run on win, just download the exe/msi file, install with one click(and click yes...)

  • @steheverod
    @steheverod 5 дней назад

    Its great idea, thanks Brandon. I will test on my homelab.

  • @trucpham9772
    @trucpham9772 6 дней назад

    How to run ollama3 in macos, i want public localhost to use nextchatgpt , can you share command this solution

  • @romayojr
    @romayojr 6 дней назад

    this is awesome and can’t wait to try it. is there a mobile app for open webui?

  • @igordasunddas3377
    @igordasunddas3377 6 дней назад

    Does any of this change if I want to deploy OPNsense/pfsense and use VLANs in there, too?

  • @kenmurphy4259
    @kenmurphy4259 7 дней назад

    Thanks Brandon, nice review of what’s out there for local LLMs

  • @nobody-P
    @nobody-P 7 дней назад

    😮I'm gonna try this now

  • @mkhanapathan
    @mkhanapathan 7 дней назад

    I have gone the other way from having a semi-mini server to a Dell R730 that I have worked to power optimise. With 1 x Xeon E5-2697 v4 cpu and 128gb ram with 8xDC800 ssd's and a Quadro P2000 card, everything runs at 112W with proxmox, pfsense, unifi controller, truenas,plex and with Windows 11 it humms along at 124W. With 2 x Xeon E5-2660 v4 installed the same setup runs at 140W. The stock fans are quiet using a ipmi control script from truenas forum and the network switch fans are what is the loudest in the room and even they are barely a humm.

    • @kazmir_
      @kazmir_ 2 дня назад

      Very informative, thanks for this comment. Might do something like this until I can afford a Microserver.

  • @techhypero
    @techhypero 7 дней назад

    hello, do you know how i can download nutanix CE without a company email address?

  • @shakibhossain4334
    @shakibhossain4334 7 дней назад

    Brother i'd love to know your suggestion about building a small data center for a cloud computing service company running with Proxmox as a core system. Is it a good idea to run with proxmox as the core system? Thank you!

  • @traviswilliams6140
    @traviswilliams6140 7 дней назад

    I want to see an updated video for VLAN management using the new SDN features with existing externally managed (UniFi) VLANs including tagging the host os

  • @jackt6112
    @jackt6112 8 дней назад

    Having been the CIO for two Tier 1 automotive suppliers and now owning an IT business, I know how things work in corporate America. You budget your costs every year and unless there is some compelling reason to make a change, you don't make a change. It becomes a cost of doing business, and change and all of the time lost, which results in extra staff or projects pushed behind all have a cost. This is the way things continue until someone pokes the bear. Broadcom tased the bear. It got the attention of the CIO, CFO, and CEO. The CIO now has the reason and can justify the resources. He has himself and staff that are all to eager to have the excuse to play with new technologies, and eager to take a bow for saving the company a lot of money. If they come back with something free, VMware will never see them back. In their greediness they have "chopped up the goose that was laying the golden eggs". Workstation as an olive branch makes no sense because home users are not paying for ESXi. Their IT department is paying $249 for workstation, now reduced to $199.

  • @jackt6112
    @jackt6112 8 дней назад

    1. I've been in the IT field for decades and own an IT company. I can tell people that nothing can hold a candle to VMware. They had the first cost effective VM system and are still the leaders from a performance and functionality perspective. 2. I do not agree with your logic as to why the change to free for personal use. Workstation as an olive branch makes no sense because home users are not paying for ESXi. Their IT department is paying $249 for workstation, now reduced to $199. Workstation was spun off from the main group to a separate entity years ago. That doesn't take away from the fact that Workstation makes any competitor in that area look Mickey Mouse from a performance, feature, and rock-solid reliability perspective. If you make your living in the IT field, you cannot be annoyed by and spend your time working around bugs and peculiar behavior. 3. We also have ESXi free and paid out there. I always felt that free for commercial use was a mistake from the get-go. Initially, they wanted to charge a lot for backup capability and later made it much less expensive. However, the fact is you don't need their backup software to back it up, often we have not, and you can do it simply for free. What you gain by paying is an API that can work with backup software. While having the free version seemed like a bad move to me, it might have been somehow to their advantage to establish themselves as the standard in a market that for the first time had the hardware capable of cost-effectively leveraging virtualization. The processor capabilities that you see in the Intel processors came from VMware schooling Intel, who were only too eager to learn from them. VMware architects worked full-time at Intel. Today, that architecture is incorporated into other brands. When Hyper-V entered the scene, every advantage they talked about having over VMware was a disadvantage, and laughable to anyone who understood virtualization technology. We watched the dunces talk about the advantages of Hyper-V as if they understood what was going on, and Hyper-V over time incorporated the very technologies their FUD machine cited as disadvantages earlier as though they invented some new amazing technology. 4. Licensing for ESXi has always been strange. As soon as you wanted to add any management, their licensing costs didn't scale in line with the usage. This kept a lot of people in the free tier. There is a lot more to VMware for the enterprise than ESXi, and they have an incredible environment when you put the pieces together, which is why it has been cost-effective for larger organizations. More capabilities, less hardware, less man hours managing, and rock solid reliability. 5. I don't understand Broadcom's strategy after they bought the company. It is a stretch to chalk it up to naiveté on the part of people they've paid cubic cash to get it right and have a track record of getting it right to get the job. Their stock jumped 25% because of the huge licensing fee changes. However, as they partied, they witnessed the ominous handwriting on the wall by the finger of their user base and the world. Even IF their new licensing fees could be cost justified, a large percentage will react by investigating alternatives and implementing lesser alternatives as long as they can do the job. Decisions are made on more than logic. Example: Comcast has been stiffing us for decades, going up and up and going from $87/mo. to $199/mo. They always have deals that expire and then only have good deals for new customers. AT&T laid fiber in our area, cut the cost in half, gave better performance and symetrical up and down, making remote backups between our servers practical. Moreover, you can leave and come back at the same price and they will guarantee it for 2 years. Then Comcast comes by with a lot lower prices and the promise of going symetrical in the future. When I talked to the business owner across the street I said, "I don't care if Comcast comes in at 1/2 the price of AT&T, I'm never going back there." His response was, "Me neither. I don't care what they come up and won't even take their calls or open their envelopes." On the flip side, if you don't see making Workstation free for non-commerical use an olive branch, then what is it? One possibility is it wasn't going anywhere because people were using the alternatives and they stood to gain by getting it into the hands of future IT support people. If not these, then it is just as difficult to make sense of as their licensing moves as it is with ESXi. (When I bought 16, it was $249, not $199.) 6. To us, it does not make sense what Broadcom did. The part that we don't understand is that might be that they see the progression of the industry toward other products, it put VMware in a position to be bought, and this move by Broadcom is a "Hail Mary". Here is a quote: "Computer Associates International, Inc., and CA, Inc., was an American multinational enterprise software developer and publisher that existed from 1976 to 2018. CA grew to rank as one of the largest independent software corporations in the world, and at one point was the second largest." That's the official word. Reality: CA is where software went that was losing its future. CA were masters at keeping advertising, development, and support in line with revenues until there was no significant profitability and made a lot of money doing it. Because of this, they could outbid anyone else and convince stockholders to sell to them. Offhand I can't think of anything they developed unless it complemented something they had previously bought. Hopefully this is not what is going on with VMware, but this brash licensing move at a time when free alternatives are maturing makes one wonder.

  • @kishorparmar4066
    @kishorparmar4066 8 дней назад

    How to install on Virtualbox ??

  • @didierdel2319
    @didierdel2319 8 дней назад

    Bonjour, obliger d'acheter une carte réseau Intel de serveur, pour pouvoir installer Esxi 8. Heureusement Amazone est là ! ! Mais c'est vrai que la configuration et l'utilisation Esxi est plus facile qu'avec Proxmox.

  • @tomheinrich7776
    @tomheinrich7776 8 дней назад

    Is it possible to share the custom ESXI image ? Perfect would be Version 7U3 with integrated community drivers.

  • @cliffl7619
    @cliffl7619 8 дней назад

    It's "free" for now. After making you jump through all these hoops to download it, they then ask for all of your detailed personal info full name, address, multiple terms of service sign offs. Once they feel enough suckers, I mean people, have downloaded it and started using it, get ready for free to be replaced by fee.

  • @BOOSTEDDUDE
    @BOOSTEDDUDE 10 дней назад

    Thanks for this video. I'm getting prepared to help upgrade an environment that has lots of ESXi patches listed as Critical. I'm hoping to take the best approach possible.

  • @GTOGregory
    @GTOGregory 10 дней назад

    I don't suppose this Workstation version has a feature to simulate a TPM 2.0 module? That sure would be a helpful feature as my hardware lacks a TPM. It's not that old, but I'm not ready to upgrade everything as I don't know what the requirements of Windows 12 will be.

  • @jonathanchavez2312
    @jonathanchavez2312 10 дней назад

    Hello, when trying to access the sphere client I get "no healthy upstream"? Not sure how to fix this. It worked at first but now I get that. This is on my Lab using Vmware workstation Pro. I can also get to the VMware vCenter Server Management with no issues.

  • @ManOwaRitis
    @ManOwaRitis 10 дней назад

    You mentioned that Nakivo also supports Proxmox, but it was not showing in the list of hypervisors on the second step of your introduction. Am I missing something?

  • @sekritskworl-sekrit_studios
    @sekritskworl-sekrit_studios 10 дней назад

    Where are the SATA slots for NAS😢

  • @lexidecimal9941
    @lexidecimal9941 11 дней назад

    Im geting an error and cannot add the esxi storage. Is there some fw rules on esxi thats prvwbting this connection? Theres many rules but i didnt build it.

  • @user-od6gi4lz8t
    @user-od6gi4lz8t 11 дней назад

    Thanks for this video, I love your channel and subscribed! ❤ Do you have any other monitoring system to suggest easy and nice like Kuma? I’m looking to implement something on my Raspberry Pi 4, thanks!

  • @zackshaikh4601
    @zackshaikh4601 11 дней назад

    Thank you! for the video here, very useful. I have a question and hope you can answer. I have tried these steps to create a VM inside VMware ESXi and bare-metal, but both failed at the last steps, which required a reboot. it's terminating with the following message. 2024-06-14-18:55:26-UTC INFO Installing /usr/lib/python2.7/site-packages/foundation_layout-2.12.4+r.1704.5fa2273-py2.7.egg 2024-06-14-18:55:27-UTC WARNING Unable to detect directory with aurora [screen is terminating] Any idea?

  • @Ixspar
    @Ixspar 11 дней назад

    Decided to purchase the Minisforum MS-01 on your recommendation (plus a few other sources). It has been a nightmare dealing with these people. DO NOT, DO NOT, DO NOT purchase via their website. It is not worth the savings over Amazon. Fortunately, I purchased using Paypal. I made my purchase and they replaced my billing address with the shipping address. I did not receive the promised invoice for my purchase. Sent an email correcting the glitch on the billing address and requesting an invoice. It has been 16 days and a Paypal dispute process. Today the product showed up but STILL no invoice. Considering every computer related warranty service I have had over the last ten years has required an invoice/proof of purchase, warranty service is going to be another horror story. Let's not mention, this thing could be stolen and I have no way of knowing. I cannot recommend you avoid Minisforum enough. What a terrible way to do business. Update: It has now been 21 days. All further requests for an invoice have been ignored. Escalated to Paypal requesting an invoice or refund. I do not recommend doing business with Minisforum and will not do so again.

  • @Check_This_Out188
    @Check_This_Out188 12 дней назад

    I am trying to choose the home server. I was almost convinced to buy dl380 gen 10 with 2x intel 6152 CPU and 256gb ram. But then I watched a lot of videos how this server boots and I was disappointed. The sound it makes during boot is unacceptable for my home. I was wondering does it that loud when you load them very hard? alternative has been found as hp z8 g4 with x2 intel 8160 and 256gb ram. research I did make me think that this is just as good as dl380 setup I mentioned previously. I would like to have a advice witch one is better and how loud they are. Thanks!!!