Local Large Language Models
Operate an LLM within a DaDesktop instance rather than transmitting your prompts to external APIs. The model executes on DaDesktop's GPU infrastructure, ensuring that your prompts, files, and associated data remain confined within the desktop environment. You incur costs based on the desktop resource rather than on a per-token basis.
Benefits of local LLM execution
- Ensure data privacy: Your prompts, files, and other data remain secure within the DaDesktop environment.
- Eliminate per-token fees: Utilize DaDesktop's GPU infrastructure to run models without incurring API charges for each individual request.
- Select your model: Choose the specific model you wish to deploy and manage its configuration parameters.
- Execute custom workloads: Interact with the model directly from the desktop, integrating it alongside other applications and tools.
AI agents
Deploy agents that leverage local models to accomplish tasks and interface with external tools.
Coding
Utilize local models for coding assistance, software development, and testing purposes.
Research and experimentation
Employ models for research, data analysis, and the evaluation of various models and configurations.
Operational overview
Select a DaDesktop GPU instance, load your preferred model, and execute it locally. GPU passthrough functionality grants the desktop exclusive access to a physical GPU dedicated to LLM workloads. You can review available GPUs, specifications, and supported configurations on the GPU page.
Start Your Free Trial Today
Run seamless virtual IT training with cloud-based labs, no downtime, just scalable learning that works.