Chat with RTX from NVIDIA is free, works fully locally on the user's computer and does not need an internet connection. And this means a much higher level of data privacy and significantly faster work.
Free access to this article is provided to you by MU Group.
NVIDIA has presented a demonstration version of its new AI chatbot - Chat with RTX. The tool operates entirely locally on personal computers with the Windows system and allows users to create their own, personalized AI chatbots.
They are based on one of two large language models (LLM) - Mistral or Llama 2 - and use data from the computer on which they were installed.
Thanks to this, users, instead of manually searching files and notes for specific information, can simply ask the chatbot, which will scan the indicated documents in a few seconds and provide an answer along with the context. Chat with RTX supports various file formats: .txt, .pdf, .doc/.docx, or .xml, as well as YouTube videos or playlists.
"Because Chat with RTX operates locally on Windows computers, results are delivered quickly, and user data remains on the device. Chat with RTX also allows for the processing of sensitive data without internet connectivity or the need to share them with external entities" - NVIDIA assures in a post on its blog.
Chat with RTX is designed to work on modern computers equipped with NVIDIA GeForce RTX 30 series graphics cards or newer, which have at least 8 GB of VRAM (video random access memory). The tool also requires the latest NVIDIA drivers and the Windows 10 or 11 operating system.
Chat with RTX offers significant value for people who care about the privacy of their data and want to have more control over chatbot technology. Local data processing significantly reduces the risk of information leakage, which is particularly important in the context of subsequent privacy breaches by modern AI-based tools.
Therefore, the tool can find application not only among homegrown technology enthusiasts, but also in the business sector, education or research, where data security and information personalization are key.
Jakub Rusak
Blindly following trends, lack of a clearly defined identity and vision, or relying on too narrow measures of success. How not to fall into the most popular traps that lurk for brands on social media?
Inclusive language is a way of communication that aims to avoid discrimination and promote equality by taking into account differences. Unfortunately, something that should unite, more and more often divides. What does this result in and how to change it?
As the only company in the world, it is able to produce processors in the most advanced 3 nm technology. In addition, it owns the most expensive factory ever built, and its clients are Apple, NVIDIA and Intel. How did it happen that Taiwanese TSMC became one of the most important companies in the world?
The PFR Ventures team has prepared a list of B2C products and services from Polish startups for this year's Santa Claus, which can serve as Christmas gifts. What's on the list?
English