Chatbots are a common occurrence now and are used by millions of people to aggregate information and present it in a quick and easy-to-access format. In fact, this article is written by AI. We are just kidding. Or are we?
NVIDIA’s new Chat with RTX is now available as a free download and offers the same usefulness as an AI chatbot but for your local files and information. Instead of pulling information from the cloud, it works through files stored on your PC to enable user queries for any relevant information they require from it.
So, let’s say you want a quick recap of the minutes of a meeting. Instead of scanning through pages and pages looking for relevant information, you can simply add the file to Chat with RTX’s library and ask it to pull out any information you want from it. You could simply ask it, “What does my boss want me to do for tomorrow’s client meeting?” and it can provide a quick summary of the discussed matter.
The tool supports various file formats, including .txt, .pdf, .doc/.docx, and .xml. It can also read YouTube videos and playlists for contextual queries. For example, you can ask the chatbot to recommend the best places to eat from your favourite influencer videos or get quick tutorials and how-tos based on top educational resources, and it will summarize it in a neat little package.
Chat with RTX uses retrieval-augmented generation (RAG), NVIDIA TensorRT-LLM software and NVIDIA RTX acceleration to bring generative AI capabilities to Windows PCs. However, to use this new tool, you need an NVIDIA GeForce RTX 30 series GPU or higher with at least 8GB of VRAM to power it properly.
Will you be using Chat with RTX to run your own locally-powered AI chatbot? Let us know in the comments!
Mufaddal Fakhruddin has been writing about games and technology for the past 15 years. He has lost count as to how many reviews he has written over the years, but he is sure headphone reviews make up at least 70% of that.